If I remember high school physics correctly, I don't think you can make a direct comparison without knowing the forces at work.

For example, you can't say these two people colliding this the same as these other two people colliding if in the first case it's my four year old bumps into me while walking and the second case is an NFL linebacker at top speed. I hope I'm only in one of those situations.

So you have to ask how big and how fast. It says video unavailable what kind of plane was it?

Also the Empire State Building is covered in stone. The facade is limestone and granite.

https://media-cdn.tripadvisor.com/media/photo-s/08/2f/89/f6/empire-state-building.jpg

According to official fact sheets, the facade uses 200,000 cubic feet (5,700 m3) of limestone and granite, ten million bricks, and 730 short tons (650 long tons) of aluminum and stainless steel.

So the construction would play a part too.

I think you would need to do a lot math to an apples to apples comparison. I suck at math, so not me.