when you combine takai and biru (sorry, no Japanese support on this computer), takai means tall, not expensive.
Also, when using the past tense as a noun-modifying clause, such as "takakatta biru," it sounds like the building WAS tall, but is now not, perhaps because it shrank or fell over. Same with the negative past tense; it's as if the building used to be (whatever adjective in past tense), but is no longer that way. Generally, we don't use the past tense in noun-modifiers like this. Also, you don't need to put spaces between words in Japanese.
But grammatically it's conjugated correctly.