Revelation 21:15-21 provides evidence that in Heaven, there is a real city (especially note in Verse 17, where the walls are measured, and that angel/human measurements are the same.)
Furthermore, note that in verse 5,
5Thomas saith unto him, Lord, we know not whither thou goest; and how can we know the way? 6Jesus saith unto him, I am the way, the truth, and the life: no man cometh unto the Father, but by me.
Now, it seems like if Christ was referring to an earthly house / temple, the conversation might have been of the form "great, what are the cross streets."
It seems like the fact that Thomas not knowing where the house/temple is -- and Jesus responding with "I am the way" rather than "go to the house by the lake" seems to imply that it's heavenly rather than earthly.
15And he that talked with me had a golden reed to measure the city, and the gates thereof, and the wall thereof. 16And the city lieth foursquare, and the length is as large as the breadth: and he measured the city with the reed, twelve thousand furlongs. The length and the breadth and the height of it are equal. 17And he measured the wall thereof, an hundred and forty and four cubits, according to the measure of a man, that is, of the angel. 18And the building of the wall of it was of jasper: and the city was pure gold, like unto clear glass. 19And the foundations of the wall of the city were garnished with all manner of precious stones. The first foundation was jasper; the second, sapphire; the third, a chalcedony; the fourth, an emerald; 20The fifth, sardonyx; the sixth, sardius; the seventh, chrysolite; the eighth, beryl; the ninth, a topaz; the tenth, a chrysoprasus; the eleventh, a jacinth; the twelfth, an amethyst. 21And the twelve gates were twelve pearls; every several gate was of one pearl: and the street of the city was pure gold, as it were transparent glass.