I struggle with games that involve buildings. They make me incredibly claustrophobic. I think that it's not being inside a building per se, it's the low ceilings, dark corners, unknown doors and lack of exits. I can't stand it for very long at a time.
I find System Shock 2 especially bad in this regard, as it is ALL corridors and low ceilings and doors with stuff behind them... I even freak out in Sledge's Safehouse in Borderlands. Just one little mission... it doesn't take too long, but I can only do it multiplayer, and then I have to follow the other player and I beg them to find what we need fast so I can finish and get out...