I keep them on, because I generally have no control over the noise level around me, and I hate missing dialogue in case it's interesting or useful. I can also read about twice as fast as the actors in most games speak, so I can get through the game marginally faster with less boredom (I find it intensely boring to listen to someone speaking a sentence I just read for myself).