I had a discussion about this with a friend recently. I'm personally of the opinion that it doesn't really matter, and that the context is everything, though, I very rarely use the phrase.
Also, does anyone else think it's odd that the meaning of the word 'gay' has been completely inverted...