I don't use the exact phrase, but I still have to get the same idea across when I talk about most things that I like. For example, I am a musician, a percussionist to my core, and there is nothing is this world that even comes close to my love of the marimba in particular. Since music is so central to my everyday life, the topic will certainly pop up in casual conversation. When I don't have to explain what "percussion" is, I have to describe what a "snare drum" is, or what "timpani" are. Even when I don't have to describe those, it is a very rare treat for someone to intrinsically know what a marimba is, so I have to proceed to give the same song and dance using the dreadfully inaccurate phrase that it's "a really big xylophone". I often try to describe the more important differences, such as in the overtones and timbre, and the amount of mallets generally held in each hand, but that often goes over the heads of the people less familiar with musical instruments. Oh, and I just don't even try to describe the world music instruments I play/enjoy, I usually just avoid mention of the instruments themselves, or just mention that they're obscure.
Apart from that, my interests concerning video games are terrible for trying to find two-sided conversation, since I have a penchant for gaming history and I rarely get modern AAA games, since I usually just use Steam or play games from previous console generations, and I'm a noncompetitive antisocial gamer. It doesn't make sense to assume that the average person will know about the video game crash of '83 or that they will know much about the Anonymous/Sony PSN scandal. It's never that I'm dismissing the mainstream, I just have uncommon tastes, and fortunately, I have yet to hear someone accuse me of doing so.
I'm lucky to not be mislabeled a hipster, though that might have to do with the fact that I generally wish that more people knew about the topics I enjoy rather than being uninviting to those interested in the topic.
Captcha: hobby-horse. Strangely appropriate considering how often I try to converse about these topics.