Unlike half the people here, I have no problem with what you believe, and even find it annoying how several people say you'll be miserable as if the pleasure factor is all that matters, even though they've already been proved wrong about what it can be like by several others.
Do whatever you want. I'm in the same position as you(Well 16, not 19), but I'd like to focus more of the loving side instead of whether they're a virgin. I can understand that though. I'd certianly be a bit aggitated if I was having sex with someone who previously had sex with someone I hated. That's a bit childish for me to think though, but I don't think your idea is at all selfish, afterall it's only denying yourself sex for someone of comparable level, so you can both have the same first experience.