I guess it would depend on if I were to have known what I would have done with the time otherwise. If I could go back in time, would I have seen myself writing a Pulitzer Prize winning novel or accidentally finding a cure for the common cold? Yeah, then I would regret the time I've played video games. Otherwise, if I were to just have watched TV, learned how to play an instrument, or painted Warhammer 40k figs, no, I wouldn't regret it.
Now, there are games that I regret spending so much time playing, usually MMOs. But I look at that as not a real waste of time if I had fun while playing, even though there was not clear cut ending.