The way I see it, there are two ways time travel works out.
A) The future you already went back in time and attempted to do it in your timeline. Since it still happened, you obviously failed, or worse, caused it.
B) Time is incredibly fragile and by going back in time and changing the past...