Lydia's the only follower I ever brought with me anywhere, and I guess I had her around for half the game. I left her at home for the DB and Thieves Guild quests.
And if she died, I reloaded a save.
And if she died, I reloaded a save.