I did that, too. And more. Nearing the end of the game, I would have one group of four I would always travel and fight with. Naturally, those four were the only party members who had any gear on them, since i saw no point in equipping people who just hang around at camp.