Yeah, you are not alone with this habit, I think I first did it in Baldur´s Gate 1, with Montaron and Xzar.
Also, BG1 had one genre-savvy NPC that knew how to (partially) prevent this: Xan, he had a sword that only he can use. (And it´s a really cool sword, basically a laser sword.)