I would say to be true chaotic neutral, what you should do is sell the slaves to the slavers, then kill the slavers. Because what the slavers do is evil, and neutral is balance. And you get money, and people (the ex-slaves) like you. Bonus points if you get the slaves to help kill the slavers to...