It's basically just the right to privacy and safety. Since you're only using voyeurism as an example, everyone has the right to do as they please (as long as it's not illegal) in their own homes without feeling like their privacy is being invaded. If you don't want people watching you do something in your own home, then you have every right to make sure it doesn't happen.
Right to privacy, simple as that.