Well, first, the attitude that brought about many of those "features" wasn't just a little off-putting. It had anti-consumer implications that posed a serious threat to the rest of the industry. It posited an "always on" feature that was inconvenient to many customers and seemed largely about protecting companies from the used market and enabling the "day-one patch" and heavy DLC sales models that so many of us have come to loathe. And that's before the incredibly misguided sense that the XB1 was a media center first and a games console second, as reflected by the heavy emphasis on television in early promotions. To the best of my knowledge, the "media center" functionality still serves as a roadblock to developers being able to make full use of the system's resources, functionality that apes many functions that exist in devices users interested in watching television already own.
That Microsoft eventually backpedaled on most of the worst ideas doesn't mean they replaced those "features" with things their customers actually wanted. And I think many people, myself included, are still waiting for indication that the "we'll tell you what you like" sentiments have actually been excised from their creative processes, rather than that a single generation of those sentiments' products have merely been amputated due to direct consumer pressure.
Similarly, while Microsoft has started making some inroads in the "indie" market, they have a lot of catch-up to do, and a long and regrettable history of alienating independent developers and putting hurdles in the way of their creating and publishing the games they wanted to create.
Then there's the Kinect. Ignoring the security issues and laying aside how long it took Microsoft to detach the hardware so their console could approach price parity, Kinect has largely remained an interesting idea that almost no one, including Microsoft's own people, has been able to make functional software around. Sure, it might be fun to call out commands to your console, but most implementations have been gimmicky at best, glitchy and ill-conceived at worst. When the hardware that made you spend over a hundred dollars more than you would have for a competitor's product just makes you swear at the screen and wish the dev had simply designed with the traditional controller in mind instead, you have a problem.
Others have pointed out that few of the console's titles aren't available for PC. With Street Fighter V now coming to PC and PS4 but not the XBox One, that becomes particularly glaring.
Basically, The XB1 occupies a space right now that begs the question "Why?" in all but hardcore brand loyalists. Unless one is fanatically devoted to Microsoft or Halo (and that latter loyalty has survived the original creators moving on to other projects), or mad about Sunset Overdrive (a game some have quite enjoyed, in fairness), or perhaps sustains a steady faith that something like Crackdown will return and make it all worthwhile...
...The XBox started out costing more, and Microsoft's reversals have left early adopters with little but grief to show for it. Most games common to both systems play as well or better on the PS4 for those with budget issues, and often far better on PCs for those who shell out for high-end gaming systems. More games are available for both the PC and PS4; more interesting games seem to be in the works for both the PC and PS4. Games like Titanfall and Killer Instinct have started big but ended up underwhelming; semi-promising new offerings like Quantum Break, promoted from XB1's inception, have suffered long delays.
Now, all this negativity said, I'm sure there are people out there with XBox Ones that have had enjoyable experiences with them. That is: there is a box under my tv, I use it to play games, I can play those games and have fun. If one isn't immersed in "game culture" and constantly reading about news and new releases, I don't doubt it would be perfectly possible for one's ownership of same (and only the same) not to be tinged with envy, exasperation, or resentment; just pleasant game and media experiences.
But for someone who does allow themselves to delve into such matters, and make comparisons, and read the scuttlebutt regarding the options, and doesn't start into the fray with strong pre-existing brand loyalties... It's hard to see what would make one choose the XB1 over the PS4 or the PC.
Hell, even the Wii-U has had more well-reviewed exclusive titles at this point.
TLDR: People dislike the XB1 because other available options surpass it in virtually every field that informed people would consider in choosing a game console, including price, performance, available software, "indie" support, exclusives, and customer relations.
(And yes, I'm aware Sony has some utterly horrorshow stories of customer relations, but in recent days this is one field where Microsoft has, regrettably, kept up.)
