You realise that pretty much everything you talk about can be summed up with "I'm not very good at this game or its puzzles, and that's the games fault".
I've didn't have any problems with any of the stuff you mentioned. But then, I'm good at games, and appreciate them for more then just "being something to play". I love everything about Colossus. The art, the music, the story, the giant empty world that's both ancient and beautiful, yet has an aura of loneliness. And of course, the Colossi are simply magnificent. They come across as real living beings, simply defending themselves or their territory rather then trying to maliciously kill you. In fact, YOU'RE the one trying to maliciously kill THEM. It's tragic, and makes you feel terrible for doing it.
And I can say that easily, cause I've replayed the PS3 remake probably once a month since its release. I haven't "forgotten" anything. A game doesn't become renowned for no reason. If your having major issues with it, chances are it's either A: your skill level, or B: simply not a game for you. Put down the controller, turn off the game, and play something you enjoy. Don't try to convince a massive and established fan base that they've been wrong all these years. Never ends well.