What I like about Yahtzee's reviews, (aside from the humor, of course) is that he does a very good job of pointing out the bullshit and little ridiculous things in games that we sort of just accept and don't really question. I won't scour all of his videos for examples, but one that comes to mind is his comments on the improbably high number of chest-high walls in every damned area of Gears of War 2. He's good at pointing out silly conceits made for gameplay such as that. What I dislike about Yahtzee, however, is how political (for lack of a better word) his reviews and picks are. I do not honestly believe that he thought Saints Row 2 was really the best game that came out that year, but he had to choose a game to fit his persona and attitude.
I watch Moviebob's reviews occasionally. I won't say he has bad taste, but I will say that I disagree with a lot of his assessments.
As for the other reviews on the site, I read them to generally just get an idea of what a game has in store. I don't take the Escapist's (or any other news outlet, really) say as the final word.