The characters, in my opinion. You could write a book about a man coping with the runs all day, but as long as he's interesting, the poor quality of the subject matter can be forgiven. Case in point: Scott Pilgrim.
Similarly, an excellent concept can be ruined by flat or badly-done characters. Case in point: Eragon.