I disagree with your point about pacing and voxophones, it really doesn't grind the game to a halt. It's just natural exploration of the area you are and fits with the game's "panic, panic over" general pace that allows you to search and prepare for the next panic.
The story is mostly good, save for the ending, which was pulled out of someone's ass somewhere along the line and had the shit carelessly brushed off. Had the entire game not been rewritten we would have had a far better result, look at the 2011 E3 demos and tell me what we got was as good as those.
Gameplay is repetitive and the tacticool guns didn't really serve much purpose. Your point about not having to rely on RPGs to dispatch large enemies or tough groups has no foundation since every area with a handyman or tough enemy group usually has an enemy using a volley gun or an RPG lying around. If you ever get into a tangle there's a weapon that serves your need lying pretty much at the entrance, especially prevalent with sniper rifles.
Music and sound was well done and provided a great backdrop to the game, it's a completely under rated part of video games but it does set a lot of tone. The only issue I draw with Bioshock Infinite's sound is that it does fit the cliche of "feel this way" music, but then again everything does this now and I can't think of many ways you can achieve the kind of atmosphere Bioshock has without it.
Graphically the game is lackluster. The NPC animations are boring in every sense and don't play the part they need to, though this could also come from the rewrite and rush to completion, a lot of the game seems to have been lost in the rewrite. Texturing is appalling, there are textures in key areas that have such a low resolution and level of detail that you would think they were pulled from a game from the late 90s. These textures are also present in areas that are specifically added to provide detail to the world, like the vegetable stands and roses near the start. Where the game has done it well though, it is done with enough care that you really become immersed in the world, just not enough to prevent the detraction of the poor areas.
A lot of the world feels empty and dull, but it performs well where it chooses to. I can't help but wonder what the original would have been like, and if I would be happier or more impressed if we'd have received that version instead.
Also Captcha is star spangled. Nice one Solve Media.