So, early on in the game I stole an Elven Bow from a display case in Whiterun. When I flaunted it in front of its former owner, they didn't seem to care. I thought I was in the clear. I have failed to find a better bow, so I've been using it ever since. 12 hours later into the game, I take a carriage to Windhelm. Before setting out into the wilderness, I decide to "discover" Windhelm so I can fast travel there.
I approach the gates, but a guard stops me. "Yes, I know you from somewhere," he ponders; he then tries to arrest me. I agree to pay the paltry 26 gold fine and be on my way. But, he then mentions he'll be confiscating any contraband I have on me. I had a hunch... and sure enough, yes, my Elven Bow had been taken. So, I steal a bow in Whiterun... 12 hours later, in a place I've never been to before, a random guard "recognizes" me. That was unexpected. Guess who's reloading?