If I've had more than one pleasant conversation with someone (or a long conversation), I'll typically add a person.
If someone adds me, and we've actually had friendly interaction, I'll return the favor. Still, my "Friend of" list is longer than my "Friend" list, because some people have added me as a friend for no discernible reason.