Yes.
I was small and skinny my whole life, resulting in constant abuse all the way until I hit college. Even today I still take shit from people that I know I wouldn't if I was about 4 or 5 inches taller. I'm about 5'10" 155 now, but I was young for my class and very thin boned, so being much smaller and weaker I was an easy target.
It was a challenge, but you learn to use what God has given you. Also, martial arts go a long way in overcoming the "I'm too small to matter" self-defeating complex. In my case I really didn't learn how to defend myself and stand tall until my mid-twenties, but...that's life.