I swim and I fence, but I don't have time to swim as much as I used to.
While both those sports are good for general fitness, especially with regard to cardio, neither are particularly good for building up muscles. So no, I'm not muscular in the least. But I am stronger than I look.