It seems to me that most people are ignorant fools, particularly about dogs. I wouldnt worry about it or else find another place to walk if it bugs you that much.
I have the opposite problem lots of people come shrieking up to Jonah to fondle him especially kids and I have had to be rude a few times to dimwits who wont listen when I ask them not to touch him as he is very fearful of people reaching for his head and bending over him.