I am likely biased as I am not a breast man. I literally won't notice if a woman is an A cup or a D cup. But I have been around houses and communities where women walked around topless, and the men weren't gaping with drooling mouths.
There have been societies where topless women was the norm. Ancient Egypt was one, I believe. And I think certain Native American tribes were another.