When I was a kid, really nobody wore hats. The borderline between hats and caps in Yugoslavia goes by simple definition: if it has a rim all around, it's a hat. If it has just a shield in front or has no rim at all, it's a cap.
Hats were deemed somehow capitalist, too bourgeois. Regular people would wear a šubara - a fleece fez of sorts, mostly black lamb. I had one when I was age 5 or so.
There was a hat factory in my town. An old one, and it did make hats - hey, even Tito wore a hat, but he was a dandy. Regular serious folks wore berets, by same factory (though there was another one in Vršac, made berets only - naval infantry, aka marines, wore them, hence the need). Except they'd wear them like skullcaps, not bent to one side. And this hat factory was mostly making berets, even though beret classifies as a cap.
Actually I do remember few people wearing them - Teja's husband for one (but then he was one of perhaps six bald people I knew then), and so did my grandfather, but that was a simple peasant's hat, nearly shapeless. Had a straw hat and a nice hat for important days, though.
It didn't change much in the next century. There's still a small percentage of guys wearing them (including me - I had one in the early nineties, two since 2010, all from this factory), but now that the factory is killed, there's no interest for import either, and a proper hat has become a luxury item, a rarity that will cost you. Though I heard that a bunch of guys bought off some of the machinery and went into production on their own. Haven't seen anything from them, though.