You might want to talk to a therapist because that is not a “cultural” difference.

But if you don’t care that other people around you think you’re an asshole even if they’re not coming up to you and saying it, then there’s nothing anyone can say.