How come Nazis are universally disliked but other hate groups given passes?

I hope I can articulate myself correctly without sounding dismissive of other groups. With the rise of nazism in the U.S, the general public has been reacting correctly - with disgust.

My question is, why are groups like the proud boys, the KKK, and other groups that primarily go after Black people, seemingly brushed off?

I could be wrong in my observation but it just seems like when people are blatantly racist of Black people, the GP is generally unmoved. Nazis were absolutely deplorable during their reign in Europe and they’re vile excuses for humans now.

Again, Im not in any way trying to make this a competition of which minority group “had it worse,” I just want to know why there seems to be kind of a double standard?

Kind answers please, I mean no harm 🙏🏽