It’s usually the other way around. The nazis slowly corrupt a community that consists mostly of one of their target groups, pushing out people who are aware of their dogwhistles because, well, they’re clearly nazis, and is not going to recognize that or listen to you, as they wouldn’t make a good target group otherwise.
Then, if they succeed, at some point it gets bad enough that the media notices, after which the nazis go “look at the silly liberals, thinking everyone is racist these days” and get a lot more open, thereby pushing out the last few people who were initially oblivious to there fascism, or forcing them to endure fascist rethoric to enjoy their hobby’s community.