People, particularly people with controversial or "edgy" opinions, and especially people with JP-style controversial edginess, tend to hide their opinions behind that exact thing. His fanbase tends to be pretty religious about it and so people who start prattling on about his stuff come off as a red flag. It's a bit like "I'm not racist or anything, but-": you sorta know what's coming.
It's knee-jerk stereotyping, but not exclusively for a poor reason: it's a consequence of a bunch of his fans being cagey. You can obviously quote him or know some quotes without agreeing, but maybe it helps to make it clear. Or just don't refer much to him at all, I guess: anyone who doesn't already know about him can't really profit from learning about his BS.