Libertarianism is bad because bad people reject it?

I was going to give a comprehensive response to Matt Lewis's article in The Daily Beast, The Insidious Libertarian-to-Alt-Right Pipeline, but after reading it I decided not to waste my time. It's a guilt-by-association hit piece pretending to ask difficult and potentially troubling questions about libertarianism. Lewis asks:

Is it just a phase they go through—or is there something about libertarianism that attracts, well, uh, you know, racist kooks?

It's clear from the sarcastic, "aww shucks" tone of the question what Lewis thinks. What he's is trying to do is to cast libertarianism in a dark light because official Bad People have at one time or another identified themselves or been identified with libertarianism. The problem with this analysis is that it ignores the obvious point that these people rejected libertarianism and moved on to something else.

So far from having bad feelings about libertarianism, I feel great that people with views I find repellent or at least irritating never felt comfortable identifying as libertarians and moved on to something else. I'd say this clearly speaks in libertarianism's favor as an ideology.