Facebook Just Revealed Its Secret Strategy for Taking Down Hate Groups

The company recently removed a small network of the “worst racists” in America.

Josh Edelson/ZUMA Wire

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.

The members of Northwest Front have been called the “worst racists” in America, amid stiff competition. On Wednesday, Facebook told Mother Jones that it had used a new enforcement strategy to take down a network of Northwest Front accounts that tried to circumvent the platform’s ban on white nationalists.

“This organization has been banned on Facebook for years now. We recently identified that they had tried to reestablish a presence on the platform. What we decided to do is identify as many of their assets as we could, identities of their supporters and members, groups, pages, and then take them all down at once,” Brian Fishman, Facebook’s director of counterterrorism and dangerous organizations policy, explained on the phone.

The action against the Northwest Front that Fishman outlined is a strategy that Facebook occasionally uses to stop the most egregious and dangerous groups from using its tools. Until Wednesday, the company had not shared any details of that strategy publicly.

The group had been organizing on Facebook and attempting to use the platform to recruit potentially sympathetic minds into the neo-Nazi group. 

Typically, Fishman explained, most content that violates Facebook’s terms of service is reviewed and taken down as quickly as the company can manage it; the takedowns are accompanied by messages to violators about how they’d breached platform rules. In the case of the recent move against Northwest Front, though, the company instead opted to monitor accounts of individuals associated with the Northwest Front, in the hopes of finding a larger chunk of the network and taking it all down at once, with no explanations given.

“This is different than our normal operations. The reason for doing things like this is to make it more difficult to rebuild a network,” Fishman said. “If you take out one piece or consistently takedown pieces, then they still can try to rebuild.”

Fishman emphasized that Facebook was not ignoring normal policy violations while monitoring the group. “If something came into standard enforcement flows, it would come down,” he said.

“Also if we recognize something that was an imminent threat, we wouldn’t delay. If we identify something that indicated that there’s potential for harm, we’ll take enforcement action,” Sarah Pollack, a spokesperson for Facebook, added. 

Facebook would contact law enforcement if the group posed an imminent threat, Fishman said. It would also work with its lawyers to loop in law enforcement, the military, or other government groups if its investigators came across any white nationalists working in their ranks.

Facebook has been deliberately opaque about its strategy in the past. That’s because the company wanted to make it harder for groups like the Northwest Front to understand what was happening and figure out how to dodge detection in the future. Fishman was light on a lot of details about what Facebook looks for in monitoring these types of groups. Often, he said, Facebook won’t say that it took action on a set of accounts, leaving users puzzled as their accounts, pages, and groups are deleted without explanation. 

“Sometimes these groups are confused about actions. That’s a positive effect from my perspective,” he said. “When we’re talking about terror groups and hate groups, ambiguity can be a useful tool.”

The overall scope of the takedown was small, at 36 Facebook users, 10 Instagram users, nine groups, and nine pages.

Fishman said that this isn’t the first time Facebook has taken action of this kind. He and Pollack explained that the company had used the same strategy against other American right-wing hate organizations, including The Right Stuff and Identity Dixie, two alt-right podcasts, as well as the Revolutionary Armed Forces of Colombia (aka FARC), a leftist rebel group in Columbia. 

“We’ve always wanted to explain that we’re using this approach,” Pollack said, “but we wanted to do it now to highlight [that] our work on dangerous organizations continues even in this moment where Facebook and the world is focused on COVID-19.”

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate