Facebook Just Revealed Its Secret Strategy for Taking Down Hate Groups

The company recently removed a small network of the “worst racists” in America.

Josh Edelson/ZUMA Wire

Fight disinformation. Get a daily recap of the facts that matter. Sign up for the free Mother Jones newsletter.

The members of Northwest Front have been called the “worst racists” in America, amid stiff competition. On Wednesday, Facebook told Mother Jones that it had used a new enforcement strategy to take down a network of Northwest Front accounts that tried to circumvent the platform’s ban on white nationalists.

“This organization has been banned on Facebook for years now. We recently identified that they had tried to reestablish a presence on the platform. What we decided to do is identify as many of their assets as we could, identities of their supporters and members, groups, pages, and then take them all down at once,” Brian Fishman, Facebook’s director of counterterrorism and dangerous organizations policy, explained on the phone.

The action against the Northwest Front that Fishman outlined is a strategy that Facebook occasionally uses to stop the most egregious and dangerous groups from using its tools. Until Wednesday, the company had not shared any details of that strategy publicly.

The group had been organizing on Facebook and attempting to use the platform to recruit potentially sympathetic minds into the neo-Nazi group. 

Typically, Fishman explained, most content that violates Facebook’s terms of service is reviewed and taken down as quickly as the company can manage it; the takedowns are accompanied by messages to violators about how they’d breached platform rules. In the case of the recent move against Northwest Front, though, the company instead opted to monitor accounts of individuals associated with the Northwest Front, in the hopes of finding a larger chunk of the network and taking it all down at once, with no explanations given.

“This is different than our normal operations. The reason for doing things like this is to make it more difficult to rebuild a network,” Fishman said. “If you take out one piece or consistently takedown pieces, then they still can try to rebuild.”

Fishman emphasized that Facebook was not ignoring normal policy violations while monitoring the group. “If something came into standard enforcement flows, it would come down,” he said.

“Also if we recognize something that was an imminent threat, we wouldn’t delay. If we identify something that indicated that there’s potential for harm, we’ll take enforcement action,” Sarah Pollack, a spokesperson for Facebook, added. 

Facebook would contact law enforcement if the group posed an imminent threat, Fishman said. It would also work with its lawyers to loop in law enforcement, the military, or other government groups if its investigators came across any white nationalists working in their ranks.

Facebook has been deliberately opaque about its strategy in the past. That’s because the company wanted to make it harder for groups like the Northwest Front to understand what was happening and figure out how to dodge detection in the future. Fishman was light on a lot of details about what Facebook looks for in monitoring these types of groups. Often, he said, Facebook won’t say that it took action on a set of accounts, leaving users puzzled as their accounts, pages, and groups are deleted without explanation. 

“Sometimes these groups are confused about actions. That’s a positive effect from my perspective,” he said. “When we’re talking about terror groups and hate groups, ambiguity can be a useful tool.”

The overall scope of the takedown was small, at 36 Facebook users, 10 Instagram users, nine groups, and nine pages.

Fishman said that this isn’t the first time Facebook has taken action of this kind. He and Pollack explained that the company had used the same strategy against other American right-wing hate organizations, including The Right Stuff and Identity Dixie, two alt-right podcasts, as well as the Revolutionary Armed Forces of Colombia (aka FARC), a leftist rebel group in Columbia. 

“We’ve always wanted to explain that we’re using this approach,” Pollack said, “but we wanted to do it now to highlight [that] our work on dangerous organizations continues even in this moment where Facebook and the world is focused on COVID-19.”

ONE MORE QUICK THING:

Or at least we hope. It’s fall fundraising time, and we’re trying to raise $250,000 to help fund Mother Jones’ journalism during a shorter than normal three-week push.

If you’re reading this, a fundraising pitch at the bottom of an article, you must find our team’s reporting valuable and we hope you’ll consider supporting it with a donation of any amount right now if you can.

It’s really that simple. But if you’d like to read a bit more, our membership lead, Brian Hiatt, has a post for you highlighting some of our newsroom's impressive, impactful work of late—including two big investigations in just one day and covering voting rights the way it needs to be done—that we hope you'll agree is worth supporting.

payment methods

ONE MORE QUICK THING:

Or at least we hope. It’s fall fundraising time, and we’re trying to raise $250,000 to help fund Mother Jones’ journalism during a shorter than normal three-week push.

If you’re reading this, a fundraising pitch at the bottom of an article, you must find our team’s reporting valuable and we hope you’ll consider supporting it with a donation of any amount right now if you can.

It’s really that simple. But if you’d like to read a bit more, our membership lead, Brian Hiatt, has a post for you highlighting some of our newsroom's impressive, impactful work of late—including two big investigations in just one day and covering voting rights the way it needs to be done—that we hope you’ll agree is worth supporting.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate