Skip to main content

Advertisement

Advertisement

commentary Commentary

Commentary: Banning disruptive online groups is a pointless game of whack-a-mole

Deplatforming is not an effective strategy for stopping disruptive groups from forming and coordinating online, says a social networks researcher.

Commentary: Banning disruptive online groups is a pointless game of whack-a-mole

Rioters gesture to US Capitol Police in the hallway outside of the Senate chamber at the Capitol in Washington, Wednesday, Jan. 6, 2021, near the Ohio Clock. (AP Photo/Manuel Balce Ceneta)

LONDON: From Washington DC to Wall Street, 2021 has already seen online groups causing major organised offline disruption. Some of it has been in violation of national laws, some in violation of Internet platforms’ terms of service.

When these groups are seen to cause societal harm, the solution has been knee-jerk: To ban or “deplatform” those groups immediately, leaving them digitally “homeless”.

But the online world is a Pandora’s box of sites, apps, forums and message boards. Groups banned from Facebook migrated seamlessly to Parler, and from Parler, via encrypted messaging apps, to a host of other platforms.

Users easily migrate between platforms on the “dark web”. Deplatforming won’t work on the regular Internet for the same reason: It’s become too easy for groups to migrate elsewhere.

READ: Commentary: Facebook’s eleventh-hour suspension of Trump’s account raises questions about its motives

This year, we’ve come to see social platforms not as passive communication tools, but rather as active players in public discourse.

Twitter’s announcement that it had permanently suspended Donald Trump in the wake of the Capitol riots is one such example: A watershed moment for deplatforming as a means of limiting harmful speech.

Elsewhere, the Robinhood investment platform suspended the trading of GameStop stocks after the Reddit group r/WallStreetBets (which had 2.2 million members at the time) coordinated a mass purchase of the shares.

While the original Reddit group remained open, many r/WallStreetBets users had also been communicating via the social network Discord. In response, Discord banned their channel, citing “hate speech”.

READ: Commentary: GameStop insanity has painful lessons on short-selling and more for retail investors

NET MIGRATION

Deplatforming is the mechanism currently used by social networks and technology companies to suspend or ban users who’ve allegedly violated their terms of service. From a company’s perspective, deplatforming is a protection from potential legal actions.

For others, it’s hoped that deplatforming might help stop what some see as online mobs, intent on vandalising political, social, and financial institutions.

People holding mobile phones are silhouetted against a backdrop projected with the Twitter logo in this illustration picture taken Sep 27, 2013. (Photo: REUTERS/Kacper Pempel)

But deplatforming has proven ineffective in stifling these groups. When Trump was banned from social media, his supporters quickly reorganised on Parler – a social networking site that markets itself as the home of free speech.

Shortly after, Parler was removed from the Apple and Google app stores, and Amazon Web Services – who provided the digital infrastructure for the platform – removed Parler from its servers.

With Parler offline, Trump’s supporters began looking for alternative social media apps, including MeWe and CloudHub, which both rose rapidly up the app store rankings, organised by volume of downloads.

Similarly, after the Discord ban, Reddit investors quickly reorganised themselves on the messaging service Telegram. These “whack-a-mole” dynamics, with deplatformed groups rapidly reforming on other platforms, is strikingly similar to what my research team and I have observed on the dark web.

READ: Commentary: Impeaching Donald Trump still makes little sense

DARK DYNAMICS

The dark web is a hidden part of the Internet that’s easily accessible through specialised web browsers such as TOR. Illicit trade is rife on the dark web, especially in dark “marketplaces”, where users trade goods using cryptocurrencies such as Bitcoin.

Silk Road, regarded as the first dark marketplace, launched in 2011 and mostly sold drugs. Shut down by the US Federal Bureau of Investigation in 2013, it was followed by dozens of dark marketplaces which also traded in weapons, fake IDs and stolen credit cards.

READ: Commentary: Redpilling, rabbit holes and how far-right ideology spreads in online spaces

My collaborators and I looked at what happens after a dark marketplace is shut down by a police raid or an “exit scam” – where the marketplace’s moderators suddenly close the website and disappear with the users’ funds. We focused on “migrating” users, who move their trading activity to a different marketplace after a closure.

We found that most users flocked to the same alternative marketplace, typically the one with the highest amount of trading. User migration took place within hours, possibly coordinated via a discussion forum such as Reddit or Dread, and the overall amount of trading across the marketplaces quickly recovered.

FILE PHOTO: Reddit logos are seen displayed in this illustration taken February 2, 2021. REUTERS/Dado Ruvic/Illustration/File Photo

So, although individual marketplaces can be fragile, with participants being exposed to losses due to scams, this coordinated user migration guarantees the marketplaces’ overall resilience, so that new ones continue to flourish.

PLATFORM PROMISCUITY

Back in 2006, Facebook was competing for dominance against other social networks such as MySpace, Orkut, Hi5, Friendster and Multiply. When Facebook started to dominate the scene, network effects made it unstoppable.

Put simply, network effects compound platform dominance because you and I are most likely to join networking platforms our friends are already on. Given this tendency, Facebook and Twitter grew to host billions of users, and Hi5 disappeared.

By the time their dominance had crystallised, a ban from Facebook or Twitter would have meant total ostracisation from the online community.

READ: Commentary: Handmaidens to US Capitol chaos, social media giants face a turning point

READ: Commentary: Why Asia may not be immune to far-right terrorism

In 2021, everything is different. Global communities organised by interests or political opinion are now established, and are able to quickly formulate emergency evacuation or migration plans. Members are usually in contact on several channels – even “dormant” channels few users are active upon.

As dark markets show, dormant channels can become active when they’re required.

All this means that being banned from Twitter, Facebook, Instagram, Snapchat, Twitch and others no longer results in your isolation, or in your community being disbanded. Instead, just like on the dark web, deplatforming simply requires users to migrate to a new home, which they do in a matter of hours.

Deplatforming is clearly an ineffective strategy for stopping disruptive groups from forming and coordinating online. This means that policing online conversation will be harder in the future.

Whether this is seen as good or bad will depend on the specific circumstances and – of course – your point of view.

Listen to a lawyer and a communication researcher break down WhatsApp's new terms of service on CNA's Heart of the Matter podcast:

 

Andrea Baronchelli is Associate Professor at the Department of Mathematics at the City University of London. This commentary first appeared on The Conversation.

Source: CNA/el

Advertisement

Also worth reading

Advertisement