WASHINGTON, July 25 — The Supreme Court is currently hearing a case that could redraw the boundaries of how American platforms police what we say online. At stake: Moody v. NetChoice, LLC, a direct challenge to Section 230 of the Communications Decency Act, the 1996 law that has long shielded websites from liability for user-generated content.
The outcome will ripple through an industry now estimated to be worth US$9 billion — one that employs tens of thousands of people, many of them thousands of miles from the corporate headquarters they serve.
The Scale of the Moderation Machine
Content moderation, at its heart, is the systematic process of identifying and removing user contributions deemed irrelevant, obscene, illegal, harmful, or insulting. It happens across Internet forums, blogs, and news sites — those powered by phpBB, wiki, PHP-Nuke — but the largest stage belongs to the major social media platforms. There, a mix of algorithmic tools, user reporting, and human review decides what stays and what goes.
Moderators manually flag or remove content flagged for hate speech, incivility, revenge porn, graphic material, child abuse imagery, and propaganda. As of 2022, the sheer scale of human oversight was striking: approximately 10,000 content moderators for TikTok, 15,000 for Facebook, and 1,500 for Twitter.
They work for platforms largely based in the United States, Europe, and China. But the actual screening is rarely done in the corporate headquarters. Multinational enterprises such as Accenture and Foiwe — headquartered in the global north or India — act as middlemen, while the suppliers themselves are concentrated in low-wage areas of the global south, particularly India and the Philippines.
What unfolded over the past two decades was a transformation from volunteer-led moderation — the early days of forums and wikis — to a sprawling, outsourced industry. The global value chain now funnels work away from the platform companies and toward specialised firms in countries where labour costs are low.
This structure creates powerful economic incentives: cheaper labour means more content can be reviewed, but it also raises questions about working conditions and the psychological toll of viewing graphic material day after day.
Behind the Screens: The Human Cost
For those involved, moderation is not an abstract algorithmic task. It involves direct removal, warning labels, and tools that enable users to block and filter content. Moderators may also face the practice known as shadow banning — a form of visibility moderation where a user’s content is made less visible without their knowledge.
And then there is “jawboning”: government pressure to moderate beyond what the law requires, a dynamic that critics say reduces accountability and due process. Supervisor moderation, where a group chosen by administrators unilaterally enforces rules and deletes or edits contributions, remains common.
But the commercial side of the work has a specific name: Commercial Content Moderation, a term coined by scholar Sarah T. Roberts. It refers to the monitoring and vetting of user-generated content to ensure compliance with legal and regulatory requirements, site guidelines, and what she calls “norms of taste.” The industry, Roberts argues, is not just about removing hate speech or child abuse material — it is also about making content hospitable for advertisers.
Websites must make their platforms safe for the ads that fund them. That economic imperative runs headlong into free expression protections.
In the United States, Section 230 of the Communications Decency Act has been the legal bedrock, giving platforms broad immunity for what users post. The current Supreme Court case, Moody v. NetChoice, LLC, tests the limits of that immunity.
Meanwhile, the same platforms must balance the demands of law enforcement, users who want less harmful content, and the companies that pay for ad space.
Policy Challenges Ahead
The global distribution of moderation work — with social media companies in the West and screening teams in India and the Philippines — creates a set of policy challenges that are only now receiving serious attention. There are questions about legal liability under Section 230, about the mental health of moderators exposed to trauma, and about whether a system designed for speed and cost-effectiveness can also be fair. As the Supreme Court hears arguments in Moody v.
NetChoice, LLC, the outcome will define not only the legal framework for moderation but also the economic incentives that drive it. For the people who work as content moderators for the three biggest platforms alone, the stakes could not be higher.
The work they do, often far from the public eye, is the invisible architecture of the modern public square.
