October 13, 2019

The Underworld of Online Content Moderation

“More than one hundred thousand people work as online content moderators, viewing and evaluating the most violent, disturbing, and exploitative content on social media. In a new book, “Behind the Screen,” Sarah T. Roberts, a professor of information studies at U.C.L.A., describes how this work shapes their professional and personal lives. Roberts, who conducted interviews with current and former content moderators, found that many work in Silicon Valley, but she also travelled as far as the Philippines, where some of the work has been outsourced. From her research, we learn about the emotional toll, low wages, and poor working conditions of most content moderation. Roberts never disputes that the work is crucial, but raises the question of how highly companies like Facebook and Google actually value it.

I recently spoke by phone with Roberts. During our conversation, which has been edited for length and clarity, we discussed why finding and deleting offensive content is so tricky, why the job is so psychologically taxing, and the fixes that could help these workers and make them better at their jobs.

What is it about the lives of people doing this work that you thought was important for people to understand?

I came to this topic in 2010. The nature of the work demanded total psychic engagement and commitment in a way that was disturbing, because it was a flow that they could not predict, and they were always open to anything at any time. People were flocking to these platforms, in no small part, at least in the American context, because they were being led to believe, either tacitly or overtly in some cases, that being online in this way would allow them to express themselves. What they were being told was that you have your thought or you have your thing you want to express, you share it on the platform, and you can broadcast it to the world. YouTube’s tagline was “Broadcast yourself.””

Read more

JJ Editor's Picks

"Kurds have been staunch allies in America's struggle against ISIS. Without them, America would have paid a far steeper price in blood and treasure to defeat the brutal outfit. That's why President Trump's move to pull U.S. troops out of..."

"For the first time since President Richard Nixon refused to turn over the White House tapes, the United States is facing a genuine constitutional crisis. To be sure, Donald Trump had already created a crisis in the presidency by abusing the..."

"Every October for the past five years, Fat Bear Week has showcased some of the healthiest, hungriest, and chonkiest bears in Katmai National Park and Preserve, a four-million-acre expanse of wilderness in southern Alaska..."

"I sat on my childhood bed, surrounded by 52-year-old stuffed animals, with a smartphone lodged between my ear and shoulder. My father had died unexpectedly the day before, and I was jotting down notes as my rabbi back in Ohio described various..."

"In August, it was SoulCycle and Equinox. The month prior, Home Depot. Back in 2017, L.L.Bean. These are only a few of the companies to ignite the collective ire of progressive consumers over corporate ties to Trump. In the case of the boutique..."

"Movies like Gemini Man are usually ideal airplane viewing. Take a formulaic plot about spies and cloning, then add dialogue so predictable that getting interrupted by pilots’ announcements and turbulence and your seatmate’s need to get up and..."

"It’s still unclear whether Israel’s next election will be in four years or four months. But either way, if the center-right wants a better outcome, it needs to learn the lessons of September’s election. So here are two: First, while center-right..."

"Smart homes, bountiful oceans and casual sexism: the future as envisaged from 1967 ‘Yes, life will be richer, easier, healthier as space-age dreams come true.’ In 1967, the Ford Motor Company (then known as Philco-Ford) released the short film..."