Media & Entertainment

YouTube promises to increase content moderation and other enforcement staff to 10K in 2018

Comment

Now that its bottom line is being affected, YouTube says it will begin to take additional steps to protect its advertisers and creators from inappropriate content on its network. In a blog post authored by YouTube CEO Susan Wojcicki on Monday, the company said it will increase its staff to 10,000 in 2018 to help better moderate video content, and perform other related tasks.* The news follows a series of scandals on the video-sharing site related to its lack of policing around content aimed at childrenobscene comments on videos of children, horrifying search suggestions, and more.

* Update: YouTube reached out to clarify its hiring numbers. Its teams include a mix of different specialists working on these issues, the majority who are content reviewers. But the number also includes other policy specialists who review and take action on content, engineers building and refining the machine learning technology, and policy specialists training our machine learning algorithms. The 10K ‘content reviewers’ headline was not accurate, and we’ve corrected.  

The company has been suffering from the fallout of accusations that it has for too long allowed bad actors to game its recommendation algorithms to reach children with videos that aren’t meant for younger viewers. At the same time, it has seemingly fostered a community of creators making videos that involve putting kids in concerning, and even exploitive, situations.

One example, the channel ToyFreaks, was recently terminated after concerns were raised about its videos, where a fathers’ young daughters were filmed in odd, upsetting and inappropriate situations, at times.

YouTube had said then the channel’s removal was part of a new tightening of its child endangerment policies. It also last month implemented new policies to flag videos where inappropriate content was aimed at children.

It has since pulled down thousands of videos of children as a result, and removed the advertising from nearly 2 million videos and over 50,000 channels.

Having policies is one thing, but having staff on hand to actually enforce them is another.

That’s why YouTube says it’s now planning to increase its workforce focused on this task. While the blog post from Wojcicki only offered the number of total hires it planned to have on staff by next year, a report from BuzzFeed notes this “over 10,000” figure represents a 25 percent increase from the current staffing levels.

However, YouTube still relies heavily on algorithms to help police its content. As Wojcicki noted in a blog post, YouTube plans to use machine learning technology to help it “quickly and efficiently remove content that violates our guidelines.”

This same technology has aided YouTube in flagging violent extremist content on the site, leading to the removal of over 150,000 videos since June.

“Today, 98 percent of the videos we remove for violent extremism are flagged by our machine-learning algorithms,” Wojcicki wrote. “Our advances in machine learning let us now take down nearly 70 percent of violent extremist content within eight hours of upload and nearly half of it in two hours and we continue to accelerate that speed,” she added.

The goal is now turn those technologies to a more difficult (and sometimes less obvious) area to police.

While some content is easier to spot – like videos where kids seem to be in pain, or being ‘pranked’ by parents in a cruel fashion – other videos exist in a much grayer area.

There are so many parents who have roped their kids into their quest for YouTube stardom, it’s hard to draw a fine line between what’s appropriate and what’s not.

One question that needs to be raised is to what extent can a preschooler or schoolager really consent to participating in mom or dad’s daily videos? Shouldn’t they be free to play instead of constantly instructed to act out various skits, or have the camera trained on them nonstop? These channels, after all, aren’t just the occasional fun video – they are often full-time jobs for parents. There are laws in the U.S. around child labor, and child actors in particular, but YouTube has continually danced around that line, as it’s “not really TV” – and that means it doesn’t have to play by TV’s rules regarding deceptive ads, junk food ads, and more.

In addition to the new policies and promises of increased staffing, YouTube also says it will create regular reports where it’s transparent about the aggregate data regarding the flags it receives, and the actions it takes to remove videos and comments that violate its content policies.

And most importantly, in terms of its business, YouTube says it will more carefully consider which channels and videos are eligible for advertising using a set of stricter criteria, combined with more manual curation.

“We are taking these actions because it’s the right thing to do,” wrote Wojcicki. “Creators make incredible content that builds global fan bases. Fans come to YouTube to watch, share, and engage with this content. Advertisers, who want to reach those people, fund this creator economy. Each of these groups is essential to YouTube’s creative ecosystem—none can thrive on YouTube without the other—and all three deserve our best efforts.”

Personally, I’d love it if YouTube cut off the ability for creators to make money from videos featuring children, period. Maybe the too-young stars could finally get a break and just be allowed to just go be kids again. But I won’t hold my breath.

More TechCrunch

Flock Safety is a multi-billion dollar startup that’s got eyes everywhere. As of Wednesday, with the company’s new Solar Condor cameras, those eyes are solar-powered and using wireless 5G networks…

Flock Safety’s solar-powered cameras could make surveilliance more widespread

Since he was very young, Bar Mor knew that he would inevitably do something with real estate. His family was involved in all types of real estate projects, from ground-up…

Agora raises $34M Series B to keep building the Carta for real estate

Poshmark, the social commerce site that lets people buy and sell new and used items to each other, launched a paid marketing tool on Thursday, giving sellers the ability to…

Poshmark’s ‘Promoted Closet’ tool lets sellers boost all their listings at once

Google is launching a Gemini add-on for educational institutes through Google Workspace.

Google adds Gemini to its Education suite

More money for the generative AI boom: Y Combinator-backed developer infrastructure startup Recall.ai announced Thursday it’s raised a $10 million Series A funding round, bringing its total raised to over $12M.…

YC-backed Recall.ai gets $10M Series A to help companies use virtual meeting data

Engineers Adam Keating and Jeremy Andrews were tired of using spreadsheets and screenshots to collab with teammates — so they launched a startup, Colab, to build a better way. The…

Colab’s collaborative tools for engineers line up $21M in new funding

Reddit announced on Wednesday that it is reintroducing its awards system after shutting down the program last year. The company said that most of the mechanisms related to awards will…

Reddit reintroduces its awards system

Sigma Computing, a startup building a range of data analytics and business intelligence tools, has raised $200 million in a fresh VC round.

Sigma is building a suite of collaborative data analytics tools

European Union enforcers of the bloc’s online governance regime, the Digital Services Act (DSA), said Thursday they’re closely monitoring disinformation campaigns on the Elon Musk-owned social network X (formerly Twitter)…

EU ‘closely’ monitoring X in wake of Fico shooting as DSA disinfo probe rumbles on

Wind is the largest source of renewable energy in the U.S., according to the U.S. Energy Information Administration, but wind farms come with an environmental cost as wind turbines can…

Spoor uses AI to save birds from wind turbines

The key to taking on legacy players in the financial technology industry may be to go where they have not gone before. That’s what Chicago-based Aeropay is doing. The provider…

Cannabis and gaming payments startup Aeropay is now offering an alternative to Mastercard and Visa

Facebook and Instagram are under formal investigation in the European Union over child protection concerns, the Commission announced Thursday. The proceedings follow a raft of requests for information to parent…

EU opens child safety probes of Facebook and Instagram, citing addictive design concerns

Bedrock Materials is developing a new type of sodium-ion battery, which promises to be dramatically cheaper than lithium-ion.

Forget EVs: Why Bedrock Materials is targeting gas-powered cars for its first sodium-ion batteries

Private equity giant Thoma Bravo has announced that its security information and event management (SIEM) company LogRhythm will be merging with Exabeam, a rival cybersecurity company backed by the likes…

Thoma Bravo’s LogRhythm merges with Exabeam in more cybersecurity consolidation

Consumer protection groups around the European Union have filed coordinated complaints against Temu, accusing the Chinese-owned ultra low-cost e-commerce platform of a raft of breaches related to the bloc’s Digital…

Temu accused of breaching EU’s DSA in bundle of consumer complaints

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

The AI industry moves faster than the rest of the technology sector, which means it outpaces the federal government by several orders of magnitude.

Senate study proposes ‘at least’ $32B yearly for AI programs

The FBI along with a coalition of international law enforcement agencies seized the notorious cybercrime forum BreachForums on Wednesday.  For years, BreachForums has been a popular English-language forum for hackers…

FBI seizes hacking forum BreachForums — again

The announcement signifies a significant shake-up in the streaming giant’s advertising approach.

Netflix to take on Google and Amazon by building its own ad server

It’s tough to say that a $100 billion business finds itself at a critical juncture, but that’s the case with Amazon Web Services, the cloud arm of Amazon, and the…

Matt Garman taking over as CEO with AWS at crossroads

Back in February, Google paused its AI-powered chatbot Gemini’s ability to generate images of people after users complained of historical inaccuracies. Told to depict “a Roman legion,” for example, Gemini would show…

Google still hasn’t fixed Gemini’s biased image generator

A feature Google demoed at its I/O confab yesterday, using its generative AI technology to scan voice calls in real time for conversational patterns associated with financial scams, has sent…

Google’s call-scanning AI could dial up censorship by default, privacy experts warn

Google’s going all in on AI — and it wants you to know it. During the company’s keynote at its I/O developer conference on Tuesday, Google mentioned “AI” more than…

The top AI announcements from Google I/O

Uber is taking a shuttle product it developed for commuters in India and Egypt and converting it for an American audience. The ride-hail and delivery giant announced Wednesday at its…

Uber has a new way to solve the concert traffic problem

Google is preparing to launch a new system to help address the problem of malware on Android. Its new live threat detection service leverages Google Play Protect’s on-device AI to…

Google takes aim at Android malware with an AI-powered live threat detection service

Users will be able to access the AR content by first searching for a location in Google Maps.

Google Maps is getting geospatial AR content later this year

The heat pump startup unveiled its first products and revealed details about performance, pricing and availability.

Quilt heat pump sports sleek design from veterans of Apple, Tesla and Nest

The space is available from the launcher and can be locked as a second layer of authentication.

Google’s new Private Space feature is like Incognito Mode for Android

Gemini, the company’s family of generative AI models, will enhance the smart TV operating system so it can generate descriptions for movies and TV shows.

Google TV to launch AI-generated movie descriptions

When triggered, the AI-powered feature will automatically lock the device down.

Android’s new Theft Detection Lock helps deter smartphone snatch and grabs