Media & Entertainment

YouTube Addresses Complaints About Inappropriate Content In Updated YouTube Kids App

Comment

When YouTube first launched its dedicated “Kids” app earlier this year, parents welcomed the opportunity to be able to keep their children away from the more adult content found on the larger YouTube network, thanks to the new app’s curated selection of kid-friendly videos. But the app soon came under fire from consumer watchdog groups who claimed YouTube was not doing enough to protect kids from inappropriate content, including references to sex, drugs, alcohol and more.

Now, YouTube is beginning to address this problem with an update that will help parents better restrict the type of content a child can access on YouTube Kids.

This feature and more, including Chromecast and Apple TV support as well as guest-curated playlists, will arrive in an new version of the app due in a few weeks’ time, says YouTube.

The problem YouTube Kids means to address was significant.

Children today regularly visit YouTube for things like educational videos, cartoons, music videos, web series, and much more. But because the site lacked easy-to-implement parental controls, kids would often stumble upon content through YouTube’s recommendations on via search which was not exactly “kid-safe.” For example, an innocent search for Elmo videos could see kids ending up on a video of Elmo cursing.

Instead, with YouTube Kids, the idea was to offer a simplified user interface for interacting with YouTube where videos were vetted and curated into high-level categories like “Shows,” “Music,” “Learning,” and “Explore.”

youtube-kids

Developed after consultation with Common Sense Media, ConnectSafely.org, the Family Online Safety Institute, the Internet Keep Safe Coalition (iKeepSafe) and WiredSafety.org, YouTube Kids’ app is filled with content from well-known children’s entertainment brands like DreamWorks TV, Jim Henson TV, Mother Goose Club, Talking Tom and Friends, National Geographic Kids, Reading Rainbow, and Thomas the Tank Engine, plus other shows from YouTubers like Vlogbrothers and Stampylonghead.

Dealing With Inappropriate Content

But the problem with the app – and one which led to FTC complaints – was that YouTube Kids offered a search feature that could lead kids to videos that hadn’t been explicitly included and organized into the app’s various sections. While that option could be disabled in parental controls, it seemed that many didn’t know it existed.

Two consumer groups, the Center for Digital Democracy and the Campaign for a Commercial-Free Childhood, teamed up to show how that search feature could be used to point kids to very inappropriate videos.

They used the app to find videos that included sexual language, unsafe behaviors (like playing with matches or juggling knives), profanity (e.g. in a parody of the film “Casino” featuring Bert and Ernie from Sesame Street), adult discussions about family violence, pornography, and child abuse, jokes about drug use and pedophilia, and alcohol ads.

PR_onboarding_screen_N9_N5

 

YouTube today says it will make a change to YouTube Kids that will now explain to parents how videos are chosen and how they can be flagged, and it will force parents to make a decision about how much access they want their child to have. In short, parents will be asked to either enable or disable the search feature. When disabled, kids will be restricted to a more limited set of videos in the app.

Also new is the ability for parents to set a passcode instead of a spelled-out code.

However, as YouTube reminds parents in a blog post, “no system is perfect” – while noting that parents should flag concerning videos if they leak through. These flagged videos are manually reviewed 24/7 and any that shouldn’t be included are removed within hours.

The larger issue at hand is that YouTube houses a lot of content, and its catalog grows at an incredible pace with hundreds of hours of video being uploaded every minute. That means that YouTube can’t filter all the content for the Kids app by hand – instead, it uses a combination of algorithmic filtering, user input and human review. And without 100 percent manual curation, bad videos can slip through.

That means simply installing the “Kids” version of YouTube on your mobile device will never be a replacement for actual parental supervision. It’s just an improvement over the main YouTube app.

PR_canvas_screen_N9_N5

YouTube Kids And Ads

Though not mentioned in today’s post, YouTube is taking a stand on another issue raised by consumers in complaints to the FTC – advertising. The groups said YouTube was mixing content and ads in a way that was deceptive to children. In particular, the groups were concerned with paid endorsements where the relationship between a video’s star and product manufacturer was not disclosed.

YouTube’s position is that paid ads are allowed in the app and they will be marked as such. But any video uploaded by a user is not considered an ad and won’t be subject to YouTube’s advertising guidelines. That, we understand from those familiar with the situation, means the user videos can include “certain commercials and other promotional materials.”

For example, a search for “cookies” on the app may show a television commercial from a cookie company on a user’s channel — but YouTube would not consider this video a Paid Ad and it would not be subject to YouTube’s Ads policies.

The only requirement for the user videos is that they’re kid-friendly.

Official_YouTube_Blog__Introducing_the_newest_member_of_our_family__the_YouTube_Kids_app--available_on_Google_Play_and_the_App_Store

That being said, creators are asked to disclose if videos are paid endorsements, and those that are are excluded from the YouTube Kids app as a matter of policy (if not practice.) Creators are also pointed to a page that details how such videos should be labeled.

We understand the FTC investigation into the complaints against YouTube is ongoing but are waiting to hear back on the detailed status.

Along with these more serious issues, YouTube today is also promoting a handful of other features in the updated app including support for watching YouTube Kids on TV via Chromecast, Apple TV, game consoles and smartTVs as well as new guest-created playlists from National Geographic Kids, Kid President, a girl power-themed playlist from actor Geena Davis, creators including Vsauce and Amy Poehler’s Smart Girls, and others.

The company says the app has seen over 8 million downloads since its February launch.

More TechCrunch

TechCrunch Disrupt, our flagship startup event held annually in San Francisco, is back on October 28-30 — and you can expect a bustling crowd of thousands of startup enthusiasts. Exciting…

Startup Blueprint: TC Disrupt 2024 Builders Stage agenda sneak peek!

Mike Krieger, one of the co-founders of Instagram and, more recently, the co-founder of personalized news app Artifact (which TechCrunch corporate parent Yahoo recently acquired), is joining Anthropic as the…

Anthropic hires Instagram co-founder as head of product

Seven orgs so far have signed on to standardize the way data is collected and shared.

Venture orgs form alliance to standardize data collection

As cloud adoption continues to surge towards the $1 trillion mark in annual spend, we’re seeing a wave of enterprise startups gaining traction with customers and investors for tools to…

Alkira connects with $100M for a solution that connects your clouds

Charging has long been the Achilles’ heel of electric vehicles. One startup thinks it has a better way for apartment dwelling EV drivers to charge overnight.

Orange Charger thinks a $750 outlet will solve EV charging for apartment dwellers

So did investors laugh them out of the room when they explained how they wanted to replace Quickbooks? Kind of.

Embedded accounting startup Layer secures $2.3M toward goal of replacing Quickbooks

While an increasing number of companies are investing in AI, many are struggling to get AI-powered projects into production — much less delivering meaningful ROI. The challenges are many. But…

Weka raises $140M as the AI boom bolsters data platforms

PayHOA, a previously bootstrapped Kentucky-based startup that offers software for self-managed homeowner associations (HOAs), is an example of how real-world problems can translate into opportunity. It just raised a $27.5…

Meet PayHOA, a profitable and once-bootstrapped SaaS startup that just landed a $27.5M Series A

Restaurant365, which offers a restaurant management suite, has raised a hot $175M from ICONIQ Growth, KKR and L Catterton.

Restaurant365 orders in $175M at $1B+ valuation to supersize its food service software stack 

Venture firm Shilling has launched a €50M fund to support growth-stage startups in its own portfolio and to invest in startups everywhere else. 

Portuguese VC firm Shilling launches €50M opportunity fund to back growth-stage startups

Chang She, previously the VP of engineering at Tubi and a Cloudera veteran, has years of experience building data tooling and infrastructure. But when She began working in the AI…

LanceDB, which counts Midjourney as a customer, is building databases for multimodal AI

Trawa simplifies energy purchasing and management for SMEs by leveraging an AI-powered platform and downstream data from customers. 

Berlin-based trawa raises €10M to use AI to make buying renewable energy easier for SMEs

Lydia is splitting itself into two apps — Lydia for P2P payments and Sumeria for those looking for a mobile-first bank account.

Lydia, the French payments app with 8 million users, launches mobile banking app Sumeria

Cargo ships docking at a commercial port incur costs called “disbursements” and “port call expenses.” This might be port dues, towage, and pilotage fees. It’s a complex patchwork and all…

Shipping logistics startup Harbor Lab raises $16M Series A led by Atomico

AWS has confirmed its European “sovereign cloud” will go live by the end of 2025, enabling greater data residency for the region.

AWS confirms will launch European ‘sovereign cloud’ in Germany by 2025, plans €7.8B investment over 15 years

Go Digit, an Indian insurance startup, has raised $141 million from investors including Goldman Sachs, ADIA, and Morgan Stanley as part of its IPO.

Indian insurance startup Go Digit raises $141M from anchor investors ahead of IPO

Peakbridge intends to invest in between 16 and 20 companies, investing around $10 million in each company. It has made eight investments so far.

Food VC Peakbridge has new $187M fund to transform future of food, like lab-made cocoa

For over six decades, the nonprofit has been active in the financial services sector.

Accion’s new $152.5M fund will back financial institutions serving small businesses globally

Meta’s newest social network, Threads, is starting its own fact-checking program after piggybacking on Instagram and Facebook’s network for a few months.

Threads finally starts its own fact-checking program

Looking Glass makes trippy-looking mixed-reality screens that make things look 3D without the need of special glasses. Today, it launches a pair of new displays, including a 16-inch mode that…

Looking Glass launches new 3D displays

Replacing Sutskever is Jakub Pachocki, OpenAI’s director of research.

Ilya Sutskever, OpenAI co-founder and longtime chief scientist, departs

Intuitive Machines made history when it became the first private company to land a spacecraft on the moon, so it makes sense to adapt that tech for Mars.

Intuitive Machines wants to help NASA return samples from Mars

As Google revamps itself for the AI era, offering AI overviews within its search results, the company is introducing a new way to filter for just text-based links. With the…

Google adds ‘Web’ search filter for showing old-school text links as AI rolls out

Blue Origin’s New Shepard rocket will take a crew to suborbital space for the first time in nearly two years later this month, the company announced on Tuesday.  The NS-25…

Blue Origin to resume crewed New Shepard launches on May 19

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

In the coming months, Google says it will open up the Gemini Nano model to more developers.

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced