The founder of Google’s trust and safety team called this week for slower AI development, warning that children could face serious harm.
The warning targets the wider technology industry, including companies racing to build and release more capable AI systems. The former Google safety leader argued that developers are repeating mistakes made during the rise of social media.
The concern carries added weight because Google, owned by Alphabet, is a major AI developer. It also operates services used by children, families, schools, advertisers and content creators around the world.
Lessons From the Social Media Era
Social media platforms grew quickly before researchers, parents and regulators fully understood their effects on young users. Safety controls often followed product launches rather than guiding them.
The Google safety founder warned that AI could follow the same course, but with greater consequences. Generative systems can create text, images and other material at high speed. They can also give responses that appear confident, even when the information is wrong or unsuitable.
The technology industry is “repeating the same mistakes from the social media era,” with the risk of “even greater harm to children.”
The comparison points to a familiar business pattern. Companies compete for users, release products quickly and address harmful effects later. That approach can leave young people exposed while rules and safety systems catch up.
Why Children Face Added Risks
Children may have difficulty judging whether AI-generated material is accurate, manipulative or artificial. Systems that imitate human conversation can also appear more trustworthy than conventional search tools.
Several areas may require special attention:
- Exposure to false, harmful or age-inappropriate material
- Collection and use of data involving minors
- AI-generated bullying, impersonation or deceptive images
- Overreliance on automated advice or companionship
The warning did not identify a specific product, incident or proposed timetable for a slowdown. It also did not set out which safeguards should be required before companies release new systems.
That lack of detail leaves major policy questions open. A slowdown could mean delaying public launches, limiting access for minors or requiring independent safety reviews. Each option would carry different costs and enforcement challenges.
Pressure on Developers and Regulators
AI companies often argue that rapid development can improve education, productivity and access to information. Delays may also shift development to competitors or regions with fewer restrictions.
Safety advocates take a different view. They argue that speed should not outweigh testing, especially where products may affect children. From that perspective, early safeguards can prevent damage that is difficult to reverse after widespread adoption.
The debate places Google and its rivals under added scrutiny. Their decisions about age limits, training data, content filters and parental controls may shape industry practice. Clear reporting about failures could also help regulators judge whether voluntary measures are sufficient.
What a Safer Approach Could Require
A child-centered release process could include age-appropriate testing, privacy limits and simple ways to report harmful output. Companies could also measure how safeguards perform before and after deployment.
Independent review may be especially important because developers have strong incentives to release products before competitors. Outside researchers can test risks that internal teams may miss or lack authority to address.
The central question is no longer whether AI offers useful tools. It is whether companies can develop them without repeating a cycle of rapid growth followed by delayed protection.
The former Google safety leader’s intervention adds an experienced industry voice to calls for caution. The next test will be whether developers slow releases, strengthen child protections or wait for regulators to impose firmer rules.
Kirstie a technology news reporter at DevX. She reports on emerging technologies and startups waiting to skyrocket.
