EU Moves to Break Up Kids and Their Chatbots: The End of AI Magic?

The EU Kids Act wants to rip out everything that makes chatbots irresistible to minors. ChatGPT, Character.ai, and Snapchat’s My AI are in the crosshairs of a regulation that could redefine how children interact with AI.

Context: Years of Ignored Warnings

Since the 2022 conversational AI boom, bodies like the European Parliament have flagged addictive design in these tools. 2023 reports showed under-13s using ChatGPT unsupervised, and platforms like Character.ai allowed unfiltered roleplay. Pressure mounted after documented emotional dependency cases in the UK and Netherlands.

Details: What the Law Will Actually Ban

The proposal, leaked this week, will force minor-facing chatbots to eliminate:

• Emotional personalization and simulated empathetic responses.
• Reward mechanics (points, streaks, achievements).
• Persistent conversation memory to build attachment.
• Avatars and voices that mimic human relationships.

Tech giants will have 18 months to comply or face fines up to 6% of global revenue. Snapchat said it will "scrutinize the text," while OpenAI remains silent.

Analysis: Real Protection or Miscalibrated Paternalism?

The problem isn't AI—it's the dark design chasing engagement at any cost. But banning synthetic empathy is like banning books that make you cry. Kids need digital literacy, not a wall that leaves them alone with even more opaque algorithms. Regulators win; minors who use these tools to explore identity lose.

Implications: Global Domino Effect

If passed, the US and UK could copy the framework, forcing a massive redesign of AI products. Educational chatbot startups will be hit hardest, while giants will integrate AI age verification. The debate moves to the UN in 2025.

Ultimately, the question isn't whether kids should talk to chatbots—it's who decides which conversations are safe.

Source: Wired