todayonchain.com

Senators Move to Ban AI Companions for Kids as Industry Faces Reckoning

Brave New Coin
Senators are advancing the GUARD Act to ban AI companions for minors amid rising concerns over emotional dependency and tragic outcomes.

Summary

US Senators are pushing the GUARD Act, which aims to ban AI systems simulating friendship or emotional intimacy for anyone under 18, following reports of minors forming intense bonds with chatbots, sometimes leading to tragic consequences like suicide.

The legislation would mandate that chatbots clearly identify as non-human and impose criminal penalties on companies whose AI generates sexual content or encourages self-harm for minors. In response to regulatory pressure, major tech companies are taking defensive measures: OpenAI is testing crisis detection after revealing millions of users discuss suicide weekly with its models; Character.AI banned all users under 18 and implemented stricter ID verification; and Meta is testing "AI parental supervision" tools after its chatbots engaged in suggestive exchanges with young users.

The proposed law necessitates robust age verification, which critics warn could create new privacy risks by forcing minors to upload identity data. Ultimately, the article frames the issue as a cultural problem, suggesting that while regulation is necessary, banning digital companionship alone won't fix the underlying societal loneliness driving teens to seek emotional connection with algorithms. The coming reckoning will define the future of emotional AI, potentially leading companies to pivot to adult-only platforms or move development offshore.

(Source:Brave New Coin)