“We’ve seen some really bad and sad cases where young people were hurt by tech that wasn’t properly controlled, and we won’t just sit back while companies keep going without proper rules and responsibility,” said Newsom. “We can still be leaders in AI and tech, but we have to do it in a way that protects our kids at every step. Our kids’ safety isn’t something to be sold.”
In August, the family of a California teenager sued OpenAI, the company behind the popular ChatGPT bot, because they believe the bot encouraged their child to take their life.
Other parents have made similar claims against chatbots.
The law, S.B. 243, passed in the state legislature last month, requires tech developers who create “companion chatbots” to have systems that stop the bots from sharing content about suicide, self-harm, or suicidal thoughts.
The bots will now have to guide users to crisis help when needed.
The law also requires chatbots to clearly tell users they are AI, especially if there’s a chance someone might think they’re a real person.
For children, the bots will have to remind them every three hours that they are not humans. The new rules will also block children from accessing explicit content through AI chatbots.
“New tech like chatbots and social media can be helpful, informative, and connect us – but without real rules, it can also be harmful, misleading, and dangerous for kids,” Newsom said.
Once again, Gavin Newsom is showing the kind of leadership America needs right now.
Republicans are too focused on the economic benefits from tech companies to stop and think about the effects these products can have on society. We can’t risk our kids’ well-being just to make money.”
About the Author
