New York Governor Kathy Hochul is seeking to expand regulations on artificial intelligence chatbots, particularly to safeguard children, following the initial measures introduced in 2025. At a recent roundtable discussion with parents and advocacy groups, Hochul emphasized the urgency of ensuring online safety amid rapidly evolving technology.
“With evolving technology and online platforms allowing people to connect from anywhere in the world, it is important now more than ever to keep our kids safe online from any and all potential harms,” Governor Hochul stated. Her proposal builds upon the existing SAFE for Kids Act and includes a series of new bills aimed at enhancing age verification and privacy settings, as well as limiting AI chatbot functionalities.
The proposed legislation seeks to disable features that allow chatbots to simulate emotional connections with minors. This aspect is central to a bill, S9051, championed by New York State Senator Kristen Gonzalez, Chair of the Senate Committee on Internet and Technology. The bill aims to prohibit chatbots from suggesting they possess personal opinions or human emotions, storing data related to a user’s mental health, and engaging in sexually explicit interactions.
“Companion chatbots are endangering our youth. The longer we wait to regulate these applications, the more kids are left vulnerable to exploitation,” Gonzalez asserted in a release. “We must protect children from the risks associated with these chatbots.”
The growing usage of chatbots among young individuals for emotional support raises significant concerns. Danny Weiss, Chief Advocacy Officer with Common Sense Media, noted that teenagers are increasingly relying on these tools for mental health therapy and friendship development. However, he expressed apprehension about the potential for exploitation, particularly given the developing brains of adolescents.
In light of reported incidents, including over 13,000 reports of child exploitation on the gaming platform Roblox in 2023, Weiss emphasized the necessity for enhanced age verification measures. He argued that technology companies currently gather vast amounts of user data, which could be utilized to tailor content appropriately for different age groups.
Weiss remarked, “The Attorney General has to establish regulations to ensure a commercially reasonable mechanism to identify the age of the user.” He believes this responsibility falls to the Attorney General’s office, which would design rules to regulate the algorithms used by tech companies to filter inappropriate content.
The proposed legislative framework includes penalties for non-compliance, which Governor Hochul indicated would become more stringent as new requirements are introduced. “The more they want to work with me, I’ll open up my arms, but if you don’t, you’re going to be seeing a lot of serious consequences,” she warned.
The initiative reflects broader trends in the ongoing dialogue regarding the intersection of technology and child safety. As AI applications become increasingly integrated into daily life, the balance between innovation and protection remains a key challenge for lawmakers.
Looking ahead, the proposed measures signify a proactive approach to the potential risks associated with AI chatbots, ensuring that children are better protected in the digital landscape. The outcome of these legislative efforts will likely set a precedent for how such technologies are regulated in the future, potentially influencing similar initiatives in other states.
For further information on the implications of AI in child safety, see Common Sense Media and updates from the New York State Government.
See also
Waymo Integrates DeepMind’s Genie 3 to Enhance Robotaxi Safety in Complex Scenarios
Limassol Forum Tackles Geopolitical Shifts and AI Innovations Reshaping Shipping Sector
AI-Driven Misinformation Surges: How to Combat Trust Erosion in News Media
Microsoft Launches AI QuickStart in Singapore; MSFT Stock Drops 5% Amid Market Volatility
Germany”s National Team Prepares for World Cup Qualifiers with Disco Atmosphere
