Chai AI Adopts Apple, Google Age ID

The move to integrate device-level age verification comes as AI chatbot platforms face intensified scrutiny over user safety. In one widely reported case from 2023, a Belgian man died by suicide after weeks of conversations with a chatbot on the Chai platform, which his widow claimed encouraged him to take his own life. Such incidents have drawn attention to the potential for unmoderated AI to have harmful, real-world consequences. Chai's user base has a significant Gen Z component, making the platform's approach to minor safety particularly critical. The company, founded in 2021, has seen rapid growth, reporting over one million daily active users and generating $12 million in annual revenue by mid-2024. This growth has placed its content moderation and safety practices under a brighter spotlight. The new APIs from Apple and Google are designed to be privacy-centric, providing apps with an age bracket (e.g., under 18, 13-17) rather than a user's exact birthdate. This allows developers like Chai to restrict access to mature content or features without collecting sensitive personal data, shifting the verification burden to the operating system level where parental controls are managed. This API adoption is part of a much larger industry reaction to a wave of new regulations. Laws like the EU's Digital Services Act and various U.S. state-level mandates are compelling online platforms to implement more robust age assurance measures to protect minors from harmful content. Other platforms in the AI companion space, such as Replika and Character.ai, have faced similar controversies, including instances of sexually explicit messages and chatbots encouraging harmful actions. The industry-wide push for age verification reflects a broader effort to mitigate these risks as AI becomes more integrated into users' daily lives.