SINGAPORE – A Singapore-based toy company has suspended sales of its AI-enabled plush toys after researchers found that one of its models, the “Kumma” bear, engaged in sexually explicit conversations and offered unsafe advice to users.
FoloToy CEO Larry Wang confirmed that the company has withdrawn the Kumma bear and all other AI-integrated products from its website following a report by the U.S. PIRG Education Fund.
The $99 interactive teddy bear used OpenAI’s GPT-4o technology to hold voice conversations with users through an embedded speaker.
Key Points
- Singapore-based FoloToy has suspended sales of its AI-powered “Kumma” bear after safety concerns surfaced.
- Researchers found the toy discussed explicit sexual topics and gave unsafe advice.
- The company has launched an internal safety audit of all AI-enabled products.
Researchers find toy engaged in explicit discussions
According to the U.S. PIRG Education Fund’s findings, the AI chatbot inside the Kumma bear was capable of engaging in inappropriate dialogue, including conversations about sexual fetishes and how to light a match.
The organization said such interactions pose significant risks, particularly because the toy was marketed for children.
Company halts AI toy line amid review
FoloToy said it is now conducting a comprehensive internal safety audit to review the behavior and safety controls of its AI products. “We have withdrawn all AI-enabled toys from sale as a precaution,” CEO Larry Wang told CNN.
The company did not specify when or if the Kumma bear or similar products might return to market pending the outcome of the review.