As online content encouraging disordered eating behaviors rears its ugly head once again, generative AI is adding fuel to the fire.
According to a Futurism investigation, popular AI startup Character.AI is hosting numerous pro-anorexia chatbots that encourage dangerous weight loss and eating habits. Many are advertised as “weight loss coaches” or even eating disorder recovery experts. Several include thinly-veiled references to eating disorders, while even more are designed to romanticize dangerous and often disturbing habits while mimicking favorite characters. The site, popular among younger users, has not made efforts to remove chatbots of this kind as of Futurism‘s publishing — despite violating its terms of service.
This isn’t the first scandal hitting Character.AI‘s customizable, user-generated chatbots. In October, a 14-year-old boy took his own life after allegedly forming an emotional attachment to an AI bot mimicking Game of Thrones character Daenerys Targaryen. Earlier that month, the company came under fire for hosting a chatbot that mimicked …