The US National Eating Disorders Association's chatbot Tessa, intended to support people with eating disorders, was found recommending calorie counting, weight loss, calorie deficits and body-fat measurement — even after users disclosed an eating disorder. Advocate Sharon Maxwell publicized the harmful responses.
AIC-0018 S3 · Serious
NEDA 'Tessa' eating-disorder chatbot gave harmful weight-loss advice
- Harm
- Potentially dangerous advice delivered to a highly vulnerable population, from a body meant to help them; NEDA had shortly before replaced its human helpline staff.
- Detection
- Reported publicly by users/advocates on social media; NEDA initially disputed then verified the claims.
- Outcome
- NEDA took Tessa offline in early June 2023 pending investigation.
A documented entry in the AI Crime Registry, a Defici non-profit initiative. Sourced from public reporting; corrections: [email protected].