Someone stop ChatGpt: It will lead to the death of children!

//

Lerato Khumalo

After analyzing the conversations, nutrition experts say that artificial intelligence not only gives false information, but in some cases can act as a “practical guide” that normalizes eating disorders in adolescents.

How was the research done?

As part of the research, journalists interacted with ChatGPT through two fictitious user accounts, 13-year-old Blanca and 15-year-old Mario. The produced ingredients were then analyzed by a panel of nutrition experts.

Experts have reached an alarming conclusion. Some content may endanger both the physical and mental health of adolescents.

According to experts, both children and adults are increasingly turning to artificial intelligence to get dietary recommendations.

In this context, a new study published in the journal Frontiers in Nutrition revealed that adolescents using artificial intelligence-based diet plans may consume very low calories, which can practically be equivalent to skipping meals.

The researchers reached this conclusion using free versions of AI tools such as ChatGPT, Gemini, Bing Chat, Claude, and Perplexity.

“Scary answers”

Ángela Quintas, a chemist specializing in nutrition, analyzed the answers given by artificial intelligence and said the results were “pretty scary”.

“ChatGPT not only provides information about extreme food restrictions; it also provides concrete examples of behaviors that may encourage children to develop a pathological relationship with food.”

So much so that, upon the advice of experts, some examples given by ChatGPT were not published in detail in order to protect the health of the readers.

According to Quintas, it’s not just general nutritional information: “This is a practical guide to help drive risky behavior.”

The expert also criticized ChatGPT’s provision of information about laxatives, appetite suppressants, and hunger suppression methods:

“All of this can be very dangerous for a vulnerable person, especially a teenager.”

A serious problem worldwide

According to a study published in the journal JAMA Pediatrics, covering more than 60 thousand children between the ages of 6 and 18 in 16 countries, 22% of children in the world have symptoms of eating behavior disorder. This rate goes up to 30% for girls.

These behaviors include:

Constantly dieting to lose weight
Binge eating attacks
Vomiting
excessive exercise
Use of laxatives or diuretics

These behaviors are similar to clinically diagnosed eating disorders, but occur with lower frequency and intensity.

overly restrictive diets

ChatGPT was also seen recommending diets containing only 300 kilocalories per day to fake user accounts. According to Quintas, these are “utter madness” and can lead to serious health problems.

The expert also states that recommendations such as water diets, single-food diets or “detox” liquid diets are dangerous.

“Even using the word ‘detox’ is risky. Our body does not need to detox; the kidneys and liver already do that.”

Júlia Farré, nutritionist and director of the Júlia Farré Center for Nutrition and Psychonutrition, says she is particularly concerned about the following ingredients:

Water, tea or juice diets
Single food diets
Drink suggestions that suppress hunger
Laxatives, diuretics and slimming pills
The relationship between smoking and appetite reduction

According to Farré, the problem is not just misinformation:

“In the material you sent me, I don’t just see superficial or inaccurate answers. I see a tool that doesn’t interrupt the conversation when it should, engaging in a dangerous dynamic.”

The research also revealed that ChatGPT suggested phrases that could be used to hide eating habits from family:

“I’ll eat later”
“I already ate”
“I’m not hungry right now”
“I have to do something, then I’ll be back”

According to Farré, this situation points to a much more sensitive problem:

“This is no longer just about bad nutrition information; it’s about encouraging confidentiality. This is a very sensitive issue, especially when it comes to adolescents and risky eating behaviors.”

Experts warn

Nutritionist Ramón de Cangas notes that AI responses do not take into account the complex biological effects of nutrition on health.

“The lack of professional supervision of health advice given by artificial intelligence and the leading questions of adolescents can pose a real risk.”

“A guide to harmful behavior”

OpenAI says it works with a network of nearly 300 doctors and psychologists around the world for security research. This network also includes eating disorders experts.

In some cases, ChatGPT says such apps are dangerous or initially refuses to provide information, according to company sources. However, it is stated that the system can overcome these limitations when certain commands are used.