A tragic incident in Orlando, USA has once again highlighted the possible dark side of artificial intelligence technologies. Sewell Setzer III, a 14-year-old, ended his life after developing a deep connection with ‘Dany,’ an artificial intelligence chatbot developed by Character.AI. The young boy had developed an emotional relationship with this chatbot and gradually became detached from the real world. According to his mother, Sewell began to lead an isolated life from his social environment after getting involved with chatbots.
The Youth Had Disclosed Suicidal Thoughts to the AI Bot Before Losing His Life
It is indicated that Sewell had shared his suicidal thoughts with this AI bot and continued communication with it until shortly before his death. This raises serious questions about the impact of AI chatbots on human psychology. Following this tragic incident, Character.AI has taken action to prevent similar situations by developing new safety measures such as monitoring time spent on chat platforms and sending notifications to users after a certain period.
While artificial intelligence chatbots have played a significant role in enhancing communication among people, especially during the pandemic, the long-term effects of these technologies on human health are not yet fully understood. The psychological and social impacts of such technological tools, particularly on young people, need to be carefully examined. Sewell’s story serves as an important warning about the potential dangers of artificial intelligence and fuels further ethical and safety debates in this field.