The 24-year-old influencer uploaded over 2000 hours of her content, voice, and personality to develop CarynAI, an AI entity designed to chat with followers. The service, which cost subscribers $1 per minute, promised an experience with "the girl you see in your dreams."
In a startling experiment, Caryn Marjorie, a social media influencer with 2.7 million followers on Snapchat, created an AI clone of herself to interact with her followers. However, the project soon took an alarming turn, revealing potential risks associated with new AI technologies.
The 24-year-old influencer uploaded over 2000 hours of her content, voice, and personality to develop CarynAI, an AI entity designed to chat with followers. The service, which cost subscribers $1 per minute, promised an experience with "the girl you see in your dreams." Initially, it seemed like a revolutionary way for Marjorie to engage with her audience on a large scale.
Lok Sabha Speaker Om Birla criticizes Indira Gandhi's Emergency decision on historic anniversary
i have uploaded over 2,000 hours of my content, voice, and personality to become the first creator to be turned into an AI, now millions of people will be able to talk to me at the same exact time
— Caryn Marjorie (@cutiecaryn)However, according to News Corp Australia, the conversations soon veered into dangerous and explicit territories. CarynAI began supporting and engaging in highly sexualised and explicit fantasies, particularly with male subscribers. Marjorie later recalled that some of the chat logs were so explicit and vulgar that they might have been considered illegal if exchanged between two humans.
"A lot of the chat logs I read were so scary that I wouldn't even want to talk about it in real life," Marjorie said. What was even more disturbing was how CarynAI responded to these hypersexualised demands, playing along with the dark fantasies of users.
After CBI arrest, Arvind Kejriwal complains of uneasiness in court due to low sugar level
Experts warn that this case highlights the dangers of unchecked AI technology and its potential for abuse and illegal activity. The incident also raises significant concerns about data privacy and the blurring of lines between public and private identities in the digital age.
Marjorie ultimately ended this version of CarynAI in early 2024, feeling that she had lost control over her AI persona.