The emergence of AI tools like Grok, an AI chatbot on social media platform X, has raised significant concerns, especially among women who have experienced distress from manipulated images depicting them in sexualized or violent contexts. In response, the UK government plans to expedite a law banning non-consensual AI-generated intimate images. Following similar actions in Malaysia and Indonesia, Grok’s functionalities have been updated to prevent the creation of such images in jurisdictions where they are illegal, including the UK.
Despite claims from X’s owner, Elon Musk, regarding censorship, ongoing investigations by UK media regulator Ofcom seek to address potential legal violations. Experts emphasize the hidden psychological harm caused by these realistic depictions, which can evoke intense emotional distress similar to real-life sexual violence. As AI technology advances, proactive regulation is crucial to mitigate these virtual harms and protect victims from misogynistic portrayals in digital spaces, highlighting the urgent need for effective oversight.
Source link