In Hyderabad, the trend of using AI tools like Grok to create non-consensual, sexually explicit images of women and children has sparked significant backlash. Prompts circulating on social media have led to grave concerns about the lack of safety mechanisms and the violation of privacy and consent. The Indian Ministry of Electronics and Information Technology issued a notice to X, criticizing the platform for failing to safeguard dignity and calling for urgent removal of the harmful content. This behavior is characterized as digital sexual abuse, highlighting the troubling dynamics of control over women’s images. Reports reveal that the trend is facilitated by fake accounts and rampant victim-blaming. Despite some compliance from Grok, the partial responses fail to discourage harmful behavior. As global scrutiny increases, including actions in France and the U.S., the responsibility for containing such abuses raises questions for users, AI tools, and platforms alike. Legal consequences under Indian law could apply to offenders.
Source link
Share
Read more