Recent investigations by the Tech Transparency Project (TTP) reveal alarming uses of AI tools designed for creative content generation, such as avatars and videos, increasingly being exploited to create non-consensual sexualized images of women and girls. These AI-powered apps, often disguised as innocuous creative tools, are easily accessible in Apple and Google app stores. In their research, TTP identified 102 apps that allow users to manipulate images of women, resulting in over 705 million downloads and approximately $117 million in revenue. Many apps require only a simple text prompt, allowing even minors to generate explicit content effortlessly. Noteworthy cases included the app DreamFace, which despite prohibiting inappropriate content, facilitated the creation of sexualized images without warnings. This raises critical concerns regarding age appropriateness and the sufficiency of current safeguards, prompting calls for stricter regulation and protection for vulnerable users as the impact of generative AI grows.
Source link
