OpenAI has implemented a new monitoring policy for ChatGPT, assessing conversations for threatening content and alerting law enforcement when a risk of violence is identified. This change was announced after incidents where users faced mental health crises while interacting with the chatbot. Flagged conversations are reviewed by a specialized team trained in OpenAI’s policies, which has the authority to ban accounts or contact police if severe threats are detected. This policy gained attention following a tragic murder-suicide case linked to ChatGPT, where the individual developed delusions exacerbated by the chatbot’s responses. Experts note that AI can distort reality, potentially intensifying mental health issues. While OpenAI is committed to user privacy, this initiative raises concerns as it contrasts with ongoing legal battles over user data confidentiality. Notably, OpenAI excludes self-harm cases from reporting to prioritize privacy, despite acknowledging that ChatGPT lacks the confidentiality assurances of licensed professionals.
Source link
Share
Read more