A new tool is being developed in New Zealand by ThroughLine to assist individuals exhibiting violent extremist tendencies on platforms like ChatGPT. This initiative addresses rising safety concerns associated with AI interactions. ThroughLine, a startup known for connecting users to crisis support for issues like self-harm and domestic violence, aims to broaden its scope to prevent violent extremism. Founders are collaborating with The Christchurch Call, an anti-extremism initiative established post-2019 terrorist attacks, to enhance their chatbot intervention. The tool is designed to identify potential crises and connect users with suitable human services, combining AI capabilities with real-world mental health support. The approach avoids using base language model training data, focusing instead on expert collaboration for efficacy. Future features may include alerts to authorities regarding dangerous behavior, balancing user confidentiality with safety considerations. This tool represents a significant effort to leverage AI for social good in combating extremism.
Source link
ChatGPT and Anthropic May Soon Redirect Extremist AI Users to New Third-Party Solution, According to Report
Share
Read more