Ask HN: What Strategies Can You Use to Safeguard Support AI Agents Against Voice Prompt Injection?

We are in the process of hiring a customer support agent who will be responsible for retrieving information about our company services from a Retrieval-Augmented Generation (RAG) system. This agent will be integrated with various tools to facilitate escalations to human representatives and manage support ticket creation. The support agent will also utilize voice technology from 11labs. Although we have conducted a thorough assessment for normal prompt injection vulnerabilities related to our tools, we are seeking solutions to protect against potential voice attacks.

Source link