We are excited to announce significant enhancements to AI Gateway, now integrated into Unity Catalog as Unity AI Gateway. This upgrade enhances governance for AI agents, enabling consistent permissions, auditing, and policy application when accessing LLMs and interacting with MCP servers and APIs. AI agents can orchestrate complex workflows rapidly, but traditional governance tools are often inadequate for tracking these actions comprehensively. Unity AI Gateway addresses this gap, allowing control over LLM access and providing improved visibility into agent activities. Key features include fine-grained permissions, customizable guardrails, and detailed observability across LLM and MCP calls, making it easier to manage costs, debug issues, and maintain security. The platform supports rapid setup for multiple model endpoints and automatic failover to ensure reliability. With enhanced logging infrastructure, Unity AI Gateway meets the needs of FinOps, engineering, and security teams, facilitating efficient oversight of AI-driven workflows. For more insights, explore our detailed blog post.
Source link
Share
Read more