GenAI Processors is a lightweight Python library designed for creating modular, asynchronous, and composable AI pipelines tailored for generative AI. Central to the library is the concept of a Processor, which functions as a unit of work encapsulating input and output streams of ProcessorParts. These processors can be easily applied to various data streams, enabling efficient content processing.
The library supports modularity by breaking tasks into reusable units that can be chained or executed in parallel, and integrates seamlessly with the GenAI API, offering pre-built processors for different use cases. It’s extensible, allowing users to create custom processors, and is built on Python’s asyncio for handling concurrent tasks. Additionally, it features robust stream management utilities.
Installation requires Python 3.10+, and extensive documentation, including examples of real-time applications, is available. The project encourages community contributions, adhering to the Apache License, Version 2.0.
Source link
