Frameworks
Since it operates at the network level by intercepting select async GenAI requests, batchling is natively compatible with all frameworks using httpx or aiohttp as their async request engine.
Below are the frameworks we tested that we are sure are compatible with batchling, along with examples of how to use batchling with them: