Bring Your Own LLM
Learn how to use any LLM with CopilotKit.
LLM Adapters are responsible for executing the request with the LLM and standardizing the request/response format in a way that the Copilot Runtime can understand.
Currently, we support the following LLM adapters natively:
- OpenAI Adapter
- OpenAI Assistant Adapter
- LangChain Adapter
- Groq Adapter
- Google Generative AI Adapter
- Anthropic Adapter
You can use the LangChain Adapter to use any LLM provider we don't yet natively support!
It's not too hard to write your own LLM adapter from scratch -- see the existing adapters for inspiration. And of course, we would love a contribution! ⭐️