CopilotKit + LlamaIndex

Bring your LlamaIndex agentsinto any app

CopilotKit is an open-source framework that connects your app to LlamaIndex agents. Give your agents chat, generative UI, human-in-the-loop, AG-UI Streams, Automatic Learning and more.

Quickstart
Chat

Waking up the demo

Talk to your agent in a ready-made chat interface. Open in the showcase

LlamaIndex and CopilotKit running together, in the React frontend. Every demo below is the same integration with one capability turned on.

Build with LlamaIndex

LlamaIndex gives you the agent and everything it reads: indexes, retrievers and the workflow around them. What it does not give you is the surface. Your users need a place to talk to the agent, a view of the run while it works, and a way to step in. Each capability below builds on something your agent already does.

Generative UI

Your workflow emits events and tool calls as it runs. CopilotKit streams them to the browser and renders each one as a React component, so retrieval and reasoning are visible instead of hidden behind a spinner.

Human-in-the-loop

A frontend tool registered with useHumanInTheLoop renders your own UI, waits for the user's answer, and hands it back to the agent as the tool result.

Shared state

Your workflow carries state between steps. CopilotKit mirrors it into your app and back, so changes from the user and the agent go to the same state.

Chat surfaces, headless UI, frontend tools and multi-agent flows work with LlamaIndex too. And more

Start building

Scaffold a new app with the CLI, or follow the quickstart to connect the LlamaIndex agent you already run.

npx copilotkit@latest init
Read the quickstart

Connect your agent

Your agent keeps running as its own LlamaIndex service. The LlamaIndexAgent bridge points CopilotKit at its AG-UI endpoint, so nothing inside the agent changes.

app/api/copilotkit/[[...slug]]/route.ts
import {
  CopilotRuntime,
  createCopilotRuntimeHandler,
} from "@copilotkit/runtime/v2";
import { LlamaIndexAgent } from "@ag-ui/llamaindex";

const runtime = new CopilotRuntime({
  agents: {
    my_agent: new LlamaIndexAgent({ url: "http://localhost:8000/run" }),
  },
});

const handler = createCopilotRuntimeHandler({
  runtime,
  basePath: "/api/copilotkit",
});

export const GET = handler;
export const POST = handler;
Read the setup guide

How is this guide?