Logo
Docs
LLM Adapters

GroqAdapter

Copilot Runtime adapter for Groq.

Copilot Runtime adapter for Groq.

Example

import { CopilotRuntime, GroqAdapter } from "@copilotkit/runtime";
import { Groq } from "groq-sdk";
 
const groq = new Groq({ apiKey: process.env["GROQ_API_KEY"] });
 
const copilotKit = new CopilotRuntime();
 
const serviceAdapter = new GroqAdapter({ groq, model: "<model-name>" });
 
return copilotKit.streamHttpServerResponse(req, res, serviceAdapter);

Constructor Parameters

groqGroq

An optional Groq instance to use.

modelstring

The model to use.

disableParallelToolCallsboolean
Default: "false"

Whether to disable parallel tool calls. You can disable parallel tool calls to force the model to execute tool calls sequentially. This is useful if you want to execute tool calls in a specific order so that the state changes introduced by one tool call are visible to the next tool call. (i.e. new actions or readables)

On this page

Edit on GitHub