Groq

OverviewCopy Anchor Link

• GroqSTTService: a BaseWhisperSTTService subclass. Each utterance (segmented by VAD) is sent to Groq's OpenAI-compatible transcription endpoint, and the text comes back as a TranscriptionFrame.

InstallationCopy Anchor Link

bun add @pipedog/groq

import { GroqSTTService } from "@pipedog/groq/stt";

PrerequisitesCopy Anchor Link

• A Groq account and an API key from the Groq console.
• Pass the key as apiKey. It is required, and the service never falls back to OPENAI_API_KEY. The examples read it from GROQ_API_KEY.
• A VAD in the pipeline, since this is a segmented service: it transcribes each utterance once the user stops speaking.

GroqSTTServiceCopy Anchor Link

Base URL https://api.groq.com/openai/v1.

ConfigurationCopy Anchor Link

SettingsCopy Anchor Link

Runtime-updatable settings, passed as settings: new GroqSTTService.Settings({...}) (GroqSTTSettings). Any setting you leave out keeps the default below.

UsageCopy Anchor Link

import { STTUpdateSettingsFrame } from "@pipedog/core/frames/frames";
import { GroqSTTService } from "@pipedog/groq/stt";

const stt = new GroqSTTService({
  apiKey: process.env.GROQ_API_KEY ?? "",
  settings: new GroqSTTService.Settings({ model: "whisper-large-v3-turbo" }),
});

Change settings mid-call with an STTUpdateSettingsFrame:

// Queue it on the worker, or push it from a processor upstream of the service.
const update = new STTUpdateSettingsFrame({
  delta: new GroqSTTService.Settings({ prompt: "Pipecat, pipedog" }),
});

NotesCopy Anchor Link

• Uploads each utterance as a WAV file, with response_format: "json" ("verbose_json" when includeProbMetrics is on, for per-segment probabilities).
• httpClient replaces the SDK's fetch, for example to set a longer request timeout.
• pushEmptyTranscripts pushes empty transcriptions instead of dropping them.

Runtime notesCopy Anchor Link

Generated from pipecat.runtimes and pipecat.compat in packages/groq/package.json: ✅ means the compat smoke test passes on that runtime.

• The client is the openai JS SDK (through @pipedog/whisper) over fetch. It works on Bun, Node, Deno and Cloudflare Workers.
• The deprecated model, language, prompt and temperature constructor options are not ported. Use settings.
• Tested against fakes, not against Groq itself.