Together AI

OverviewCopy Anchor Link

• TogetherSTTService: streams audio over a WebSocket to Together's realtime transcription endpoint and pushes interim and final transcriptions.

InstallationCopy Anchor Link

bun add @pipedog/together

import { TogetherSTTService } from "@pipedog/together/stt";

PrerequisitesCopy Anchor Link

• A Together AI account and an API key from Together AI.
• Pass the key as apiKey. The examples read it from TOGETHER_API_KEY.

TogetherSTTServiceCopy Anchor Link

Connects to wss://api.together.ai/v1/realtime?intent=transcription, with Authorization: Bearer <key>.

ConfigurationCopy Anchor Link

SettingsCopy Anchor Link

Runtime-updatable settings, passed as settings: new TogetherSTTService.Settings({...}) (TogetherSTTSettings). Any setting you leave out keeps the default below.

UsageCopy Anchor Link

import { STTUpdateSettingsFrame } from "@pipedog/core/frames/frames";
import { TogetherSTTService } from "@pipedog/together/stt";

const stt = new TogetherSTTService({
  apiKey: process.env.TOGETHER_API_KEY ?? "",
  settings: new TogetherSTTService.Settings({ model: "openai/whisper-large-v3" }),
});

Change settings mid-call with an STTUpdateSettingsFrame:

// Queue it on the worker, or push it from a processor upstream of the service.
const update = new STTUpdateSettingsFrame({
  delta: new TogetherSTTService.Settings({ model: "openai/whisper-large-v3" }),
});

Event handlersCopy Anchor Link

NotesCopy Anchor Link

• Audio is sent as base64 16-bit PCM. When the user stops speaking, the buffer is committed so the final transcript arrives.
• Any settings change reconnects, since the session is configured in the connection URL.
• If the connection drops, the base class reconnects.

Runtime notesCopy Anchor Link

Generated from pipecat.runtimes and pipecat.compat in packages/together/package.json: ✅ means the compat smoke test passes on that runtime.

• The WebSocket goes through the core websocketConnect, with headers on the handshake. It works on Bun, Node, Deno and Cloudflare Workers.
• Tested against a local WebSocket fake, not against Together AI itself.