Smallest AI

OverviewCopy Anchor Link

• SmallestTTSService: streams text over a WebSocket and pushes audio as it arrives. Fragments of one LLM turn share a continuation context, so the voice keeps its prosody across them. An interruption reconnects the socket.

InstallationCopy Anchor Link

bun add @pipedog/smallest

import { SmallestTTSService } from "@pipedog/smallest/tts";

PrerequisitesCopy Anchor Link

• A Smallest AI account and an API key from Smallest AI.
• Pass the key as apiKey. The examples read it from SMALLEST_API_KEY.

SmallestTTSServiceCopy Anchor Link

Connects to wss://api.smallest.ai, with the key as a Bearer token on the handshake.

ConfigurationCopy Anchor Link

SettingsCopy Anchor Link

Runtime-updatable settings, passed as settings: new SmallestTTSService.Settings({...}) (SmallestTTSSettings). Any setting you leave out keeps the default below.

UsageCopy Anchor Link

import { TTSUpdateSettingsFrame } from "@pipedog/core/frames/frames";
import { Language } from "@pipedog/core/transcriptions/language";
import { SmallestTTSService } from "@pipedog/smallest/tts";

const tts = new SmallestTTSService({
  apiKey: process.env.SMALLEST_API_KEY ?? "",
  settings: new SmallestTTSService.Settings({ voice: "sophia", language: Language.EN }),
});

Change settings mid-call with a TTSUpdateSettingsFrame:

// Queue it on the worker, or push it from a processor upstream of the service.
const update = new TTSUpdateSettingsFrame({
  delta: new SmallestTTSService.Settings({ speed: 1.1 }),
});

NotesCopy Anchor Link

• outputFormat is "pcm" by default; it is fixed when the service is created.
• wordTimestamps (on by default) makes the service push aligned per-word TTSTextFrames. It works on meher, devansh, kartik, maithili, liam and avery; other voices send no word events, so leaving it on is safe.
• maxBufferDelayMs (0 to 5000) bounds how long the server holds a continuation fragment. null keeps the server's 3000 ms.
• The same package has Smallest AI's LLM and speech-to-text services.

Generated from pipecat.runtimes and pipecat.compat in packages/smallest/package.json: ✅ means the compat smoke test passes on that runtime.

Runtime notesCopy Anchor Link

• The WebSocket goes through the core websocketConnect, with headers on the handshake.
• Tested against local WebSocket servers, as upstream's tests do, not against Smallest AI itself.