Resemble AI

OverviewCopy Anchor Link

ResembleAITTSService keeps one WebSocket open to Resemble AI's streaming endpoint and sends each sentence as a JSON request. Audio comes back as base64 JSON frames, which the service buffers (a one-second jitter buffer first, then 2208-byte frames) so playback survives Resemble's bursty delivery.

InstallationCopy Anchor Link

bun add @pipedog/resembleai

import { ResembleAITTSService } from "@pipedog/resembleai/tts";

PrerequisitesCopy Anchor Link

• A Resemble AI account on a plan that includes the WebSocket API, an API key, and the UUID of a voice.
• Pass the key as apiKey. The examples read it from RESEMBLE_API_KEY.

ConfigurationCopy Anchor Link

SettingsCopy Anchor Link

Runtime-updatable settings, passed as settings: new ResembleAITTSService.Settings({...}) (ResembleAITTSSettings). Any setting you leave out keeps the default below.

UsageCopy Anchor Link

import { ResembleAITTSService } from "@pipedog/resembleai/tts";

const tts = new ResembleAITTSService({
  apiKey: process.env.RESEMBLE_API_KEY ?? "",
  // Resemble's WebSocket reference lists the project as required.
  projectUuid: process.env.RESEMBLE_PROJECT_UUID ?? null,
  settings: new ResembleAITTSService.Settings({ voice: "your-voice-uuid" }),
});

Event handlersCopy Anchor Link

NotesCopy Anchor Link

• The sample rate defaults to 22050 Hz (8000, 16000, 22050, 32000 and 44100 work), precision to PCM_16 and outputFormat to wav. Audio is requested without a WAV header.
• Word timestamps come from Resemble's per-character timings, so each pushed "word" is one character.
• A 401 or 403 error from Resemble closes the connection and opens a new one.
• Resemble doesn't acknowledge the WebSocket closing handshake, so the service doesn't wait for one.
• projectUuid is not an upstream option. Resemble's reference lists project_uuid as required, but upstream never sends it, so the service sends it only when you set it.

Runtime notesCopy Anchor Link

• The WebSocket opens through the core websocketConnect, with the key in an Authorization header (through fetch on Cloudflare Workers), so it works on Bun, Node, Deno and Cloudflare Workers.
• The deprecated voiceId option is not ported. Use settings.
• Tested against a local WebSocket server, not against Resemble AI itself.

Generated from pipecat.runtimes and pipecat.compat in packages/resembleai/package.json: ✅ means the compat smoke test passes on that runtime.