Inception
InceptionLLMService streams chat completions from Inception through its OpenAI-compatible API.
Overview
Inception serves Mercury-3, a diffusion-based reasoning language model, over an OpenAI-compatible API.
InceptionLLMService: anOpenAILLMServicesubclass with Inception's base URL and default model.
Upstream page
Pipecat's documentation for the same service.
Source
packages/inception/src/llm.ts.
Inception docs
Models and the API reference.
Installation
bun add @pipedog/inceptionIt depends on @pipedog/openai, which is installed with it.
import { InceptionLLMService } from "@pipedog/inception/llm";Prerequisites
- An Inception account and an API key from Inception.
- Pass the key as
apiKey. It is required, and the service never falls back toOPENAI_API_KEY. The examples read it fromINCEPTION_API_KEY.
InceptionLLMService
Configuration
Prop
Type
The other options (organization, project, defaultHeaders, serviceTier,
retryOnTimeout, retryTimeoutSecs, function calling) are OpenAILLMService's. See
OpenAI.
| Base URL | https://api.inceptionlabs.ai/v1 |
| Default model | mercury-3 |
| Models to try | mercury-3. See the provider's catalog for the rest. |
Settings
Runtime-updatable settings, passed as settings: new InceptionLLMService.Settings({...})
(InceptionLLMSettings). They are OpenAI's settings, with these
defaults:
| Setting | Type | Default | Description |
|---|---|---|---|
model | string | "mercury-3" | Model name. |
reasoningEffort | "instant" | "low" | "medium" | "high" | null | null | Sent as reasoning_effort when set. When unset, Inception's server-side default applies. |
realtime | boolean | null | true | Sent as realtime in the request body, to cut the time to the first diffusion block. |
Every other setting keeps OpenAI's default. Unset sampling settings are left out of the request, so
the provider's own defaults apply. extra carries provider-specific request fields.
Usage
import { LLMUpdateSettingsFrame } from "@pipedog/core/frames/frames";
import { InceptionLLMService } from "@pipedog/inception/llm";
const llm = new InceptionLLMService({
apiKey: process.env.INCEPTION_API_KEY ?? "",
settings: new InceptionLLMService.Settings({
model: "mercury-3",
systemInstruction: "You are a helpful assistant in a voice conversation.",
}),
});Trade reasoning for speed with reasoningEffort:
const fast = new InceptionLLMService({
apiKey: process.env.INCEPTION_API_KEY ?? "",
settings: new InceptionLLMService.Settings({ reasoningEffort: "instant" }),
});Change settings mid-call with an LLMUpdateSettingsFrame. The next completion uses them:
// Queue it on the worker, or push it from a processor upstream of the service.
const update = new LLMUpdateSettingsFrame({
delta: new InceptionLLMService.Settings({ reasoningEffort: "low" }),
});Notes
- Runs a completion for each
LLMContextFrame, between anLLMFullResponseStartFrameand anLLMFullResponseEndFrame, and streams the reply asLLMTextFrames, asOpenAILLMServicedoes. Function calls, token usage metrics andrunInferencework the same way. - "developer" messages are sent as "user" messages, since the API doesn't support that role (
supportsDeveloperRoleisfalse). realtimeandreasoningEffortgo out in the request'sextra_body. A field you put insettings.extraunderextra_bodywins over the service's own.- The default model was
mercury-2before. Inception retires Mercury 2 and 2.5 on November 15, 2026, and they are closed to new signups. Until then,settings: new InceptionLLMService.Settings({ model: "mercury-2" })keeps it.
Runtime notes
| Runtime | Works | What it needs |
|---|---|---|
| Bun | ✅ yes | Nothing. |
| Node.js | ✅ yes | Nothing. |
| Deno | ✅ yes | Nothing. |
| Cloudflare Workers | ✅ yes | Nothing. |
Generated from pipecat.runtimes and pipecat.compat in packages/inception/package.json: ✅ means the compat smoke test passes on that runtime.
- The client is the official
openaiJS SDK (through@pipedog/openai), which talks throughfetch. It works on Bun, Node, Deno and Cloudflare Workers. - The deprecated
modelconstructor option is not ported. Usesettings. - Tested against a local OpenAI-compatible mock server, not against Inception itself.
pipedog is an unofficial community TypeScript port of Pipecat. It is not affiliated with or endorsed by Daily or the Pipecat project.
Portions adapted from the Pipecat documentation, Copyright (c) 2024–2025 Daily, BSD-2-Clause (see apps/docs/LICENSE-pipecat-docs).