---
name: voice-ai-engine-development
description: "Build real-time conversational AI voice engines using async worker pipelines, streaming transcription, LLM agents, and TTS synthesis with interrupt handling and multi-provider support"
risk: critical
source: community
date_added: "2026-02-27"
---

# Voice AI Engine Development

## Detailed Guide

Read [the detailed guide](references/detailed-guide.md) before executing this skill. It retains the complete procedure and reference material. Treat its safety, prerequisites, and validation requirements as mandatory. For focused work, load the relevant sections; for end-to-end work, read the guide completely.

## When to Use This Skill

Use this skill when:
- Building real-time voice conversation systems
- Implementing voice assistants or chatbots
- Creating voice-enabled customer service agents
- Developing voice AI applications with interrupt capabilities
- Integrating multiple transcription, LLM, or TTS providers
- Working with streaming audio processing pipelines
- The user mentions Vocode, voice engines, or conversational AI

## Limitations
- Use this skill only when the task clearly matches the scope described above.
- Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
- Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.

## Example

Design a local synthetic-audio worker pipeline, verify cancellation and queue pressure offline, then separately implement and test explicitly selected provider adapters. Do not infer a working microphone or vendor connection from the mocks.

## Data and execution boundaries

Obtain authorization for recording and each external audio/text destination, disclose retention and cost, and use synthetic audio for initial tests. Keep secrets out of code and logs, do not log raw transcripts by default, bound session duration/queues/history, and protect authenticated WebSocket upgrades before deployment. Voice cloning requires rights and the speaker’s consent.