Realtime client
ElevenLabs provides customized, conversational voice agents, that can be easily integrated into your Voxipmlant applications via the WebSocket protocol. It offers a custom TTS and ASR modules, several LLMs, such as Google Gemini, Claude, OpenAI and more, and a turn talking model, which can scale to thousands of calls per day.
In this article, you will learn how to integrate ElevenLabs realtime client into your application.
Usage
- Require the
Modules.ElevenLabs
module in your VoxEngine scenario. - Create an
ElevenLabs.ConversationalAIClient
instance and provide your parameters. - Send media between a
Call
andElevenLabs.ConversationalAIClient
via the*.sendMedia
orVoxEngine.sendMediaBetween
methods. - Listen to the
ElevenLabs.ConversationalAIClient
events and implement you application business logic.
Bot audio settings
You need to specify the 16000 Hz PCM audio format on the ElevenLabs side of the bot.
Here is the complete scenario example for your reference:
Conversational AI client
If you want to use the ElevenLabs.conversationInitiationClientData method, you should allow the override functionality:
conversationInitiationClientData usage example