Expressive mode

Expressive mode enables agents to deliver speech that reflects intent, emotion, and emphasis, adapting in real time to how users sound and what they say. It is built on two system-level improvements to the conversational stack:

1. Eleven v3 Conversational — the most emotionally intelligent, context-aware Text to Speech model available in ElevenAgents.
2. A new turn-taking system — more accurately timed responses with fewer interruptions.

Expressive mode is enabled by default when you select Eleven v3 Conversational as your agent's TTS model.

Eleven v3 Conversational is an ultra-low-latency version of Eleven v3, optimized for live, back-and-forth dialogue. It maintains conversational context across turns and adapts delivery to match the tone and intent of each exchange.

• Context-aware delivery: Agents adapt tone based on conversational context — responding more calmly when a user sounds worried, or more directly when clarity matters.
• Explicit emotional control: Guide delivery through system prompt rules, from precise triggers to broader scenarios, to align with brand voice and compliance requirements.
• 70+ language support: Expanded from ~32 languages in Flash models, with improved expressiveness in languages where nuance previously lagged, including Japanese.
• Expressive tags: The LLM can output tags like [laughs], [whispers], or [sighs] to control specific moments of delivery.

The new turn-taking system uses real-time signals from Scribe v2 Realtime — including emotional cues and speech patterns — to determine when an agent should speak, pause, or wait. This helps agents respond more naturally, especially in emotionally charged situations.

For example, "yeah" can be a complete acknowledgement or a lead-in to continue speaking. By analyzing how it was said (speech cues like prosody) in addition to the transcript, the system times the agent's response more naturally.

Turn-taking behavior can be further tuned with the turn eagerness setting.

Set your agent's TTS model to V3 Conversational. Expressive mode is enabled by default with this model.

Open your agent in the dashboard, navigate to the Agent Voice tab, and select V3 Conversational as your Text to Speech model. Save your changes.

elevenlabs agents pull --agent "<agent-name>"

Set conversation_config.tts.model_id:

{
  "conversation_config": {
    "tts": {
      "model_id": "eleven_v4_turbo"
    }
  }
}

elevenlabs agents push --agent "<agent-name>"

from elevenlabs import ElevenLabs

elevenlabs = ElevenLabs()

elevenlabs.conversational_ai.agents.update(
    agent_id="agent_7101k5zvyjhmfg983brhmhkd98n6",
    conversation_config={
        "tts": {"model_id": "eleven_v4_turbo"},
    },
)

import { ElevenLabsClient } from "@elevenlabs/elevenlabs-js";

const elevenlabs = new ElevenLabsClient();

await elevenlabs.conversationalAi.agents.update("agent_7101k5zvyjhmfg983brhmhkd98n6", {
  conversationConfig: {
    tts: { modelId: "eleven_v4_turbo" },
  },
});

Add instructions to your agent's system prompt to steer how the agent adapts its tone. You can use broad guidance or specific triggers.

Guide your agent's emotional delivery through natural language instructions in the system prompt. The model interprets these contextually, so explicit tags are not required for every situation.

You are a customer support agent. When a user sounds frustrated or upset, respond
in a calm, reassuring tone. When delivering good news, allow your tone to reflect
genuine warmth. Maintain a professional but approachable delivery throughout.

You are a conversational AI agent with expressive speech capabilities.

Tone guidelines:
- When a user expresses frustration, use a calm and empathetic tone
- When explaining technical steps, use a clear and measured pace
- When a user shares good news, respond with warmth and enthusiasm
- When handling complaints, remain composed and solution-oriented

In addition to context-aware delivery, the LLM can output explicit tags to control specific moments. Common tags include:

• [laughs] — Adds laughter to the speech
• [whispers] — Lowers volume for whispering
• [sighs] — Adds a sighing quality
• [slow] — Slows down speech delivery
• [excited] — Adds excitement to the delivery

Each tag affects approximately the next 4-5 words of speech before returning to normal delivery.

You can also use expressive tags in your responses for precise control:
- [laughs] for moments of humor
- [whispers] for confidential or intimate moments
- [sighs] for resignation or relief
- [slow] when emphasizing important information

Example: "That's great to hear! [laughs] I'm glad we could sort that out for you."

Guide your agent to match its emotional delivery to the situation. A frustrated customer should hear a calm, empathetic response. A user sharing good news should hear genuine warmth. Mismatched tone erodes trust.

Define clear tone guidelines in your system prompt rather than relying solely on the model's judgment. This ensures consistent delivery aligned with your brand voice and compliance requirements.

Expressive delivery may vary across languages. Test your agent in each target language to ensure the emotional nuance lands as intended, especially in languages where conversational norms differ.

Pair expressive mode with appropriate turn eagerness settings. Patient mode gives users more space in emotionally sensitive conversations, while eager mode works for fast-paced interactions.

Use conversation analytics to track how users respond to expressive delivery. Refine your tone guidelines based on conversation outcomes and user feedback.

No. Eleven v3 Conversational is priced the same as other ElevenLabs TTS models in Agents, starting at $0.08 per minute.

Select V3 Conversational as your agent's TTS model. Expressive mode is enabled by default with this model.

The system uses real-time signals from Scribe v2 Realtime, including emotional cues and speech patterns, to predict when the agent should respond. It analyzes both the transcript and how words were spoken (prosody) to time responses naturally.

Eleven v3 Conversational does not currently preserve PVC characteristics well. If maintaining your PVC voice identity is critical, consider using Flash v2 instead.

Eleven v3 Conversational supports 70+ languages, expanded from ~32 in Flash models. This includes improved expressiveness in languages like Japanese where nuance previously lagged.

Eleven v3 Conversational offers a higher emotional range than Flash, and Multilingual v2, with the ability to adapt delivery based on conversational context. It supports 70+ languages compared to ~32 for Flash. It is priced the same as other models.

Configure turn eagerness, timeouts, and interruption handling

Use different voices for multi-character conversations and language tutoring

Adjust the overall speaking speed of your agent

Optimize your agent's behavior with effective prompting