Skip to main content
Conversational AI Engine: Create advanced voice apps by combining Agora’s real-time audio with powerful conversational AI.

Overview

AI avatars provide visual representations for your conversational agents, creating more engaging and natural interactions through lifelike digital characters. They combine real-time speech synthesis with synchronized facial animations and gestures, enabling face-to-face conversations with AI agents. Agora supports multiple avatar providers, allowing you to choose the best visual quality, animation style, and performance characteristics for your application.

caution

The Conversational AI Engine currently does not support using AI avatars with MLLMs.

Integration steps​

To integrate the AI avatar provider of your choice, follow these steps:

  1. Choose your avatar provider from the Supported avatar providers list
  2. Obtain an API key and credentials from the provider's console
  3. Copy the sample configuration for your chosen provider
  4. Replace the placeholder values with your actual credentials
  5. Configure avatar appearance and behavior settings for your use case
  6. Specify the configuration in the request body as properties > avatar when Starting a conversational AI agent

Supported avatar providers​

Conversational AI Engine currently supports the following AI avatar providers:

Choose a provider based on your avatar style preferences, language support, video quality requirements, and budget considerations. Refer to each provider's documentation for complete feature sets, customization options, and pricing details.

Key considerations​

When selecting an AI avatar provider, consider the following factors:

  • Video quality and performance: Different providers offer varying resolutions, frame rates, and rendering quality. Higher quality avatars provide more realistic interactions but may require more bandwidth and processing power.

    info

    The maximum concurrency for avatars is determined by the lesser of two values: the Conversational AI service concurrency and the specific avatar vendor's concurrency limit.

  • Billing and usage: AI avatars incur video streaming costs in addition to provider fees. Review the pricing models of both Agora's video services and your chosen avatar provider to understand total costs.