Protoface
Updated
Use a Protoface avatar to represent your agent on video in a Conversational AI Platform agent.
Preview documentation
Protoface provides real-time AI avatars that add a talking, lip-synced face to your voice agents, enabling natural video conversations with your AI agents.
Sample configuration
The following example shows how to configure Protoface as the agent's avatar when you create or update an agent. For a complete example, see Create an agent and start a session.
Protoface supports BYOK only. It isn't available in managed mode. Store your Protoface API key in a secret set, and refer to it from the agent. For details, see Use your own provider keys.
from agora_agent import Agent, Protoface, secret_ref
# client is your configured Agora client
agent = (
Agent(client=client)
.with_stt(...) # configure your ASR vendor
.with_llm(...) # configure your LLM vendor
.with_tts(...) # configure your TTS vendor
.with_avatar(
Protoface(
api_key=secret_ref("support_prod", "protoface"),
avatar_id="<protoface_avatar_id>",
agora_uid="<avatar_rtc_uid>",
agora_token="<avatar_rtc_token>",
)
)
)import { Agent, Protoface, secretRef } from 'agora-agents';
// client is your configured Agora client
const agent = new Agent({ client })
.withStt(/* configure your ASR vendor */)
.withLlm(/* configure your LLM vendor */)
.withTts(/* configure your TTS vendor */)
.withAvatar(
new Protoface({
apiKey: secretRef('support_prod', 'protoface'),
avatarId: '<protoface_avatar_id>',
agoraUid: '<avatar_rtc_uid>',
agoraToken: '<avatar_rtc_token>',
}),
);// client is your configured Agora client
agent := agentkit.NewAgent(client).
WithStt( /* configure your ASR vendor */ ).
WithLlm( /* configure your LLM vendor */ ).
WithTts( /* configure your TTS vendor */ ).
WithAvatar(vendors.NewProtoface(vendors.ProtofaceOptions{
APIKey: agentkit.SecretRef("support_prod", "protoface"),
AvatarID: "<protoface_avatar_id>",
AgoraUID: "<avatar_rtc_uid>",
AgoraToken: "<avatar_rtc_token>",
}))Add an avatar block to the pipeline. Protoface uses the generic avatar vendor. Set credential.mode to byok and credential.fields.api_key to the reference. In the following example, the key is stored as protoface in the support_prod set:
"avatar": {
"enabled": true,
"credential": {
"mode": "byok",
"fields": {
"api_key": "$secrets.support_prod.protoface"
}
},
"vendor": "generic",
"params": {
"api_base_url": "https://api.protoface.com/v1/agora",
"avatar_id": "<protoface_avatar_id>",
"agora_token": "<avatar_rtc_token>",
"agora_uid": "<avatar_rtc_uid>"
}
}Key parameters
The avatar block takes the following fields. In the SDKs, Protoface sets them from its options, and passes any other parameters from its additional parameters option to params.
| Parameter | Description |
|---|---|
enabledboolean | Set to |
vendorstring | Set to |
credentialobject | Set |
paramsobject |
|
For more information about avatars, refer to the Protoface avatar documentation. For a complete working project, see the Protoface Agora quickstart.
This integration is fully supported for use with the Conversational AI Platform. While it has completed functional validation, it is newer to the platform, and additional provider-specific edge cases may be identified as usage scales across a broader range of applications and workloads.
