Skip to main content
Conversational AI Engine: Create advanced voice apps by combining Agora's real-time audio with powerful conversational AI.

Groq

Groq provides state-of-the-art language models optimized for different use cases.

Sample configuration​

The following example shows a starting llm parameter configuration you can use when you Start a conversational AI agent.


_16
"llm": {
_16
"url": "https://api.groq.com/openai/v1/chat/completions",
_16
"api_key": "<your_llm_key>",
_16
"system_messages": [
_16
{
_16
"role": "system",
_16
"content": "You are a helpful chatbot."
_16
}
_16
],
_16
"max_history": 32,
_16
"greeting_message": "Hello, how can I assist you?",
_16
"failure_message": "Please hold on a second.",
_16
"params": {
_16
"model": "llama-3.3-70b-versatile"
_16
},
_16
}

Key parameters​

llmrequired
  • api_key stringrequired

    Create and manage your API key from Groq console.

  • url stringrequired

    Use the completions endpoint.

  • params objectrequired
    Show propertiesHide properties
    • model stringrequired

      Refer to Groq models for available models.

For advanced configuration options, model capabilities, and detailed parameter descriptions, see the Groq API Documentation.