Google Vertex AI

Google Vertex AI provides enterprise-grade access to Google's generative AI models with enhanced security, scaling capabilities, and integration with Google Cloud services.

Sample configuration

The following example shows a starting llm parameter configuration you can use when you Start a conversational AI agent.

"llm": {
   "url": "https://{region}-aiplatform.googleapis.com/v1/projects/{project}/locations/{region}/publishers/google/models/{model}:{resource}",
   "api_key": "$(gcloud auth print-access-token)",
   "system_messages": [
       {
           "role": "user",
           "parts": [ {"text": "You are a helpful chatbot."} ]
       }
   ],
   "max_history": 32,
   "greeting_message": "Good to see you!",
   "failure_message": "Hold on a second.",
   "params": {
       "model": "gemini-2.0-flash-001"
   },
   "style": "gemini"
}

Key parameters

llmrequired

api_key stringrequired

Refer to Google Cloud REST authentication to get your GCP credentials.

url stringrequired

Use the Vertex AI endpoint with your Google Cloud project ID and region in the URL path. Refer to Google Vertex AI API documentation for details.

system_messages array[object]nullable

Use parts array with text objects instead of simple content string.

style stringrequired

Set to gemini to use Gemini's message format.

params objectrequired

Show propertiesHide properties

model stringrequired

Refer to Vertex AI models for available models.

For advanced configuration options, model capabilities, and detailed parameter descriptions, see the Google Vertex AI API documentation.

Sample configuration​

Key parameters​

Sample configuration

Key parameters