Post-Upgrade Verification

Health Check

curl -f https://{GATEWAY_DOMAIN}/healthz

The health check should return a successful status. If the environment provides a readiness endpoint, confirm that database and upstream model service dependencies are ready.

Model Invocation Verification

Use a test API Key to call a test model.

curl https://{GATEWAY_DOMAIN}/v1/chat/completions \
  -H "Authorization: Bearer {API_KEY}" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen2.5-7b-instruct",
    "messages": [
      {"role": "user", "content": "Return the word ok."}
    ]
  }'

Expected result:

• The request returns successfully.
• Usage Log records tenant, organization, model, token usage, latency, and result.
• Audit Log records credential, route decision, and operation result.

Route and Quota Verification

Verify that Route Policy, model permission, and quota still take effect:

• Use an allowed organization to call an allowed model. The request should succeed.
• Use an organization without permission to call the model. The request should be rejected.
• Use a test quota close to its limit. The gateway should reject requests after the quota is exhausted.

Monitoring Verification

Confirm that metric collection and alerting work normally:

• Request count, error count, latency, and upstream failure metrics are updated.
• Gateway health status is visible in the monitoring system.
• Logs are written to the expected directory and are included in log collection.