Configure Route Policies
Scenario
Use Route Policies when a model has multiple channels or when different organizations should use different channels.
Prerequisites
- At least one channel is created and enabled.
- The channel has synchronized and enabled the target model.
- The administrator has permission to manage Route Policies.
Procedure
- Go to Route Policy.
- Click Create Policy.
- Enter a policy name, for example
prod-gpt-4o-primary-backup. - Select the applicable organization or scope.
- Select the target model.
- Add the primary channel and configure priority and weight.
- Add a backup channel with lower priority.
- Configure failover behavior.
- Click Save.
- Call the model with an API Key from the target organization and verify the selected channel.
Recommendations
| Scenario | Recommendation |
|---|---|
| Critical production model | Configure at least one primary channel and one backup channel. |
| Cost-sensitive model | Use a lower-cost channel as primary and a higher-quality channel as backup. |
| Organization isolation | Configure different policies for different organizations. |
| Grayscale validation | Use a test organization for a grayscale channel. |
Verification
- Use a test API Key from the target organization to call the target model.
- Confirm that Usage Log records the expected Route Policy and channel.
- Temporarily disable the primary test channel and confirm that the backup channel is selected.
Notes
- Do not change production Route Policies during peak traffic.
- Keep at least one verified channel for each production model.
- Record the reason, operator, and validation result for each policy change.