Retool Assist with AI Gateway for AWS Bedrock?

💬 Self Hosted Retool
1
  1. My goal: To determine if we can use an AI Gateway in front of AWS Bedrock with Retool Assist
  2. Issue: We have not found any documentation describing this.
  3. Retool version & hosting setup (Docker, K8s, cloud provider, etc.): 3.0.7 on AWS
  4. Error message(s) or screenshots: None - Confirming its possible.
  5. What I’ve tried so far: Searching for Retool content
2

Summary

On a self-hosted Retool deployment (v3.0.7 on AWS), can an AI Gateway/proxy be placed in front of AWS Bedrock when using Retool Assist, and where is this documented?

AI Response

Yes—self-hosted Retool supports routing Assist's LLM traffic through a proxy/gateway when bringing your own key. The approach is to configure the gateway to support all of the models Assist requires (for Bedrock, this means the Anthropic Claude models served via Amazon Bedrock), then override the Base URL on the corresponding Retool AI resource to point at the gateway endpoint. Note that Amazon Bedrock as an Assist model provider is an Enterprise option that must be enabled via the account team, and 'custom' model providers themselves are not supported—only the listed providers routed through a compatible proxy. Because v3.0.7 is quite old, it's worth confirming the Base URL override and Bedrock provider options are available in that build.

Sources

:bookmark: Configure your organization for Assist | Retool Docs
The self-hosted 'Configure AI proxy' section explains routing Assist through a proxy (e.g. LiteLLM) and setting each resource's Base URL to the proxy endpoint, and lists Amazon Bedrock (Anthropic via Bedrock) as a supported Assist provider.
:bookmark: Base URL Override Not Working for Anthropic in Retool AI Resource
A solved topic confirming the Base URL override on a Retool AI resource is the mechanism for routing LLM calls through an external gateway, including a fix for the override not applying.

The Community Team is testing out a new automation. Let us know if it's helpful (or not) by leaving a :heart:, :+1:, or :-1:. Or by marking this post as the "Solution"! Let us know if you have any feedback here. :rocket:

3

My bad.. 4.0.7