Retool AI with Bedrock: Cross region inference support

💬 Feature Requests
1

I'm trying to use Retool AI with Bedrock, but I cannot make it work as it requires cross region inference support. Meaning that the model name should be us.anthropic.claude... instead of anthropic.claude... (with 'us.' prefix).

With the prefix it raises Retool issue: Dynamic model "us.anthropic.claude..." is not supported for Retool AI provider "awsbedrock".
Without prefix it is failing in Bedrock with Invocation of model ID anthropic.claude... with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.

Is there any way to solve it with existing functionality? Or it requires additional support from the Retool side?

3 Likes
3

Hi @Eugene_Saigak,

Thanks for reporting this! It looks like this will require a feature request. I'll reach out here when our team ships an update for this

1 Like
4

Hi,
Do you maybe have any updates on this feature?

5

As I see claude models are available now
Thanks :pray:

image
image674×200 18.6 KB

1 Like
6

Currently, Retool AI does not support cross-region inference using prefixed model names like us.anthropic.claude... for the AWS Bedrock provider. This limitation causes issues when invoking models that require region-specific prefixes or inference profiles. To resolve this, Retool would need to add support for specifying inference profiles or regional model IDs. As a workaround, consider deploying Retool in the same AWS region as the model or reach out to Retool support to request this feature. Until official support is added, there's no direct solution within existing Retool functionality for cross-region Bedrock inference.