Retool AI with Bedrock: Cross region inference support

💬 Feature Requests
1

I'm trying to use Retool AI with Bedrock, but I cannot make it work as it requires cross region inference support. Meaning that the model name should be us.anthropic.claude... instead of anthropic.claude... (with 'us.' prefix).

With the prefix it raises Retool issue: Dynamic model "us.anthropic.claude..." is not supported for Retool AI provider "awsbedrock".
Without prefix it is failing in Bedrock with Invocation of model ID anthropic.claude... with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.

Is there any way to solve it with existing functionality? Or it requires additional support from the Retool side?

2 Likes
3

Hi @Eugene_Saigak,

Thanks for reporting this! It looks like this will require a feature request. I'll reach out here when our team ships an update for this

1 Like
4

Hi,
Do you maybe have any updates on this feature?