Hi folks! I'm excited to announce that Retool now supports custom AI providers.
You can now connect any AI provider that adheres to the OpenAI, Anthropic, Google, or Cohere schema. This enables you to connect from a wide range of AI providers, such as Mistral, Fireworks AI, Together AI, and OpenRouter.
Organizations with increased security and compliance requirements can also configure custom AI providers if they need to route traffic through their own proxies.
I absolutely hate help that's not actually helpful.
Sorry for the tone, it just seems you've done the bare minimum and the docs doesn't even answer the question.
I've done that step.
How do I actually use it Kent, not sent it up.
In the chat component do I have do add it as a resource?
When I open the resources I can connect OpenAI but that's it.
Do I keep it as retool AI?
@dominiconorton within any AI query (in an app, or a workflow), there is a "model" drop-down. Inside the model dropdown, you can select a model from the Custom AI provider that you've connected. If you're not seeing your Custom AI Provider's models in that dropdown, you'll want to ensure that you've added at least one "model name" in the Custom Provider configuration.
I've attached a photo, let me know if you have more questions.
just thought i'd add a picture of the "model name" @kent is referring to:
to add a model name, click in the area like it's text input and it'll allow you to type stuff, then hit enter and it will update the dropdown.... if you just click the dropdown and it's empty, there's no option to add item and it took me a sec to figure out how to add things
