App Gen Model choice

💬 App Building
1
  1. My goal:

I'd like to be able to bring my own key for the app gen functionality so I have introduced DeepSeek, which has an open API-style endpoint.

  1. Issue:

Even though I can select this new endpoint in the AI section of settings, the app gen doesn't work. Even though I still have a Tropic key re-tool managed, it won't default to this one when the other one doesn't function

Can I make it such that the DeepSeek open AI style endpoint works with DeepSeek reasoning?

If not, can I make Retool default to the anthropic?

3

@ChiEn could you have a look? I think it's very hard to find a way to control the actual model that is used by App Assist

I consulted documentation and went to a resource to configure this in Retool AI
It is nowhere to be found anymore
Then upon checking settings, AI there is no way I can specify the model. I can set an OpenAI key and an Anthropic one but I have no way to control which one is used

And also I provided an endpoint in the OpenAI style with DeepSeek. Also it didn't work

Can you guide me on how to do this?

4

Hey @mascaritas, are you looking to switch the model Assist uses, or the model your Agents use? And what plan are you currently on?

Could you clarify where you're configuring that? A screenshot of the settings page where you added the DeepSeek endpoint would help. Thanks!

5

Thanks a lot. I'm looking for a way to control the model that my app gen uses, not the agent.

Also I have included two screenshots where you are able to see how I configured this. Also in the AI section it is selectable if I wanted to select the OpenAI DeepSeek because they offer an OpenAI-style endpoint to hit

image
image1754×1347 106 KB

image
image1636×698 54.5 KB

6

@Darren @ChiEn is there anything we can do to adjust this ?

7

Hey @mascaritas - unless you're on an Enterprise plan, app generation via Assist currently requires that you use Retool-managed keys, as described here. The fact that you even have access to this dropdown is probably a bug - I'll follow up internally!

1 Like
8

Thanks a lot for your reply and explanation. Now what I have done is reset the API keys in the resources to be retool managed for Anthropic and for OpenAI.

Now I opened a new app and use App Assist to create new elements but constantly this dialogue would show up. I would assume if I have Retool managed for OpenAI and Anthropic, the models should be all right

Also I can then begin to build but it's painfully slow and it lets me wait so much longer than it used to

image
image715×1195 66.5 KB

9

Hi @Darren or @ChiEn since you mentioned that there was maybe a bug in my instance, could someone from the team take a look?

I have also opened a supportcase, but they were not able to help, can I grant access to somebody that can take a look under the hood?

I am currently not able to use the App Assist even when I use all “retool managed” resources,

Is there a way I can do a “reset” so it works like it used to ( I built many apps using my own key and it worked like a charm )

thank you

10

I've been digging into this and have a bit more insight into what's going on.

The warning that you currently see when interacting with Assist is misleading. When starting a new session, Retool currently runs a check on all BYOK AI resources to verify the presence of specified model endpoints - even for resources not assigned to Assist. As such, the warning only indicates that a potentially incompatible resource definition exists. This is definitely something we should fix, but it shouldn't block you from using Assist with Retool-managed keys.

1 Like
11

Thanks a lot for clarifying this and looking under the hood. This is exactly what is happening. I now deleted this "Bring Your Own Key" that I have on the side and the error message seems to be gone

However I have another hypothesis: I still notice my Appgen being super slow and also not so performant like it used to be. I was able to run it with my own keys before. Can that make such a big difference?

Actually should it make such a big difference? Is it maybe because it's restricted by retool manage key so the workload is a bit distributed and this hits the performance?

12

Earlier it never used to ask such questions because it actually can see the canvas and the whole app surface.
Now it's acting quite blind for the moment

image
image730×495 35 KB