Hello
I am playing around with the custom provider feature but can't seem to get it working.
I have defined the provider just like in the docs:
- Added the base url (ending on '/v1')
- Selected OpenAI Schema
- Added auth
Every time I send out a prompt I get a timeout. My endpoint has a route that looks like this: [POST] {{base_url}}/v1/chat/completions
In my app I have added the Retool AI component and selected ' generate chat response' as the action and I selected my custom model.
I do not receive any calls in my endpoint, the logs are not showing anything.
To debug I tried it with a custom REST API Resource. That worked fine, I got to see the logs in my backend.
Also the docs are quite empty on this topic. What route gets added to the url when I select generate chat response vs generate text? (I assume it's the same as OpenAI API ref)
Is anyone facing the same difficulties?