When setting the timeout in advanced for a AI Query it will continue to run indefinitely even passing the 120sec mark.
I'm using the action "Extract entity from text" with a 3000ms timeout. Using the cloud version of retool.
Hello @lpearl!
Very odd bug, not sure why the timeout counter you added in isn't exiting the query.
What model are you using? How many characters are you processing? How many entities are you entering?
It was using gpt-4o with around 10k characters and 6 entities. With that said I tried the timeout again and it seams to be working. Not sure what was wrong originally.
I'll mark this as solved for now and let you know if it comes up again.
1 Like
Ah ok thank you for the follow up details!
Very odd as that seems like a model and data set that should be working fine.
Might have been fixed with a patch from our engineering team, we are iterating on improving our AI capabilities very quickly.
Glad it works! Let me know if this issue comes up again!