AI Agent Chat Stuck Loading - Getting 304 Not Modified Errors

We're experiencing an issue with Retool AI Agents where the chat interface gets stuck in a loading state.

Setup:

  • Retool version 3.223.0
  • Deployed an AI agent chatbot for testing agentic workflows
  • Connected to Claude (Sonnet) via API
  • Claude AI API integration is confirmed working across the instance

Problem:
When attempting to chat with the agent, the interface shows a skeleton loading animation indefinitely. The Network tab reveals multiple "304 Not Modified" status responses after making the request.

image

Has anyone encountered this issue or have suggestions for troubleshooting? We're unable to interact with our deployed agents despite the Claude API connection appearing functional in our apps and workflows.

is that a self-hosted version number?

Anywho, would you mind checking to make sure you haven't hit any of the limits on your Claude API account? Possibly try switching to a GPT model or something and see if it goes through. Does this happen all the time, or just after sending the first message like in the screenshot you shared.

Hey @micriver, sorry you’re hitting this. That stuck loading state (with repeated 304s) can sometimes happen if something’s off in the self-hosted setup.

Might be worth double-checking against the setup guide here: Set up Retool Agents on Self-hosted deployments | Retool Docs

Thanks for the tips!

Yeah I've tried switching to a working gpt 4 model but that results in the same loading animation.

Also, this happens in every new chat I create. The only thing that I can send is the first message that you're able to see. Then underneath it, is just a skeleton loading animation.

Thanks for the quick reply, @nicos. I did notice that using AWS Fargate and ECS is still a limitation, and that's probably because it's agents are still in beta. I was hoping that after the open preview, this would change. Do you think this could be the issue here?

@micriver are you deploying via Fargate and ECS right now? Did you use these templates: retool-onpremise/cloudformation/retool-agents.fargate.yaml at agents-preview · tryretool/retool-onpremise · GitHub

I'll double check with our sysops team and get back to you!

@kent thank you for the link!

One thing that I notice is the link that you sent points to CloudFormation and we're using Terraform! I should have mentioned that earlier.

Another thing I noticed is that there's a discrepancy with the versions that I'm using and what is referenced in the docs (they must have been updated, and I must have missed it. I don't know if you can tell me if there's a way for me to "watch" specific docs to see when they're updated?).

The version that we're using is Retool 3.223.0-edge, and the docs say for self-hosted we need to use 3.268 edge. I'm not sure why the toggle switch for AI Agents is available in this case though?

What I think I'll do is update first since it sounds like I need to just update, and then I'll report back here.

1 Like

Have you had a chance to try updating, @micriver?