Today, i wanted to checkout AI Assist for a new application.
What started well, ended in a non completed conversation and halfway implemented application.
Reason: The limit for Assist's context window has been reached. Try again with a shorter prompt, or create a new thread.
If i start the new thread, the context is gone. How can i proceed with the previous thread?
Any suggestion is appreciated, do not want to loose the current progress. thanks!
Hey there! @whynot Thanks so much for reaching out about this! I checked with our product and engineering teams to get you some answers.
Here's what's happening: The error occurs when your prompt exceeds the model's input size limit, this commonly happens with large GraphQL queries or when there's a lot of context being passed in.
If I remembered correctly, you're on Cloud, right? If so, thread summarization should already be running automatically in the background to help manage this for you.
In the meantime, try breaking your queries into smaller chunks or reducing the amount of context you're passing to AI Assist, that should help you get past the limit.
I'd love to understand your use case better. Could you share a bit more about what you're working on when you hit this limit? That would be really helpful! Thank you!