Workflow loop causing internal server error

[Eric_Ehlert]

Hello,

I am running into an issue using a retool loop within a workflow; it seems when my input gets past a certain size (hard to pin down) I am hitting an Internal Error?

Is there any way I can get a more verbose error message? The loops functions fine when I slice up the input into smaller pieces.

Thanks

[Eric_Ehlert]

Edit:

• I have attempted with all 50-items slices from 0-412 (the entire length of value.assets)
• Each of these executed successfully
• Executing all 412 at once does not work
• Switching the mode to Batched with Batch size of 50 failed to resolve the issue

[Jack_T]

Hi @Eric_Ehlert,

Apologies for the issue, I agree the error message should be much more verbose so we can better troubleshoot and fix this.

I am currently waiting to hear back from the workflow engineering team with more details!

[Jack_T]

Hey @Eric_Ehlert,

We were able to dig into your logs via Datadog and it looks like this error is coming from the container running the workflows which is running out of memory

I believe the way to get around this is to try smaller batch sizes, it may take slightly longer but should hopefully keep the memory from capping out!

Let me know if smaller batches work

[Eric_Ehlert]

Thanks!