- My goal: My goal is to use a Snowflake query to identify a list of files to download locally from an S3 bucket. I have created a Workflow that will currently successfully do this - however the workflow can sometimes take more than 120 seconds to complete.
- Issue: My initial plan had been to kick off the workflow from an application (since I need to download the zip file being created/returned), however as it sometimes runs longer than 120 seconds Iām not sure what / if any options there are to kick off the workflow, and somehow download the zip being created locally without doing it from an application.
- Additional info: Cloud hosted
Hi there @Aaron_Joseph, welcome to the Community forum
!
On Cloud, for synchronous workflows (e.g. those with webhook or app triggers), the timeout is 15 minutes until it reaches the first Response block. So it may be expected behavior to see a workflow take more than 120 secs to finish.
More info here!
A couple questions so I can understand your setup better:
- Is the individual block within the workflow timing out? Or is the entire workflow timing out?
- Is it possible to split up the workflow into smaller blocks and/or write queries that return a smaller amount of data?
Thanks!
-Jen