Workflow that zips files from S3 bucket sometimes takes longer than 120 seconds to complete so App times out

  1. My goal: My goal is to use a Snowflake query to identify a list of files to download locally from an S3 bucket. I have created a Workflow that will currently successfully do this - however the workflow can sometimes take more than 120 seconds to complete.
  2. Issue: My initial plan had been to kick off the workflow from an application (since I need to download the zip file being created/returned), however as it sometimes runs longer than 120 seconds I’m not sure what / if any options there are to kick off the workflow, and somehow download the zip being created locally without doing it from an application.
  3. Additional info: Cloud hosted

Hi there @Aaron_Joseph, welcome to the Community forum :slight_smile: !

On Cloud, for synchronous workflows (e.g. those with webhook or app triggers), the timeout is 15 minutes until it reaches the first Response block. So it may be expected behavior to see a workflow take more than 120 secs to finish.
More info here!

A couple questions so I can understand your setup better:

  1. Is the individual block within the workflow timing out? Or is the entire workflow timing out?
  2. Is it possible to split up the workflow into smaller blocks and/or write queries that return a smaller amount of data?

Thanks!
-Jen