Automating the Download of All Images from Retool Storage to Amazon S3

Workflows
,
1

Hello Retool Community,

I am currently working on a project where I need to download all images stored in Retool and transfer them to Amazon S3. I am looking for guidance or best practices to automate this process efficiently. Here's a brief overview of what I aim to achieve:

  1. Identify All Images in Retool Storage : Extract a list of all image URLs or identifiers stored in Retool.
  2. Download Images: Programmatically download each image from the Retool storage.
  3. Upload to Amazon S3: Transfer the downloaded images to an S3 bucket.
1 Like
2

Hi @Said,

Thanks for reaching out :slight_smile:

Do you already have your s3 resource set up?

A "Get a list of file metadata" Retool Storage query will give you a list of all files:

image
image1016×302 9.16 KB

Then, you can use a loop block to get the contents of each file. You can have another loop that sends the contents to s3

Do you need the files downloaded locally, or could you pass the data directly to s3?