How do I read all files from S3, not just one?

[alex-w]

Hey @nutmeg!

How many CSV files is this? Since Retool is a frontend application, all that data would need to be loaded into your browser and iterated over with javascript to parse the CSVs. If this is a significant amount of files, I'm a little concerned this approach might overload your browser and crash the app.

If it is not a massive amount of data, you could take an approach like this JS example:

How to run a REST API/Query for each item in an array and return all results together

Similar to https://docs.retool.com/docs/scripting-retool#section-triggering-a-query-for-each-item-in-an-array, this setup using Async JS promises will make the .data property of this query include ALL of the results of the triggered queries. Using a Run JS Code type query, we will trigger another query for each item in an array, and after the last is completed return all of the results together in the jsCodeQueryName.data value. Where get_assignment is a REST Api query, taking an input of {{as…

You would swap out the REST query for individual "Read a file" queries from the "List all files" return.

Keep in mind that if you are ever loading "All" of something and the data set keeps growing, eventually it will be too much to load in a browser and your performance will keep degrading over time.