Optimizing Parsing for Large Excel Files

App Building
1

Hello,

I am currently working with extensive Excel files where I need to differentiate between Worksheets and access the columns within these worksheets. Given the size of these files, the full-size parsing that occurs as expected can become quite time-consuming and resource-intensive.

Considering this, I find myself in the need for a more efficient parsing mechanism. Is there a way in Retool to optimize this process, possibly by limiting the parsing to just the first 10 rows? This capability would greatly improve efficiency while still providing a meaningful insight into the data structure of each worksheet.

I greatly appreciate any guidance or suggestions on this matter!

Thank you!

Patrick

1 Like
2

Hi @PatrickMast, apologies for the delay here!

We don't have a config setting for this on the file uploaders, but you should be able to handle the parsing in a JS query with more custom settings.

For example, we use Papa.parse in Retool already, and there is a preview property that can limit the number of rows parsed for CSVs, etc:

We also have utility for excel files, which uses Sheets JS + accepts a Sheet range:

1 Like