Download CSV of all pages of paginated table?

💬 App Building
, ,
1

We have a paginated table and when we click the download button it only downloads one page. Is there a fix to download the whole table?

2

is your table server-side paginated? (i.e. does your sql query return 10 rows at a time, or does it return all 1000 at the same time)

3

@abdul-nimeri server side!

4

ah got it! yeah so the table doesn’t quite support downloading server-side things like that (and maybe we don’t want to support that –– what if your table was actually millions of rows!)

5

another thing you can instead do is write a JS query to download the whole table as CSV. it would look something like this:

6

^there’s actually a small bug with this where it jsonifies the file instead of keeping it as CSV, but we’re fixing it! would this approach work for you @alex-godin ?

7

is this bug fixed

8

and what is the fetchWholeTable function?

9

yes the bug is fixed!

10

ah, fetchWholeTable was the name of my sql query that fetched the whole table (i.e. without any LIMIT statement)

11

try it out and lmk if it works for you

12

@abdul-nimeri can you share your fetchWholeTable again? It seems to be deleted from your reply

13

Hey @annaxwang -- the fetchWholeTable that Abdul referenced is just a SQL query that fetches an entire table without a limit statement (which you might have had in an original query if you were server side paginating). So if you wanted to download your users table, you might set up a query to get the whole table like:

SELECT * FROM users;

Then you'd build a Javascript query to download those results to CSV (this is kind of complicated if you need to deal with escaping characters like a comma or quote). If you call the above query getUsers you can trigger it and work with the resulting data in a Javascript query with syntax like this:

getUsers.trigger({
  onSuccess: function(data) {
    //Do something with data here
  }
})

Screen Shot 2020-03-26 at 8.56.47 AM
Screen Shot 2020-03-26 at 8.56.47 AM3174×598 68 KB

For some direction on how to download JSON as a CSV, there's some content in this Medium post.

1 Like
15

Can we add a custom action to the download data as csv button?

16

Hey @Osman! What kind of action are you looking to add? You can run queries from a custom button on the table!

1635×559 55.6 KB

17

Well I wanted to use download button to run my query but I think custom button is the only way. Okay that's fine too. Thanks

18

@Osman did you figure out the end-to-end solution here?

I'm looking to do the same thing - download the entire table as a CSV from a server-side paginated API.

19

Hey @joshdnsfilter! Would something like this work for you?

http://community.retool.com/t/keep-running-rest-api-requests-until-all-results-are-returned-load-all-rows-from-an-airtable-api/2759

http://community.retool.com/t/how-to-run-a-rest-api-query-for-each-item-in-an-array-and-return-all-results-together/2352/4

What do you currently have set up? :slight_smile: