Our company is using Retool as a GUI to interact with our data stored in DynamoDB. We have a large dataset in DynamoDB, currently holding around 450,000 items, and this data is continuously being updated.
Problem Description:
- When we connect DynamoDB to Retool, it displays only 1689 items, but the issue is that these items appear to be selected at random. We need to display the most recent items instead.
- We've tried using automatic pagination, but when it's enabled, the query times out, and no data is displayed. With pagination turned off, the same 1689 items are shown, but again, they are random and not the most recent data.
- So far, we've been using the Scan method, but it's not serving our needs, as it fetches random data and doesn't focus on the most recent items.
- We believe the Query method would be more appropriate to retrieve the most recent data, but we're facing issues where even simple queries don't work and no data is displayed.
Our Goal: We need to display the most recent data from DynamoDB in Retool—ideally 5000 to 10,000 rows of the most recent items**. We're looking for guidance on how to properly configure the Query method (or any alternative solution) to achieve this.
Could you please provide assistance on how we can efficiently display and paginate the most recent DynamoDB entries within Retool?
Thank you for your support, and we look forward to your guidance.