Loading Retool's data into Snowflake

Hey,

I am currently exploring how we might load data from Retool (user activity and Retool databases) into Snowflake. I’d really appreciate any insights from anyone who has worked on a similar project.

Thank you for your help!

Hey @Hippolyte_Le_Comte welcome to Community! :waving_hand:

Just to confirm, you're on the Business plan on Retool Cloud, correct? That'll help narrow down the exact options available to you. Here's what's available based on Business plan:

User activity (audit logs):
You can download audit logs as a CSV directly from your Audit Logs page. The file is a compressed CSV covering up to one year of data. From there, you can load it into Snowflake using a stage and COPY INTO. Note: real-time streaming to Snowflake isn't available on the Business plan, that requires Enterprise (via Datadog or Splunk as an intermediary).

Retool Database:
The cleanest native option here: Retool Workflows

  1. Add Retool Database as a PostgreSQL resource in Retool
  2. Add Snowflake as a Snowflake resource in Retool
  3. Build a Workflow with a scheduled trigger that queries Retool Database and upserts rows into Snowflake

Some docs to help:

Let me know if you have questions on either approach!

Hey @Hippolyte_Le_Comte did you get a chance to take a look at my suggestion above? Was it helpful at all? Let me know! :folded_hands: