Add Groq to Retool AI

Can we add Groq to the list of connectors in Retool AI? They are well known to have one of the fastest token throughput of all providers.

If anyone is curious about setting up Groq via RestAPI, this is how I did it.

1. Grab a Groq API Key

2. Create a new RestAPI Resource using the Groq cURL docs

Add your API Key as a Bearer Token.

I used this part of the URL so I could expand to different endpoints in the future:
https://api.groq.com/openai/v1/

3. Create a Saved query

This is the last part of the URL:
chat/completions

This is my default model (full list):
llama-3.2-3b-preview

This is the body:

  "messages": [
    {
      "role": "user",
      "content": {{ content }}
    }
  ],
  "model": {{ model }}
}

4. Add to an app

I saw a 4x speed increase :chart_with_upwards_trend: and 50x price decrease :chart_with_downwards_trend:.

2 Likes

Hi @jonnilundy,

I requested this internally. I'll follow up here if I get any updates :slightly_smiling_face:

Thanks so much for sharing your current solution!