Can we add Groq to the list of connectors in Retool AI? They are well known to have one of the fastest token throughput of all providers.
If anyone is curious about setting up Groq via RestAPI, this is how I did it.
1. Grab a Groq API Key
2. Create a new RestAPI Resource using the Groq cURL docs
Add your API Key as a Bearer Token.
I used this part of the URL so I could expand to different endpoints in the future:
https://api.groq.com/openai/v1/
3. Create a Saved query
This is the last part of the URL:
chat/completions
This is my default model (full list):
llama-3.2-3b-preview
This is the body:
"messages": [
{
"role": "user",
"content": {{ content }}
}
],
"model": {{ model }}
}
4. Add to an app
I saw a 4x speed increase and 50x price decrease
.
2 Likes
Hi @jonnilundy,
I requested this internally. I'll follow up here if I get any updates
Thanks so much for sharing your current solution!