Retool Chat with audio response

💬 App Building
1

  • Goal: Trying to build a Chat bot with audio input and audio output or text input with audio output -->

  • Steps: Added a chat component, set up the system message-->

  • Details: Hanvent found a way to integrate audio-->

  • Screenshots:

  • App json export: (here's how to get a json export)

2

If it helps with your search this is certainly feasible.

I've previously had luck using native microphone component and turning it into fileURL which can be passed to Groq or different type of models that do voice recognition.

On transcription pass along message to the LLM for response.