OpenAI Whisper expecting UploadFile received <class 'str'>

Queries and Resources
,
1

Hello,

The form suggested by the OpenAI integration for Whisper is casting file as a string while OpenAI API is expected an UploadFile object.

Is there a recommended way to use this integration with existing audio files or ones recorded via the microphone component?

Best regards,

1 Like
2

Hi @antoine.meilliez

Thanks for reaching out!

Hmm, I see what you mean :thinking: We've seen similar issues with other APIs, which we've solved through Justin's workaround here. I don't quite have it working for OpenAI yet, but I'll do some more testing & follow up

3

Hi there! I wanted to check in to let you know I've attached a bug internally for this :disappointed:

4

For simply transcribing audio, I did find the Whisper API (https://transcribe.whisperapi.com), which appears to accept uploaded files or file urls. If using this is an option to you, I might try uploading the base64 to something like s3 -> getting a signed url -> and then sending that url to this API

5

I am facing some similar issue:

Screen Shot 2023-07-07 at 1.39.48 AM
Screen Shot 2023-07-07 at 1.39.48 AM882×1087 48.2 KB

but with the OpenAI Files API

Using the Workflow, I load some data from Retool PG database, and create a string. But it is failing right now because it is expecting a file as the value of the file input.

[Fri July 7th 2023 01:33:03.535 am] --- Running query: startTrigger ---
[Fri July 7th 2023 01:33:03.535 am] Evaluating JS query: startTrigger
[Fri July 7th 2023 01:33:03.572 am] --- Successfully finished running query: startTrigger ---
[Fri July 7th 2023 01:33:03.572 am] --- Running query: trainingData ---
[Fri July 7th 2023 01:33:03.989 am] --- Successfully finished running query: trainingData ---
[Fri July 7th 2023 01:33:03.989 am] --- Running query: processData ---
[Fri July 7th 2023 01:33:03.989 am] Evaluating JS query: processData
[Fri July 7th 2023 01:33:03.995 am] --- Successfully finished running query: processData ---
[Fri July 7th 2023 01:33:03.995 am] --- Running query: uploadFile ---
[Fri July 7th 2023 01:33:04.352 am] Error evaluating uploadFile: {"error":{"message":"The browser (or proxy) sent a request that this server could not understand.","type":"server_error","param":null,"code":null}}
[Fri July 7th 2023 01:33:04.352 am] --- Failed running query: uploadFile ---
[Fri July 7th 2023 01:33:04.352 am] --- Hit failure ---
6

Hi @Tess
Is there an ETA on the bug fix?

7

Hi @bce9722, unfortunately I don't have an eta for this one :disappointed: Would you be able to use a Rest API resource type instead of the Open AI integration?