Retool AI to generate multiple image tags

💬 App Building
, , ,
1
  1. My goal:
    I want to be able to get more than just 1 classification (tag) per image. Would this be possible using Retool AI?
  2. Issue:
    Right now, Retool AI will always spit out only one item.
  3. Steps I've taken to troubleshoot:
    I've looked into seeing if there's another resource I could use. Would agents be a good resource? I think they are only triggered via Email and / or Chat, which I don't think would work for my use case.

I tried to use openai's vision api directly. However, I believe that that product is a paid feature.
4) Additional info: (Cloud or Self-hosted, Screenshots)

image
image451×422 16 KB

3

Hi @brpark, you're right that Retool AI will only return what it considers its best match out of the labels you provide it. Your most fully functional option is likely to use openai's vision api, google cloud vision, or aws rekognition.

Otherwise, if you don't have many labels to classify images with, I could imagine looping over the labels and just checking yes or no if the image contains that label, and aggregating the labels that it checked yes for.

1 Like