Easiest way to capture SKU and price data within retool from a photo?

💬 App Building
, ,
5

Hey @Amy_BLuk Amy, welcome to the Community! :raising_hands:

Thanks for your input, great suggestions from @Jon_Steele! Spot on that a vision-capable LLM and the Scanner component are the right tools for this. Just wanted to add that you actually don't need to wire up a custom REST API call for the vision piece, Retool has this built in natively.

1. Extracting printed text from a label (SKU, price, size, etc.)

Retool has a built-in AI query type with a native "Extract entity from image" action, no custom REST API needed. It supports OpenAI, Anthropic, Google Gemini, and Amazon Bedrock as providers. You can pass an image, prompt the model to return structured JSON, and write it straight to your database.

Docs: AI queries guide and AI integrations

2. Reading a barcode from the label

Retool has a native Scanner component for barcode/QR scanning on mobile, as Jon mentioned. There's also a newer Scanner V2 with improved reliability.

Hope this helps! :folded_hands:

1 Like