Unleash the power of images with AI sheets

🧭TL;DR: Hugging Face AI Sheets is an open-source tool for supercharging datasets with AI models, with no code required. Vision support was added. Extract data from images (receipts, documents), generate visuals from text, and edit images, all in spreadsheets. Leverage thousands of open models through inference providers.

We are excited to release a major update to Hugging Face AI Sheets, an open source tool for building, transforming, and enriching data using open AI models. AI Sheet is powered by inference providers, so you can use thousands of open models powered by the best inference providers on the planet.

The first version of AI Sheets made it easy to structure and enrich your text content. We are currently adding vision to the AI ​​sheet.

Images are everywhere: product photos, receipts, screenshots, diagrams, graphs, logos. These documents contain structured information waiting to be extracted, analyzed, and transformed. Today, you can finally interact with visual content directly in your AI sheets. View images, analyze them, extract information, generate new images, and even edit them in real time, all within the same workflow.

Your images have a story to tell

Images contain valuable information such as product catalogs, support tickets, research archives, receipts, documents, and more. You can now upload images directly, use datasets containing images, and use vision models to extract, analyze, and structure information within images.

What you can do:

Image description and classification – Generate captions for product photos, classify document types, or tag images by content Structured data extraction – Extract items from receipts, data from charts, or text from scanned documents Add context and metadata – Automatically label images with relevant attributes, quality scores, or custom annotations

Just like with text columns, you can iterate through the prompts, manually edit the output, and give the thumbs up to tell the model what you want. Your feedback will give us some examples to create better results.

Examples: From receipts to structured expenses

Imagine you come back from a trip with a stack of receipts. Upload these to your AI sheet and create a column with prompts like this: Extract the seller name, date, total amount, and expense category from this receipt.

The AI ​​sheet processes each receipt and provides a clean table with all details extracted. You can edit mistakes, evaluate and verify good results, and regenerate the rest to improve. Export the final dataset as CSV or Parquet for expense tracking tools.

Or maybe you’re digitizing handwritten recipes from old family notebooks. Create columns to extract ingredients, cooking times, and dish types to turn your personal archives into searchable, structured data sets.

Generate and transform text and images in the same flow

Need visuals for your content? AI Sheets uses AI models to generate and edit images directly within your spreadsheet, keeping your entire content creation workflow in one place.
What you can do:

Generate images from text – Create social media graphics, thumbnails, or illustrations that match your content Edit and transform existing images – Modify uploaded images or generated visuals – Change styles, add elements, adjust composition Create large variations – Generate multiple versions or styles to test what resonates with your audience Build a visual content library – Create consistent brand assets across large content campaigns

Example: Creating a content calendar using visuals
Imagine you plan to post about healthy recipes on social media for a month. I have a spreadsheet with post titles and descriptions, but no images yet.

Create an image column with a prompt like this: Generate an appetizing food photo for {{title}}. Style: Bright, overhead shots, natural light.

AI Sheet generates a unique image for each post. Is it incorrect? Create another column and edit it. Convert the image to have a rustic wooden background and add fresh herbs as garnish.

You can iterate on generating and editing prompts to try different approaches. Your entire content calendar (copy and visuals) is saved in one spreadsheet and can be scheduled or exported instantly.

step-by-step guide

Now let’s take a look at the AI ​​sheet in action. We use an open model to unlock the knowledge within handwritten recipes, like the ones you might find from your grandma.

Upload data

There is a folder with photos that you can easily upload to the app.

The result will be a spreadsheet like this:

Understand how AI works

Each column in your spreadsheet can be transformed, extracted, queried, and anything else you can imagine using AI actions.

To see this in action, click the overlay at the top of the column.

Image columns come with image operations such as text extraction, image interrogation, object detection, colorization, adding text, and possible custom actions.

Text columns include summaries, keyword extraction, translations, and custom actions.

Prompts and models define every AI action. Let’s see what you can do with a handwritten recipe dataset.

Extract text from images.

AI sheets come with templates for extracting text from images.

The result of this action is an AI-generated column containing the transcribed text. Let’s take an example:

For the image above, the extracted text would look like this:

Notes: From 1 box Duncan Hines Yellow Cake Mix 1 box instant lemon pudding 2/3 cup water 1/2 cup mozola oil 4 eggs Lemon flavor, optional. Place in a mixing bowl and mix for 10 minutes. Remember…For quality printing, call or write Gatling & Pierce PRINTERS at 332-2579. We have 22 years of service in Northeastern Carolina.

Not bad! But I’m interested in the recipe text because I see that it includes print text for the header and footer. This text is included because we are using the default template for text extraction, which looks like this:

Extract and transcribe all visible text from images, including signs, labels, documents, or written content.

Try out custom prompts.

The extracted recipe details are as follows:

– 1 box of Duncan Hines Yellow Cake Mix
– 1 box of instant lemon pudding
– 2/3 cup water
– 1/2 cup mazola oil
– 4 eggs
– Lemon flavor according to taste
– Place in a mixing bowl and mix for 10 minutes

This is amazing! But what about more complex images? By default, AI Sheets uses models that balance speed and accuracy, but you can experiment with thousands of models. The example above uses the default vision language model Qwen/Qwen2.5-VL-7B-Instruct.

Let’s test the SoTA inference model, Qwen/Qwen3-VL-235B-A22B-Reasoning, with a more challenging image.

Here is a comparison between the models:

Both models produce very similar output, but include two subtle but important details (in bold): temperature and the main ingredient, spinach.

Clean, transform, and enhance your text

Once you are satisfied with the extracted text, you can further transform and enhance it. You need to perform an AI action using the new column, as follows:

You now have beautifully structured HTML pages for each recipe.

Edit and convert images.

Finally, AI Sheets integrates image-to-image models like Qwen-Image-Edit. This means you can perform AI actions to transform and enhance your images.

For example, let’s say you want to offer recipes and old style. You need to go to the column and use the black and white template like this:

result:

Export the dataset

Once you’re happy with your new dataset, export it to your hub. If you don’t want to share it with the community, you can export it to your organization, personal profile, or make it private.

Check out the dataset you just created.

What’s next?

You can try out AI Sheets without installing them or downloading and deploying them locally from a GitHub repository. To run locally and get the most out of it, we recommend subscribing to PRO and getting 20x your monthly inference usage.

If you have any questions or suggestions, let us know in the Community tab or by opening an issue on GitHub.