Mistral adds a new API that turns any PDF document into an AI-ready Markdown file | TechCrunch

LLMs rely heavily on Markdown for their training datasets. Similarly, when you use an AI assistant, such as Mistral’s Le Chat or OpenAI’s ChatGPT, they often generate Markdown to create bullet lists, add links, or put some elements in bold. Assistant apps seamlessly format the Markdown output into a rich text output. That’s why raw text — and Markdown — have become more important in recent years as GenAI has boomed.

“Over the years, organizations have accumulated numerous documents, often in PDF or slide formats, which are inaccessible to LLMs, particularly RAG systems. With Mistral OCR, our customers can now convert rich and complex documents into readable content in all languages,” said Mistral co-founder and chief science officer Guillaume Lample.

“This is a crucial step toward the widespread adoption of AI assistants in companies that need to simplify access to their vast internal documentation,” he added.

Mistral OCR is available on Mistral’s own API platform or through its cloud partners (AWS, Azure, Google Cloud Vertex, etc.). And for companies working with classified or sensitive data, Mistral offers on-premise deployment.

According to the Paris-based AI company, Mistral OCR performs better than APIs from Google, Microsoft, and OpenAI. The company has tested its OCR model with complex documents that include mathematical expressions (LaTeX formatting), advanced layouts, or tables. It is also supposed to perform better with non-English documents.

Given that Mistral OCR does one thing and one thing only, the company believes it is also faster than what’s out there. That’s not a surprise if you compare it with a multimodal LLM like GPT-4o, which also has OCR capabilities (among many other features).

Mistral is also using Mistral OCR for its own AI assistant Le Chat. When a user uploads a PDF file, the company uses Mistral OCR in the background to understand what’s in the document before processing the text.

Companies and developers will most likely use Mistral OCR with a RAG (aka Retrieval-Augmented Generation) system to use multimodal documents as input in an LLM. And there are many potential use cases. For instance, we could envisage law firms using it to help them swiftly plough through huge volumes of documents.

RAG is a technique that’s used to retrieve data and use it as context with a generative AI model.