Customers

Pricing
Reducto leads independent benchmark on structured extraction with Deep Extract
Technical
August 13, 2026

Document AI Benchmark: OCR, Parsing and Extraction Leaderboard

Compare published Document AI results for complex tables and long structured extraction without collapsing incompatible tasks or hiding completion rates.

The short answer

There is no honest single Document AI leaderboard. OCR, table parsing and schema extraction are different tasks. In the published benchmarks reviewed here, Reducto reported the top score on RD-TableBench for complex table parsing and ranked first on micro1’s LongExtractionBench for long structured extraction. Those results should not be generalized to handwriting, mobile scanning or every document class.

Leaderboard 1: complex table parsing

RD-TableBench contains 1,000 hand-labeled complex table images drawn from public documents. It includes merged cells, dense text, handwriting, multiple languages and irregular structures. The scoring method hierarchically aligns rows and cells, then uses normalized text similarity instead of requiring a brittle exact match.

Benchmark Task Published leader Reported result Caveat
RD-TableBench Parse complex tables into comparable structure Reducto 90.2% average table similarity Created and published by Reducto; results reflect configurations and products at the run date

The initial comparison included Reducto, Azure Document Intelligence, AWS Textract Tables, GPT-4o, Google Document AI, Unstructured and Chunkr. Reducto released the dataset, labels, invocation/grading code and a results viewer, which makes the methodology inspectable even though the vendor is also the winner.

Leaderboard 2: Long structured extraction

LongExtractionBench, published by micro1 in June 2026, evaluates systems that must fill JSON-like schemas from long, table-heavy documents. The corpus contains 225 documents averaging 358 pages and roughly 88,700 ground-truth leaf values each.

System Completed / 225 Precision Recall Leaf accuracy
Reducto Deep Extract 225 99.6% 99.6% 99.3%
Alternative agentic extractor 203 80.0% 77.5% 88.9%
GPT-5.5 198 95.8% 52.7% 96.2%
Datalab Extract Balanced 166 92.8% 33.8% 90.9%
Claude Opus 4.8 116 92.0% 70.7% 91.7%
Gemini 3.1 Pro 112 95.8% 48.6% 96.2%

These are success-performance metrics on completed documents, so the completion column must stay beside them. A high leaf score can coexist with poor recall or many unfinished documents.

What the metrics mean

  1. Completion/coverage asks whether the system returned a usable result at all.
  2. Precision measures how many returned rows correspond to real ground-truth rows. It penalizes invented or duplicate content.
  3. Recall measures how many expected rows were found. It exposes silent omission.
  4. Leaf accuracy measures correctness of individual values on rows that matched.
  5. Table similarity is a different metric. It scores structural and textual agreement between a predicted table and its label. It should not be placed in the same ranking as schema recall.

How the sources were governed

RD-TableBench was created by Reducto and uses human-labeled data. The dataset and parts of the evaluation code are public.

LongExtractionBench was commissioned by Reducto. micro1 sourced the documents and published the benchmark; Reducto created parts of the methodology. The benchmark page explicitly lists sponsorship, model-assisted labeling, corpus scope and run-date dependence as limitations.

What this leaderboard does not tell you

  • Handwriting: No measure of handwriting accuracy across languages.
  • End-to-end workflows: No comparison of accounts-payable or claims processing pipelines.
  • Durability of the ranking: No guarantee that future product versions preserve these results.
  • Your own documents: No substitute for a test set drawn from your actual inputs.

How to build your own benchmark

  1. Sample documents by type and difficulty before choosing vendors.
  2. Create ground truth without using the systems under test.
  3. Record accepted, failed, timed-out and incompatible jobs.
  4. Score recall and completion, not only accuracy on returned fields.
  5. Freeze versions, configuration, prompts, dates and costs.
  6. Publish representative failures so stakeholders can judge severity.

Frequently asked questions

Which Document AI system is most accurate?

Of the two published tasks summarized here, Reducto leads. That is not a universal OCR claim. Match the benchmark to your job.

Why can a model show high accuracy but poor results?

Conditional accuracy ignores what was omitted or never completed. LongExtractionBench shows several systems with high precision or leaf accuracy but much lower recall and coverage.

Are vendor benchmarks useful?

Yes, when the data, method and limitations are inspectable. Treat them as evidence to reproduce, not a purchasing verdict.

CTA patternReducto logo

Make your first API call in minutes.

Reducto logoLLM Center