Challenges

DocInsights 2026 Challenges

Two challenges advancing document intelligence beyond plain text

DocInsights 2026 hosts two complementary challenge tracks: DocSem for document-grounded quantitative reasoning with evidence attribution, and Dr.DocBench for expert-level document parsing across complex visual and structural content.

Competition Season

August 3–October 10, 2026

Teams may participate in either or both challenges. DocSem closes on September 10; Dr.DocBench closes on October 10 at 12:59 PM UTC. Each official challenge portal is the system of record for submissions and final rules.

USD 5,000+ Total prize pool
2 tracks Distinct challenge tasks
Workshop pathway System papers and presentations

System Paper Submissions

Shared-task paper submissions are open

Archival or non-archival system papers are welcome for DocSem or Dr.DocBench. Describe the system, data, models, prompts, tools, evaluation choices, and lessons learned from your challenge participation.

Selected contributions, including winning solutions, will be invited to present at DocInsights 2026.

September 15, 2026 at 11:59 PM UTC Submit on OpenReview

Challenge 1

DocSem

Document-grounded quantitative reasoning with evidence attribution

Dataset frozen Aug 5

Participants receive a PDF document and a paraphrased query. Systems must identify the relevant quantitative passage, derive the requested answer from the supplied document, and return the visible PDF block IDs that support the prediction.

Dataset and guide Submission portal Canonical source
Development data
908 labelled training tasks with PDFs, answers, and evidence block IDs.
Evaluation data
217 validation tasks with organizer-held labels and a provisional public validation leaderboard. Final rankings use a separate held-out test set.
Submission
Submit one complete validation JSONL now. Participants will be notified and asked for a separate test-set submission when final evaluation opens.

Challenge 2

Dr.DocBench

Expert-level parsing of complex, real-world documents

Submissions open

Dr.DocBench challenges systems to recover structured content from complex document pages, including text, tables, formulas, reading order, and specialized notation. Challenge predictions use a single-page unit and produce structurally faithful Markdown.

Enter on EvalAI Challenge website Dataset and guide Benchmark paper
Evaluation
Text Edit Distance, Table TEDS, Formula CDM, and Reading Order are normalized into an Overall score. Teams are ranked by Overall score.
Submission
Upload a validated submission ZIP containing predictions.jsonl or the canonical mds/ tree. Strict checks reject missing, extra, duplicate, or invalid predictions.
Participation
Open worldwide with no team-size limit. Teams may submit up to 3 times per day and select up to 2 submissions for final evaluation.

Competition Timeline

Track milestones

DocSem and Dr.DocBench have separate final submission deadlines. Use the official portal for each track's exact submission status.

August 3–September 10, 2026

DocSem Competition

Development data is frozen. A held-out test set will be released five days before the September 10 final submission deadline.

August 10–October 10, 2026

Dr.DocBench Competition

Submit through EvalAI. Final evaluation runs October 11–23, with winners announced at DocInsights 2026.

September 15, 2026

Shared-task Paper Submission Deadline

Submit an archival or non-archival system paper for DocSem or Dr.DocBench.

From Competition to Workshop

Share systems, findings, and lessons learned

Challenge participants can submit concise system papers for workshop consideration. Selected contributions, including winning solutions, will be invited to present their approaches and findings at DocInsights 2026.

Compete in either track

Teams may enter DocSem, Dr.DocBench, or both challenges, subject to each track's final participation rules.

Document the system

Participants should report models, data, tools, prompts, and evaluation choices needed to understand and reproduce their submission.

Present selected work

Winning teams and selected participant contributions will have a pathway to share their work with the workshop community.

Prize and rules notice

The combined prize pool exceeds USD 5,000, including up to USD 3,000 for Dr.DocBench. Consult each official challenge portal for track-level eligibility, team rules, ranking procedures, and award conditions.