Skip to content

Research artifacts ​

Artifacts released with the paper LTEM: LLM-Friendly Table-Enhanced Markdown for Table Understanding and Generation (EMNLP 2026).

ArtifactWhere
Taxonomy of table structural complexitytaxonomy.md
STB, the Synthetic Table BenchmarkHugging Face: eunbinkim777/ltem-stb

Taxonomy of table structural complexity ​

Six structural features (F1–F6), the basic operations for expressing table structure, and six complexity levels (L1–L6), the features a table needs, counted cumulatively. The taxonomy is the yardstick the paper uses to compare table formats and to build STB. See taxonomy.md.

STB: Synthetic Table Benchmark ​

STB is a set of 1,089 synthetic tables with 4,356 question–answer pairs, about four per table. Existing table benchmarks were collected for particular tasks without control over table structure; most tables in WikiTableQuestions, for example, are simple header–data tables. STB spreads its tables across the complexity levels on purpose, so that a result can be read level by level.

Levels and domains ​

LevelTablesShareAverage rowsAverage columns
L1 Atomic grid968.82%4.333.15
L2 Headered table33430.67%5.633.34
L3 Spanning table34231.40%7.155.22
L4 Multi-level header16415.06%8.846.65
L5 Block-partitioned877.99%12.664.20
L6 Composite table666.06%15.5511.50
Total1,089100%

About 30% of the tables are L3, the first level that needs merged cells and so the first that Markdown and CSV cannot express. For multi-table (L6) cases, the averages count all sub-tables.

A table's level is the highest feature it needs (taxonomy). In STB, the L1–L4 tables build on each other as the levels do. The L5 and L6 tables add sections (L5) or the composition of several tables (L6) to simpler tables, so not every L5 or L6 table also has nested headers.

DomainTablesShare
Scientific36633.61%
Financial28626.26%
Survey17916.44%
Product17115.70%
Schedule877.99%

Levels and domains were sampled independently, so that no domain leans towards particular levels.

How STB was built ​

  1. Structure: a rule-based generator chose each table's level, size and merging pattern.
  2. Content: Claude Sonnet 4.5 and Claude Opus 4.5 filled in headers and cell values suited to the domain, keeping the structure.
  3. Questions: GPT-5-mini wrote question–answer pairs of four kinds: lookup, counting, comparison and aggregation.

Generated answers may contain errors, so a question was kept only when two models from different families, Qwen3-VL-8B-Instruct and Phi-4-mini-instruct, both gave the generated answer under the same normalization. This agreement filters out most wrong answers, but an error that both models share can remain. The paper's appendices give the prompt templates and further details.

Corrections ​

The released STB corrects the answers to six questions; with them, nEM rises by 0.02 to 0.04 percentage points for each format, and no ranking or significance result changes.

Citation ​

Eunbin Kim, Hyeonseok Kang, Sangkeun Jung. LTEM: LLM-Friendly Table-Enhanced Markdown for Table Understanding and Generation. EMNLP 2026.

License ​

The texts in this folder are licensed under CC BY 4.0; their examples and any code here are also under the MIT License (../LICENSE). STB is published under CC BY 4.0 on Hugging Face.