Tabular LLMs: An Introduction to the Foundation Models That Predict Your Spreadsheet

Short summary

Tabular foundation models can predict missing spreadsheet columns zero-shot, analogous to how LLMs complete text. On the TabArena benchmark, these models now outperform fully tuned gradient-boosted trees like XGBoost. The article includes an independent reproduction of the strongest open model and maps scenarios where XGBoost still holds an edge.

• •Tabular foundation models predict missing columns zero-shot like LLMs complete text
• •TabArena benchmark shows them beating fully tuned XGBoost
• •Article includes independent reproduction and analysis of where gradient boosting still wins

Generated with AI, which can make mistakes.