Unsure if it's LLMs that fail at tabular data or its just that tree boosting are spectacular at that task.
{"deleted":true,"id":49168861,"parent":49168128,"time":1785850818,"type":"comment"}
Non-LLM transformers beat tree boosting - TabPFN, TabFM
https://research.google/blog/introducing-tabfm-a-zero-shot-f...
[dead]