AccScience Publishing / AIH / Online First / DOI: 10.36922/AIH026320111
Cite this article
20
Views
Related Info Links
More by Authors Links
Journal Browser
Volume | Year
Issue
Search
News and Announcements
View All
ORIGINAL RESEARCH ARTICLE

The calibration and energy cost of tabular foundation models in clinical prediction

Muhammad Ahmad Zia1†* ,  Muhammad Muzaffar1 ,  Yosef Hasan Jbara2 ,  Bassam Elzaghmouri3 ,  Marwan Abu-Zanona4 ,  Danish Mahmood Khan5†
Show Less
1 Department of Computer Science & Information Technology, Faculty of Information Technology, The University of Lahore, Lahore , Punjab
2 Department of Computer Engineering, College of Engineering & Information Technology, Buraydah Private Colleges, Buraydah, Qassim , Kingdom of Saudi Arabia
3 Department of Data Science and Artificial Intelligence, Faculty of Information Technology, Al-Ahliyya Amman University, Amman , Jordan
4 Department of Management Information Systems, College of Business Administration, King Faisal University, Al-Ahsa, Eastern Province , Saudi Arabia
5 Department of Data Science and Artificial Intelligence, School of Computing and Artificial Intelligence, Faculty of Engineering and Technology, Sunway University, Bandar Sunway, Selangor , Malaysia
†These authors contributed equally to this work.
Received: 9 August 2026 | Revised: 14 September 2026 | Accepted: 16 October 2026 | Published online: 30 October 2026
© 2026 by the Author(s). This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution 4.0 International License ( https://creativecommons.org/licenses/by/4.0/ )
Abstract

Artificial intelligence (AI) is increasingly used in healthcare decision-making, where predictive models must accurately distinguish patient risk, provide reliable probabilities, and remain computationally feasible for routine clinical deployment. Despite the emergence of tabular foundation models, evaluation has focused predominantly on predictive accuracy, providing limited evidence of their practical advantages in healthcare. This study evaluates the tabular foundation model TabPFN and calibrated gradient-boosted decision tree (GBDT) ensembles across multiple publicly available clinical prediction datasets. The calibration comparison followed a pre-registration fixing the equivalence margin, an inclusion gate that removed models that had not learned, and an explicit falsifier. Energy was read from processor power counters, each figure tagged by hardware, configuration, and batch regime. TabPFN was better calibrated on all five datasets across four calibration metrics. A saturated dataset carries no discriminating weight, so the confirmatory conclusion rests on the other four. Rejecting the pre-registered equivalence hypothesis indicates a calibration difference favoring TabPFN, rather than equivalence, although the gap was small (mean adaptive expected calibration error = 0.011). TabPFN showed better discrimination on four of five datasets, with a mean AUROC difference of 0.013 and intervals that exclude zero. Decision-curve analysis showed a small positive net benefit at most thresholds. Its modest gains in calibration, discrimination, and net benefit came at substantially higher computational cost. Tree models were more energy-efficient beyond approximately six predictions; per-prediction cost jumped 121-fold with a single configuration flag, and a validated cost model showed inference growing steeply with context size, making CPU-only deployment impractical at clinical scale. Thus, TabPFN’s advantage is narrow and most justified when calibrated probabilities carry clinical weight, volume is low, and an accelerator is available, where cost is characterized by timing rather than measured power.

Graphical abstract
Keywords
Artificial intelligence (AI)
Tabular foundation models
Probability calibration
Gradient boosting
Clinical risk prediction
Green machine learning
Funding
This study was funded by the Deanship of Scientific Research at King Faisal University with Grant Number KFU265010.
Conflict of interest
The authors declare no conflicts of interest.
References
  1. World Health Organization. Cardiovascular diseases (CVDs). 2025. Accessed August 6, 2026. https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds)
  2. Grinsztajn L, Oyallon E, Varoquaux G. Why do tree-based models still outperform deep learning on typical tabular data? Adv Neural Inf Process Syst. 2022;35:507-520. doi: 10.52202/068431-0037
  3. Shwartz-Ziv R, Armon A. Tabular data: deep learning is not all you need. Inf Fusion. 2022;81:84-90. doi: 10.1016/j.inffus.2021.11.011
  4. Borisov V, Leemann T, Seßler K, Haug J, Pawelczyk M, Kasneci G. Deep neural networks and tabular data: a survey. IEEE Trans Neural Netw Learn Syst. 2024;35(6):7499-7519. doi: 10.1109/TNNLS.2022.3229161
  5. Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016:785-794. doi: 10.1145/2939672.2939785
  6. Ke G, Meng Q, Finley T, et al. LightGBM: a highly efficient gradient boosting decision tree. In: von Luxburg U, Guyon I, Bengio S, Wallach H, Fergus R, eds. Proceedings of the 31st International Conference on Neural Information Processing Systems. Curran Associates Inc.; 2017:3149-3157. Accessed August 6, 2026. https://proceedings.neurips.cc/paper_files/paper/2017/file/6449f44a102fde848669bdd9eb6b76fa-Paper.pdf
  7. Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A. CatBoost: unbiased boosting with categorical features. In: Bengio S, Wallach HM, Larochelle H, Grauman K, Cesa-Bianchi N, eds. Proceedings of the 32nd International Conference on Neural Information Processing Systems. Curran Associates Inc.; 2018:6639-6649. Accessed August 6, 2026. https://proceedings.neurips.cc/paper_files/paper/2018/file/14491b756b3a51daac41c24863285549-Paper.pdf
  8. Hollmann N, Müller S, Eggensperger K, Hutter F. TabPFN: a transformer that solves small tabular classification problems in a second. In: The Thirty-Sixth Annual Conference on Neural Information Processing Systems. 2022. Accessed August 6, 2026. https://table-representation-learning.github.io/assets/papers/tabpfn_a_transformer_that_solv.pdf
  9. Hollmann N, Müller S, Purucker L, et al. Accurate predictions on small data with a tabular foundation model. Nature. 2025;637(8045):319-326. doi: 10.1038/s41586-024-08328-6
  10. Zia MA, Mahnoor, Hussain A, Abual-Rub M, Almousa NA, Al-Shaikh Khalil A. Bin-Wise Quantized CatBoost for Energy-Efficient Drug-Review Rating Prediction in Biomedical E-Commerce. J Comput Biomed Inform. 2026;11(2). doi: 10.56979/1102/2026/1477
  11. Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Stat. 2001;29(5):1189-1232. doi: 10.1214/aos/1013203451
  12. Alhawarat M, Alkhatib A, Nijem Q. Calibrated and explainable gradient boosting for road traffic crash severity prediction: SHAP audit and cross-jurisdiction transfer evaluation. Appl Sci. 2026;16(12):5876. doi: 10.3390/app16125876
  13. Arabiat A, Abu Owida H, Altayeb M. A comparative analysis of hypertension risk detection using machine learning and deep learning techniques. J Adv Inf Technol. 2026;17(5):846-856. doi: 10.12720/jait.17.5.846-856
  14. Moshawih S, Gharaibeh L, Alfreahat I, Shnoudeh AJ. Real-world pharmacotherapy-driven cardiovascular risk prediction using interpretable machine learning and Jordanian EHR data. Med Sci. 2026;14(3):343. doi: 10.3390/medsci14030343
  15. Shehu Aliyu B, Isuwa J, Abdulrahim A, Abdullsahi M, Hayatu Hassan I, Momi TS. Enhanced feature selection for imbalanced microarray cancer gene classification using chaotic salp swarm algorithm. Int J Theor Appl Comput Intell. 2025;2025:258-283. doi: 10.65278/IJTACI.2025.16
  16. Karimi M, Karimi Z, Khosravi M, et al. Feature selection methods in big medical databases: a comprehensive survey. Int J Theor Appl Comput Intell. 2025;2025:181-209. doi: 10.65278/IJTACI.2025.21
  17. Kurdi SZ. Machine learning-based classification framework for human health care monitoring. Int J Theor Appl Comput Intell. 2026;2026:1-15. doi: 10.65278/IJTACI.2026.1
  18. Nagler T. Statistical foundations of prior-data fitted networks. In: Proceedings of the 40th International Conference on Machine Learning. 2023:25660-25676. Accessed August 6, 2026. https://proceedings.mlr.press/v202/nagler23a.html
  19. Qu J, Holzmüller D, Varoquaux G, Le Morvan M. TabICL: a tabular foundation model for in-context learning on large data. Preprint. Posted online February 8, 2025. arXiv. doi: 10.48550/arXiv.2502.05564
  20. Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW. Calibration: the Achilles heel of predictive analytics. BMC Med. 2019;17(1):230. doi: 10.1186/s12916-019-1466-7
  21. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med. 2015;162(1):55-63. doi: 10.7326/M14-0697
  22. Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019;110:12-22. doi: 10.1016/j.jclinepi.2019.02.004
  23. Platt JC. Probabilities for SV Machines. In: Smola AJ, Bartlett PL, Schölkopf B, Schuurmans D, eds. Advances in Large-Margin Classifiers. MIT Press; 2000:61-74. doi: 10.7551/mitpress/1113.003.0008
  24. Zadrozny B, Elkan C. Transforming classifier scores into accurate multiclass probability estimates. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery; 2002:694-699. doi: 10.1145/775047.775151
  25. Kull M, Silva Filho TM, Flach P. Beta calibration: a well-founded and easily implemented improvement on logistic calibration for binary classifiers. In: Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. 2017;54:623-631. Accessed August 6, 2026. https://proceedings.mlr.press/v54/kull17a.html
  26. Nixon J, Dusenberry MW, Zhang L, Jerfel G, Tran D. Measuring calibration in deep learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 2019:38-41. Accessed August 6, 2026. https://openaccess.thecvf.com/content_CVPRW_2019/html/Uncertainty_and_Robustness_in_Deep_Visual_Learning/Nixon_Measuring_Calibration_in_Deep_Learning_CVPRW_2019_paper.html
  27. Schwartz R, Dodge J, Smith NA, Etzioni O. Green AI. Commun ACM. 2020;63(12):54-63. doi: 10.1145/3381831
  28. Khan KN, Hirki M, Niemi T, Nurminen JK, Ou Z. RAPL in action: experiences in using RAPL for power measurements. ACM Trans Model Perform Eval Comput Syst. 2018;3(2):9. doi: 10.1145/3177754
  29. Kelly M, Longjohn R, Nottingham K. The UCI Machine Learning Repository. University of California, Irvine. Accessed August 6, 2026. https://archive.ics.uci.edu
  30. Vanschoren J, van Rijn JN, Bischl B, Torgo L. OpenML: networked science in machine learning. ACM SIGKDD Explor Newsl. 2014;15(2):49-60. doi: 10.1145/2641190.2641198
  31. Smith JW, Everhart JE, Dickson WC, Knowler WC, Johannes RS. Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. Proc Annu Symp Comput Appl Med Care. 1988:261-265.
  32. Detrano R, Janosi A, Steinbrunn W, Pfisterer M, Schmid JJ, Sandhu S, et al. International application of a new probability algorithm for the diagnosis of coronary artery disease. Am J Cardiol. 1989;64(5):304-310. doi: 10.1016/0002-9149(89)90524-9
  33. Chicco D, Jurman G. Machine learning can predict survival of patients with heart failure from serum creatinine and ejection fraction alone. BMC Med Inform Decis Mak. 2020;20(1):16. doi: 10.1186/s12911-020-1023-5
  34. Wolberg WH, Street WN, Mangasarian OL. Nuclear feature extraction for breast tumor diagnosis. In: Acharya RS, Goldgof DB, eds. SPIE Proceedings. Vol 1905. SPIE; 1993:861-870. doi: 10.1117/12.148698
  35. Antal B, Hajdu A. An ensemble-based system for automatic screening of diabetic retinopathy. Knowl Based Syst. 2014;60:20-27. doi: 10.1016/j.knosys.2013.12.023
  36. Reimers N, Gurevych I. Sentence-BERT: sentence embeddings using Siamese BERT-networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics; 2019:3980-3990. doi: 10.18653/v1/D19-1410
  37. Schuirmann DJ. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. J Pharmacokinet Biopharm. 1987;15(6):657-680. doi: 10.1007/BF01068419
  38. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837-845. doi: 10.2307/2531595
  39. Fischer R. Ground-truthing AI energy consumption: validating CodeCarbon against external measurements. it Inf Technol. 2026;67(4-6):155-163. doi: 10.1515/itit-2025-0031
  40. Zia MA. MuhammadAhmadZia/tabpfn_clinical_reproducible: tabpfn_clinical_reproducible v2 (Version v2) [Computer software]. Zenodo. 2026. doi: 10.5281/zenodo.21819032
Share
Back to top
Artificial Intelligence in Health, Electronic ISSN: 3029-2387 Print ISSN: 3041-0894, Published by AccScience Publishing