Model Calibration

AAAI 2025arXiv:2402.13904

#2

Calibrating Large Language Models with Sample Consistency

Qing Lyu, Kumar Shridhar, Chaitanya Malaviya et al.

confidence calibrationlarge language modelsconsistency measurespost-hoc calibration+4

52

ICML 2024arXiv:2404.00474

#3

Linguistic Calibration of Long-Form Generations

Neil Band, Xuechen Li, Tengyu Ma et al.

linguistic calibrationlong-form generationconfidence statementsdecision-making+3

48

ICLR 2025arXiv:2410.09724

#4

Smooth ECE: Principled Reliability Diagrams via Kernel Smoothing

Jaroslaw Blasiok, Preetum Nakkiran

Taming Overconfidence in LLMs: Reward Calibration in RLHF

Jixuan Leng, Chengsong Huang, Banghua Zhu et al.

45

ICML 2024arXiv:2404.04689

#6

Multicalibration for Confidence Scoring in LLMs

Gianluca Detommaso, Martin A Bertran, Riccardo Fogliato et al.

confidence scoringmulticalibrationlarge language modelscalibration methods+4

37

ICLR 2024arXiv:2310.19208

#7

LitCab: Lightweight Language Model Calibration over Short- and Long-form Responses

Xin Liu, Muhammad Khalifa, Lu Wang

36

NEURIPS 2025arXiv:2505.14489

#8

Reasoning Models Better Express Their Confidence

Dongkeun Yoon, Seungone Kim, Sohee Yang et al.

confidence calibrationchain-of-thought reasoninglarge language modelsslow thinking behaviors+2

33

ICML 2024arXiv:2203.01850

#9

T-Cal: An Optimal Test for the Calibration of Predictive Models

Donghwan Lee, Xinmeng Huang, Hamed Hassani et al.

predictive model calibrationuncertainty quantificationhypothesis testingexpected calibration error+4

26

ICML 2025arXiv:2405.08719

#10

Addressing Misspecification in Simulation-based Inference through Data-driven Calibration

Antoine Wehenkel, Juan L. Gamella, Ozan Sener et al.

25

ECCV 2024arXiv:2403.07263

#11

Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction

Alexander Timans, Christoph-Nikolas Straehle, Kaspar Sakmann et al.

conformal predictionuncertainty quantificationobject detectionbounding box localization+4

19

ICML 2024arXiv:2402.08733

#12

Experts Don't Cheat: Learning What You Don't Know By Predicting Pairs

Daniel D. Johnson, Daniel Tarlow, David Duvenaud et al.

epistemic uncertainty quantificationsecond-order calibrationconditional distribution predictionhallucination detection+2

16

ICLR 2025arXiv:2410.10414

#13

On Calibration of LLM-based Guard Models for Reliable Content Moderation

Hongfu Liu, Hengguan Huang, Xiangming Gu et al.

16

ICML 2024arXiv:2402.07417

#14

An Empirical Study Into What Matters for Calibrating Vision-Language Models

Weijie Tu, Weijian Deng, Dylan Campbell et al.

vision-language modelsuncertainty estimationmodel calibrationtemperature scaling+3

15

ICML 2024arXiv:2402.04655

#15

Open-Vocabulary Calibration for Fine-tuned CLIP

Shuoyuan Wang, Jindong Wang, Guoqing Wang et al.

vision-language modelsopen-vocabulary tasksconfidence calibrationparameter-efficient fine-tuning+3

14

AAAI 2024arXiv:2312.09817

#16

Calibrated One Round Federated Learning with Bayesian Inference in the Predictive Space

Mohsin Hasan, Guojun Zhang, Kaiyang Guo et al.

14

ICLR 2025arXiv:2501.19047

#17

Understanding Model Calibration - A gentle introduction and visual exploration of calibration and the expected calibration error (ECE)

Maja Pavlovic

11

AAAI 2025arXiv:2408.10939

#18

Conformalized Interval Arithmetic with Symmetric Calibration

Rui Luo, Zhixin Zhou

conformal predictionuncertainty quantificationprediction intervalssum estimation+3

11

NEURIPS 2025arXiv:2508.18847

#19

ConfTuner: Training Large Language Models to Express Their Confidence Verbally

Yibo Li, Miao Xiong, Jiaying Wu et al.

confidence calibrationverbalized uncertaintylarge language modelsproper scoring rules+4

10

ICML 2024arXiv:2311.17105

#20

On the Calibration of Human Pose Estimation

Kerui Gu, Rongyu Chen, Xuanlong Yu et al.

human pose estimationconfidence calibrationkeypoint localizationheatmap analysis+3

10

ICML 2024arXiv:2405.15458

#21

FedCal: Achieving Local and Global Calibration in Federated Learning via Aggregated Parameterized Scaler

Hongyi Peng, Han Yu, Xiaoli Tang et al.

federated learningmodel calibrationdata heterogeneitynon-iid data+4

9

ICML 2024arXiv:2405.07374

#22

Conformalized Survival Distributions: A Generic Post-Process to Increase Calibration

Shi-ang Qi, Yakun Yu, Russell Greiner

survival analysismodel calibrationdiscrimination performanceconformal regression+2

9

ICML 2025arXiv:2402.05806

#23

On Temperature Scaling and Conformal Prediction of Deep Classifiers

Lahav Dabah, Tom Tirer

9

ICML 2025arXiv:2502.16336

#24

Rectifying Conformity Scores for Better Conditional Coverage

Vincent Plassier, Alexander Fishkov, Victor Dheur et al.

8

NEURIPS 2025arXiv:2503.02863

#25

SteerConf: Steering LLMs for Confidence Elicitation

Ziang Zhou, Tianyuan Jin, Jieming Shi et al.

confidence elicitationmodel calibrationsteering prompt strategyconfidence consistency+3

8

ECCV 2024arXiv:2405.20459

#26

On Calibration of Object Detectors: Pitfalls, Evaluation and Baselines

Selim Kuzucu, Kemal Oksuz, Jonathan Sadeghi et al.

8

NEURIPS 2025arXiv:2502.19110

#27

Conformal Linguistic Calibration: Trading-off between Factuality and Specificity

Zhengping Jiang, Anqi Liu, Ben Van Durme

linguistic calibrationuncertainty quantificationconformal predictionanswer set prediction+3

7

ECCV 2024arXiv:2403.12559

#28

Confidence Self-Calibration for Multi-Label Class-Incremental Learning

Kaile Du, Yifan Zhou, Fan Lyu et al.

7

NEURIPS 2025arXiv:2502.16387

#29

Simultaneous Swap Regret Minimization via KL-Calibration

Haipeng Luo, Spandan Senapati, Vatsal Sharan

swap regret minimizationkl-calibrationcalibration measuresproper loss functions+3

7

ICML 2025arXiv:2502.02861

#30

Algorithms with Calibrated Machine Learning Predictions

Judy Hanwen Shen, Ellen Vitercik, Anders Wikum

6

ICCV 2025arXiv:2503.12701

#31

AnyCalib: On-Manifold Learning for Model-Agnostic Single-View Camera Calibration

Javier Tirado-Garín, Javier Civera

camera calibrationsingle-view calibrationmodel-agnostic calibrationintrinsic parameter estimation+4

6

ICLR 2025arXiv:2412.18808

#32

Provable Uncertainty Decomposition via Higher-Order Calibration

Gustaf Ahdritz, Aravind Gollakota, Parikshit Gopalan et al.

6

ICLR 2025arXiv:2410.06615

#33

QA-Calibration of Language Model Confidence Scores

Putra Manggala, Atalanti A Mastakouri, Elke Kirschbaum et al.

confidence score calibrationgenerative question answeringposthoc calibrationdistribution-free guarantees+3

AAAI 2025arXiv:2410.19796

#34

Feature Clipping for Uncertainty Calibration

Linwei Tao, Minjing Dong, Chang Xu

uncertainty calibrationmodel calibrationpost-hoc calibrationfeature clipping+3

ICLR 2025arXiv:2410.04315

#35

Calibrating Expressions of Certainty

Peiqi Wang, Barbara Lam, Yingcheng Liu et al.

certainty calibrationlinguistic expressionsuncertainty distributionspost-hoc calibration+3

ICML 2025arXiv:2502.03023

#36

Parametric Scaling Law of Tuning Bias in Conformal Prediction

Hao Zeng, Kangdao Liu, Bingyi Jing et al.

ICLR 2025arXiv:2502.06351

#37

Calibrating LLMs with Information-Theoretic Evidential Deep Learning

Yawei Li, David Rügamer, Bernd Bischl et al.

large language modelsmodel calibrationuncertainty estimationevidential deep learning+3

ICML 2025arXiv:2502.05676

#38

Generalized Venn and Venn-Abers Calibration with Applications in Conformal Prediction

Lars van der Laan, Ahmed Alaa

ICML 2024arXiv:2402.10046

#39

How Flawed Is ECE? An Analysis via Logit Smoothing

Muthu Chidambaram, Holden Lee, Colin McSwiggen et al.

model calibrationexpected calibration errormiscalibration metriclogit smoothing+4

ICML 2025arXiv:2410.02681

#40

Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models

Shuoyuan Wang, Sharon Li, Hongxin Wei

ICLR 2024arXiv:2307.02245

#41

Set Learning for Accurate and Calibrated Models

Lukas Muttenthaler, Robert A Vandermeulen, Qiuyi (Richard) Zhang et al.

ICLR 2025arXiv:2406.04068

#42

Reassessing How to Compare and Improve the Calibration of Machine Learning Models

Muthu Chidambaram, Rong Ge

NEURIPS 2025arXiv:2506.09338

#43

Know What You Don't Know: Uncertainty Calibration of Process Reward Models

Young-Jin Park, Kristjan Greenewald, Kaveh Alimohammadi et al.

uncertainty calibrationprocess reward modelsquantile regressioninstance-adaptive scaling+4

ICLR 2025arXiv:2409.04901

#44

Unlocking the Potential of Model Calibration in Federated Learning

Yun-Wei Chu, Dong-Jun Han, Seyyedali Hosseinalipour et al.

ECCV 2024arXiv:2312.02350

#45

Instant Uncertainty Calibration of NeRFs Using a Meta-Calibrator

Niki Amini-Naieni, Tomas Jakab, Andrea Vedaldi et al.

ECCV 2024arXiv:2407.12330

#46

Uncertainty Calibration with Energy Based Instance-wise Scaling in the Wild Dataset

Mijoo Kim, Junseok Kwon

ICLR 2025arXiv:2403.02998

#47

Towards Calibrated Deep Clustering Network

Yuheng Jia, Jianhong Cheng, Hui LIU et al.

deep clusteringconfidence calibrationover confidence problempseudo-label self-training+2

CVPR 2025arXiv:2503.22725

#48

Uncertainty Weighted Gradients for Model Calibration

Jinxu Lin, Linwei Tao, Minjing Dong et al.

model calibrationuncertainty estimationloss functionsgradient weighting+4

ICML 2025arXiv:2508.00264

#49

Calibrated Language Models and How to Find Them with Label Smoothing

Jerry Huang, Peng Lu, QIUHAO Zeng

NEURIPS 2025arXiv:2505.17435

#50

Discretization-free Multicalibration through Loss Minimization over Tree Ensembles

Hongyi Henry Jin, Zijun Ding, Dung Daniel Ngo et al.

NEURIPS 2025arXiv:2505.16690

#51

Your Pre-trained LLM is Secretly an Unsupervised Confidence Calibrator

Beier Luo, Shuoyuan Wang, Sharon Li et al.

ICML 2025arXiv:2504.13548

#52

Beyond One-Hot Labels: Semantic Mixing for Model Calibration

Haoyang Luo, Linwei Tao, Minjing Dong et al.

ICML 2025arXiv:2406.06227

#53

PAC-Bayes Analysis for Recalibration in Classification

Masahiro Fujisawa, Futoshi Futami

ICLR 2025arXiv:2405.13922

#54

Towards Certification of Uncertainty Calibration under Adversarial Attacks

Cornelius Emde, Francesco Pinto, Thomas Lukasiewicz et al.

uncertainty calibrationadversarial attackscertification methodsmodel calibration+3

ICLR 2025arXiv:2507.20272

#55

Approximating Full Conformal Prediction for Neural Network Regression with Gauss-Newton Influence

Dharmesh Tailor, Alvaro Correia, Eric Nalisnick et al.

NEURIPS 2025arXiv:2505.16636

#56

Multivariate Latent Recalibration for Conditional Normalizing Flows

Victor Dheur, Souhaib Ben Taieb

conditional normalizing flowsmultivariate density estimationmodel recalibrationlatent calibration+4

CVPR 2025arXiv:2504.10007

#57

Balancing Two Classifiers via A Simplex ETF Structure for Model Calibration

Jiani Ni, He Zhao, Jintong Gao et al.

AAAI 2025arXiv:2412.20170

#58

Attack-inspired Calibration Loss for Calibrating Crack Recognition

Zhuangzhuang Chen, Qiangyu Chen, Jiahao Zhang et al.

Real-Time Calibration Model for Low-Cost Sensor in Fine-Grained Time Series

Seokho Ahn, Hyungjin Kim, Sungbok Shin et al.

sensor calibrationtime series analysislow-cost sensorstransformer architecture+4

AAAI 2025arXiv:2412.10658

#60

Combining Priors with Experience: Confidence Calibration Based on Binomial Process Modeling

Jinzong Dong, Zhaohui Jiang, Dong Pan et al.

ICLR 2024arXiv:2311.11723

#61

Leveraging Uncertainty Estimates To Improve Classifier Performance

Gundeep Arora, Srujana Merugu, Anoop Saladi et al.

NEURIPS 2025arXiv:2506.14540

#62

Aligning Evaluation with Clinical Priorities: Calibration, Label Shift, and Error Costs

Gerardo Flores, Alyssa H. Smith, Julia Fukuyama et al.

ICLR 2025arXiv:2303.15057

#63

Towards Unbiased Calibration using Meta-Regularization

Jacek Golebiowski, Cheng Wang

AAAI 2024arXiv:2401.12001

#64

Modeling Stereo-Confidence out of the End-to-End Stereo-Matching Network via Disparity Plane Sweep

Jae Young Lee, Woonghyun Ka, Jaehyun Choi et al.

stereo confidencedisparity plane sweepstereo matching networkscost volume+3

ICCV 2025arXiv:2509.26231

#65

Model Uncertainty Quantification by Conformal Prediction in Continual Learning

Rui Gao, Weiwei Liu

IMG: Calibrating Diffusion Models via Implicit Multimodal Guidance

Jiayi Guo, Chuanhao Yan, Xingqian Xu et al.

diffusion model alignmentmultimodal guidanceimage-text alignmentpreference optimization+3

NEURIPS 2025arXiv:2505.24097

#67

Improving Model Probability Calibration by Integration of Large Data Sources with Biased Labels

Renat Sergazinov, Richard Chen, Cheng Ji et al.

Performative Risk Control: Calibrating Models for Reliable Deployment under Performativity

Victor Li, Baiting Chen, Yuzhen Mao et al.

risk controlperformative predictionsmodel calibrationstrategic manipulation+3

uncertainty calibrationmodel calibratabilitypost-hoc calibrationweight decay regularizer+3

#69

Calibration Bottleneck: Over-compressed Representations are Less Calibratable

Deng-Bao Wang, Min-Ling Zhang

ICML 2024

NEURIPS 2025arXiv:2502.15131

#70

Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling

Yufan Li, Pragya Sur

binary classificationcalibration theoryhigh-dimensional statisticsbregman divergence+4

ICCV 2025arXiv:2506.22720

#71

Pointwise Information Measures as Confidence Estimators in Deep Neural Networks: A Comparative Study

Shelvia Wongso, Rohan Ghosh, Mehul Motani

Learning model uncertainty as variance-minimizing instance weights

Nishant Jain, Karthikeyan Shanmugam, Pradeep Shenoy

Uncertainty Quantification for LLM-Based Survey Simulations

Chengpiao Huang, Yuhang Wu, Kaizheng Wang

Deterministic Object Pose Confidence Region Estimation

Jinghao Wang, Zhang Li, Zi Wang et al.

ICCV 2025arXiv:2508.00922

#75

CaliMatch: Adaptive Calibration for Improving Safe Semi-supervised Learning

Jinsoo Bae, Seoung Bum Kim, Hyungrok Do

NEURIPS 2025arXiv:2507.06645

#76

Quantifying Uncertainty in Error Consistency: Towards Reliable Behavioral Comparison of Classifiers

Thomas Klein, Sascha Meyen, Wieland Brendel et al.

ICML 2025arXiv:2512.09054

#77

Improving Multi-Class Calibration through Normalization-Aware Isotonic Techniques

Alon Arad, Saharon Rosset

AAAI 2025arXiv:2412.15301

#78

Parametric ρ-Norm Scaling Calibration

Siyuan Zhang, Linbo Xie

confidence calibrationparametric calibrationuncertainty quantificationpost-processing methods+4

NEURIPS 2025arXiv:2511.10439

#79

Enhancing Post-training Quantization Calibration through Contrastive Learning

Yuzhang Shang, Gaowen Liu, Ramana Kompella et al.

Improving Accuracy and Calibration via Differentiated Deep Mutual Learning

Han Liu, Peng Cui, Bingning Wang et al.

CLIB-FIQA: Face Image Quality Assessment with Confidence Calibration

Fu-Zhao Ou, Chongyi Li, Shiqi Wang et al.

Improving Perturbation-based Explanations by Understanding the Role of Uncertainty Calibration

Thomas Decker, Volker Tresp, Florian Buettner

uncertainty calibrationperturbation-based explanationsexplanation robustnessmodel recalibration+2

NEURIPS 2025arXiv:2510.26026

#83

Conformal Prediction Beyond the Horizon: Distribution-Free Inference for Policy Evaluation

Feichen Gan, Lu Youcun, Yingying Zhang et al.

conformal predictionpolicy evaluationreinforcement learninguncertainty quantification+4

probabilistic forecast calibrationmulti-dimensional regressionsample-based uncertaintyhighest density regions+4

#84

Intelligent Calibration for Bias Reduction in Sentiment Corpora Annotation Process

Idan Toker, David Sarne, Jonathan Schler

Inlier Confidence Calibration for Point Cloud Registration

Yongzhe Yuan, Yue Wu, Xiaolong Fan et al.

Generative Calibration of Inaccurate Annotation for Label Distribution Learning

Liang He, Yunan Lu, Weiwei Li et al.

On the Asymptotic Optimality of Confidence Interval Based Algorithms for Fixed Confidence MABs

Kushal Kejriwal, Nikhil Karamchandani, Jayakrishnan Nair

Self-Calibrating Vicinal Risk Minimisation for Model Calibration

Jiawei Liu, Changkun Ye, Ruikai Cui et al.

Sampling-based Multi-dimensional Recalibration

Youngseog Chung, Ian Char, Jeff Schneider

ICML 2024

ICML 2024arXiv:2406.10017

#90

Tilt and Average : Geometric Adjustment of the Last Layer for Recalibration

Gyusang Cho, Chan-Hyun Youn

neural network calibrationconfidence alignmentlast layer adjustmentgeometric adjustment+2