Yubo Li, Tianyan Zhou, Xiaobin Shen, Yidi Miao, Rema Padman, Ramayya Krishnan · KiltHub Repository 2026 · 2026
DOI: 10.1184/r1/33990781.v1
Counts differ because each database indexes a different set of publications. We treat OpenAlex as the canonical count; Google Scholar is not shown (no API, and crawling it violates its ToS).
Most work on confidence in large language models has focused on estimation, uncertainty quantification, and calibration. In deployed systems, however, the key question is how confidence should be used to govern behavior. This survey studies confidence utilization: the use of confidence-related signals to control system decisions. We formalize this perspective through a unified framework in which confidence is defined over decision units under a local state and then consumed by a policy to determine actions. Using this lens, we organize the literature across full LLM lifecycle: training, inference, model selection and cascading, retrieval-augmented generation, risk management, and agentic control. We compare methods by signal source, decision unit, and functional role, and conclude by highlighting open challenges in confidence semantics, composition, source attribution, decision-aware evaluation, and robustness. Overall, the survey positions confidence not only as an estimation target, but as a control primitive: a signal that systems already use to reduce cost at matched accuracy, to enforce coverage guarantees, and to trade answer rate against error rate---and whose principled use we argue is a prerequisite for reliable LLM systems.
No comments yet — start the discussion below.