Model-Independent Confidence Estimation Algorithm

A Model-Independent Confidence Scoring Algorithm is a Confidence Scoring Algorithm that is not specific to a predictive model type.

• Example(s):
  • (Yu et al., 2011).
  • …
• Counter-Example(s):
  • a CRF-specific Confidence Scoring Algorithm.
  • a Decision Tree-specific Confidence Scoring Algorithm.
  • an SVM-specific Confidence Scoring Algorithm.
• See: Hypothesis Testing Algorithm.

---

---

References

2011

• (Yu et al., 2011) ⇒ Dong Yu, Jinyu Li, and Li Deng. (2011). “Calibration of Confidence Measures in Speech Recognition.” In: IEEE Transactions on Audio, Speech, and Language Processing, 19(8).
  • QUOTE: Most speech recognition applications in use today rely heavily on confidence measure for making optimal decisions. In this paper, we aim to answer the question: what can be done to improve the quality of confidence measure if we cannot modify the speech recognition engine?

---