CRF-specific Confidence Scoring Algorithm

A CRF-specific Confidence Scoring Algorithm is a confidence scoring algorithm that is specific to a CRF-based predictive model.

• Context:
  • It can make use of the Forward-Backward Algorithm.
  • It can support a CRF-specific Segmentation Confidence Scoring Algorithm.
  • …
• Examples(s):
  • CRF Gamma Score. (Culotta & McCallum, 2004)
  • (Jiang, 2005).
  • …
• Counter-Example(s):
  • a Decision Tree-specific Confidence Scoring Algorithm.
  • an SVM-specific Confidence Scoring Algorithm.
  • a Model-Independent Confidence Estimation Algorithm.
• See: Hypothesis Testing Algorithm.

---

---

References

2010

• (Mejer & Crammer, 2010) ⇒ Avihai Mejer, and Koby Crammer. (2010). “Confidence in Structured-prediction Using Confidence-weighted Models.” In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing (EMNLP 2010).
  • QUOTE: Most previous work has focused on confidence estimation for an entire example or some fields of an entry (Culotta and McCallum, 2004) using CRFs.

2005

• (Jiang, 2005) ⇒ Hui Jiang. (2005). “Confidence Measures for Speech Recognition: A Survey.” In: Speech Communication, 45(4). doi:10.1016/j.specom.2004.12.004
  • QUOTE: In speech recognition, confidence measures (CM) are used to evaluate reliability of recognition results. A good confidence measure can largely benefit speech recognition systems in many practical applications.

2004

• (Culotta & McCallum, 2004) ⇒ Aron Culotta, and Andrew McCallum. (2004). “Confidence Estimation for Information Extraction.” In: Proceedings of HLT-NAACL (NAACL 2004).

---