2019 BertscoreEvaluatingTextGenerati

• (Zhang, Kishore et al., 2019) ⇒ Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. (2019). “BERTScore: Evaluating Text Generation with BERT.” In: Proceedings in International Conference on Learning Representations (ICLR-2019).

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222019%22+Bertscore%3A+Evaluating+Text+Generation+with+Bert

Quotes

Abstract

We propose BERTScore, an automatic evaluation metric for text generation. Analogously to common metrics, BERTScore computes a similarity score for each token in the candidate sentence with each token in the reference sentence. However, instead of exact matches, we compute token similarity using contextual embeddings. We evaluate using the outputs of 363 machine translation and image captioning systems. BERTScore correlates better with human judgments and provides stronger model selection performance than existing metrics. Finally, we use an adversarial paraphrase detection task to show that BERTScore is more robust to challenging examples when compared to existing metrics.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2019 BertscoreEvaluatingTextGenerati	Tianyi Zhang Varsha Kishore Felix Wu Kilian Q Weinberger Yoav Artzi			Bertscore: Evaluating Text Generation with Bert						2019