2020 WithMoreContextsComesBetterPerf

• (Scarlini et al., 2020) ⇒ Bianca Scarlini, Tommaso Pasini, and Roberto Navigli. (2020). “With More Contexts Comes Better Performance: Contextualized Sense Embeddings for All-Round Word Sense Disambiguation.” In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020).

Subject Headings: Sense Embedding System; ARES System; Word Sense Disambiguation System

Notes

• Online Resource(s):
  • Website: http://sensembert.org/ares

Cited By

• Google Scholar: ~ 11 Citations.

Quotes

Abstract

Contextualized word embeddings have been employed effectively across several tasks in Natural Language Processing, as they have proved to carry useful semantic information. However, it is still hard to link them to structured sources of knowledge. In this paper we present ARES (context-AwaRe Embeddings of Senses), a semi-supervised approach to producing sense embeddings for the lexical meanings within a lexical knowledge base that lie in a space that is comparable to that of contextualized word vectors. ARES representations enable a simple 1 Nearest-Neighbour algorithm to outperform state-of-the-art models, not only in the English Word Sense Disambiguation task, but also in the multilingual one, whilst training on sense-annotated data in English only. We further assess the quality of our embeddings in the Word-in-Context task, where, when used as an external source of knowledge, they consistently improve the performance of a neural model, leading it to compete with other more complex architectures. ARES embeddings for all WordNet concepts and the automatically-extracted contexts used for creating the sense representations are freely available at http://sensembert.org/ares.

BibTeX

@inproceedings{2020_WithMoreContextsComesBetterPer,
  author    = {Bianca Scarlini and
               Tommaso Pasini and
               Roberto Navigli},
  editor    = {Bonnie Webber and
               Trevor Cohn and
               Yulan He and
               Yang Liu},
  title     = {With More Contexts Comes Better Performance: Contextualized Sense
               Embeddings for All-Round Word Sense Disambiguation},
  booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural
               Language Processing (EMNLP 2020)},
  pages     = {3528--3539},
  publisher = {Association for Computational Linguistics},
  year      = {2020},
  url       = {https://doi.org/10.18653/v1/2020.emnlp-main.285},
  doi       = {10.18653/v1/2020.emnlp-main.285},
}

---

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2020 WithMoreContextsComesBetterPerf	Bianca Scarlini Tommaso Pasini Roberto Navigli			With More Contexts Comes Better Performance: Contextualized Sense Embeddings for All-Round Word Sense Disambiguation						2020