WikiText Error Correction (WTEC) System Benchmark Task

A WikiText Error Correction (WTEC) System Benchmark Task is a Computer Software Benchmarking Task that evaluates the performance of WikiText Error Correction (WTEC) Systems.

• Context:
  • Task Input: Benchmarks, training, test, and evaluation datasets,
  • Task Output: WTEC System Performance Score.
  • Task Requirement(s):
    • WTEC Baseline Models,
    • a WTEC Model Training System,
    • a WTEC System's Benchmark Performance Metric.
• Example(s):
  • GM-RKB WikiText Error Correction (WTEC) Benchmark Task.
  • …
• Counter-Example(s):
  • a Grammatical Error Correction (GEC) System Benchmark Task.
  • a Spelling Error Correction (SEC) Benchmark Task.
• See: Text Wikification System, Natural Language Processing System, Misspelling Correction System, Parsing System, Wiki Markup Language, Text Error Correction System, Language Model, Character-Level MLE Language Model, Seq2Seq Encoder-Decoder Neural Network.

---

---

References

2020

• (Melli et al., 2020) ⇒ Gabor Melli, Abdelrhman Eldallal, Bassim Lazem, and Olga Moreira. (2020). “GM-RKB WikiText Error Correction Task and Baselines.”. In: Proceedings of LREC 2020 (LREC-2020).
  • QUOTE: We designed and implemented the GM-RKB WikiText Error Correction (WEC) Task to benchmark systems that attempt to automatically recognize and repair simple typographical errors in WikiText based on frequent patterns observed in the corpus. The task consisted in conducting a series of experiments on benchmark datasets to find the best performing WEC system(...)----