SentencePiece Tokenization System

From GM-RKB
Jump to navigation Jump to search

A SentencePiece Tokenization System is an unsupervised subword tokenization system and unsupervised subword detokenization system.



References

2020

2018