1.huggingface / tokenizers💥 Fast State-of-the-Art Tokenizers optimized for Research and Productionnlpnatural-language-processingnatural-language-understandinglanguage-modeltransformersbert+1 moreRustAPACHE-2.011K total1.2K forks+303 starsfrom 10,914 · score 5.72