1.huggingface / tokenizers💥 Fast State-of-the-Art Tokenizers optimized for Research and Productionnlpnatural-language-processingnatural-language-understandinglanguage-modeltransformersbert+1 moreRustAPACHE-2.011K total1.2K forks+16 starsfrom 11,201 · score 2.83