1.huggingface / tokenizers💥 Fast State-of-the-Art Tokenizers optimized for Research and Productionnlpnatural-language-processingnatural-language-understandinglanguage-modeltransformersbert+1 moreRustAPACHE-2.011K total1.2K forks+82 starsfrom 11,135 · score 4.42