Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.
Repository Index
132,241 visible repositories in the index
1–1 of 1 · Most stars
132,241 visible repositories in the index
1–1 of 1 · Most stars
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.