Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
- go
- segment
- nlp
- gse
47,133 repositories indexed
1–6 of 6 · Most stars
Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
Global edition of ARTEX — an LLM multi-agent autonomous penetration-testing framework. English default, switchable to Korean/Chinese/Spanish/Japanese. For authorized, defensive and detection use only. (upstream: Autumn-27/ARTEX, AGPL-3.0)
TranslatedConvert Chinese characters to pinyin
TranslatedA Zhuyin (Bopomofo) input method that needs no character selection: it uses a Transformer locally to choose characters based on the preceding text. Supports Linux (Fcitx5/IBus), macOS, and Windows.
Chinese word splitting algorithm MMSEG in GO
A tokenizer based on the dictionary and Bigram language models for Go. (Now only support chinese segmentation)