Fast, state-of-the-art tokenization library written in Rust, with Python and Node.js bindings, for NLP and language model pipelines.
11.2K1.2KRustApache-2.0Updated 16 hours ago
#bert
Curated GitHub repositories related to bert, with AI summaries and key stats.
Fast, state-of-the-art tokenization library written in Rust, with Python and Node.js bindings, for NLP and language model pipelines.