Tokenize string input into 32-bit integers (for full text search and natural language processing).
Cross-referenced across 55 tracked directories
#8888
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
11/8/2025
Created
1
GitHub Stars
3/16/2026
Last Commit
Recently added to the ecosystem
colthreepv
A CLI tool to build context files to attach to Large Language Models (LLMs).
niieani
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
shichri
nlux React is a library for building conversational AI interfaces, with support for OpenAI, HuggingFace, and more.