Skills

A full text search engine that isn't also a database.

Tokenize (Scan) JSDoc buffer

🔢 Ultra-fast token counter for files and text - supports GPT models, Claude, and more!

<header> <h1 align="center"> <a href="https://github.com/guanghechen/yozora/tree/master/tokenizers/inline-formula#readme">@yozora/tokenizer-inline-formula</a> </h1> <div align="center"> <a href="https://www.npmjs.com/package/@yozora/tokenize

A fork with support for documentation of Salve, a Javascript library which implements a validator able to validate an XML document on the basis of a subset of RelaxNG.

transform streamed glsl tokens into an ast

Tokenizes a text from left to right and returns the list of tokens with their types.

A simple NodeRED module to implement bert-tokenizer

Experimental JSONC AST parser and encoder

A nodejs client for the cash-tokenizer API

SQL Analyzer is a tool designed for analyzing SQL queries. The package enables parsing SQL queries, building an Abstract Syntax Tree (AST), and analyzing dependencies and relations used in queries.

Language Libraries to work with XML, Aura, Apex... files. tokenizers, parsers, system classes and much more

BASIC Stamp PBASIC Tokenizer

A NodeJS library to tokenize strings

xyxyx-web-components is an npm package designed to integrate Xyxyx API's text-based tokenization functionalities within React applications.

Streaming s-expression parser

Math expression tokenizer

Client-side Javascript utilities for GambleID

[](https://badge.fury.io/js/moo-ignore) [](https://github.com/ULL-ESIT-PL/moo-ignore/actions/workflow

Module for fast css selector tokenization from string

A very small css parser

FLEX.JS - Fast lexer (tokenizer, scanner) for JavaScript inspired by FLEX lexer generator

A tokenzier for Sass' SCSS syntax

A textual language that compiles to UML sequence diagrams.