Inference for text-embeddings in Rust, HFOIL Licence.
Cross-referenced across 55 tracked directories
#315
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
3d
Listed For
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
a toolkit for deploying and serving Large Language Models (LLMs).
NVIDIA Framework for LLM Inference(Transitioned to TensorRT-LLM)
SGLang is a fast serving framework for large language models and vision language models.
Nvidia Framework for LLM Inference