SGLang
Open-source framework for large language model inference
SGLang (short for Structured Generation Language) is an open-source framework for programming and serving large language models and multimodal models. It was introduced by researchers affiliated with LMSYS and other institutions as a system combining a Python-embedded language for structured generation with a runtime for high-throughput inference.
Nº Q139761223 ★★
Uncommon · Literature
SGLang
Open-source framework for large language model inference
SGLang (short for Structured Generation Language) is an open-source framework for programming and serving large language models and multimodal models. It was introduced by researchers affiliated with LMSYS and other institutions as a system combining a Python-embedded language for structured generation with a runtime for high-throughput inference.
Last price
—
Floor price
—
7-day median
—
30-day sales
0
30-day range
—
In circulation
0
Price history
median
low – high
sales
No sales in this period
Show table
| Date | median | Low | High | sales |
|---|
Sales history
- Last sale
- —
- 30-day average
- —
- 30-day low
- —
- 30-day high
- —
- Sales 7d
- 0
- Sales 30d
- 0
No sales yet.
Anonymous sales: no buyer or seller shown. Figures count player-to-player sales only.
From Wikipedia
SGLang (short for Structured Generation Language) is an open-source framework for programming and serving large language models and multimodal models. It was introduced by researchers affiliated with LMSYS and other institutions as a system combining a Python-embedded language for structured generation with a runtime for high-throughput inference. The project is designed for low latency and high-throughput inference workloads, and its documentation describes support for features such as structured outputs, speculative decoding, continuous batching, quantization, and compatibility with OpenAI-style APIs.
Text: Wikipédia, CC BY-SA 4.0. ·
Related cards
PyTorch
Open source machine learning library for Python, based on Torch
Nº Q47509047 ★★★
GPT-1
Generative pre-trained transformer-based language model from 2018
Nº Q95726718 ★★
OpenAI o3
Large language model developed by OpenAI
Nº Q131535482 ★★
Clang
Compiler front-end
Nº Q864915 ★★
Genera (software)
Operating System (OS)
Nº Q3100483 ★★
OpenGL ES
Port of the OpenGL API for embedded systems
Nº Q1137220 ★