XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models Paper • 2411.15100 • Published Nov 22 • 5
XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models Paper • 2411.15100 • Published Nov 22 • 5
Relax: Composable Abstractions for End-to-End Dynamic Machine Learning Paper • 2311.02103 • Published Nov 1, 2023 • 16
Atom: Low-bit Quantization for Efficient and Accurate LLM Serving Paper • 2310.19102 • Published Oct 29, 2023 • 10