Name: vLLM: Easy, Fast, and Cheap LLM Serving for Everyone - Kaichao You, Tsinghua University
Start: 2025-06-07T11:30:00+0800
End: 2025-06-07T11:50:00+0800

In-person | 2025 June 7
Learn more on our website

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered to participate in the sessions. If you have not registered but would like to join us, please visit the BAAI Conference webpage.

Please note: This schedule is automatically displayed in China Standard Time (UTC+08:00). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Saturday June 7, 2025 11:30 - 11:50 CST

TBA

vLLM is a fast and easy-to-use library for LLM inference and serving. In this talk, I will briefly introduce the evolution of the vLLM project, the open-source community behind it, and highlight some features that are interesting to many users.

Speakers

KaiChao YOU

Student, Tsinghua University

Kaichao You is a fifth year Ph.D. student from Tsinghua University. He is working on the vLLM project, a high-throughput and memory-efficient inference and serving engine for LLMs. He is also an open-source contributor to PyTorch/Triton.

Saturday June 7, 2025 11:30 - 11:50 CST
TBA

Optimization for Training and Inferences

PyTorch Day China 2025

KaiChao YOU

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!