- Published on
Enable Large Language Model Deployment Across Cloud and Edge with ML Compilation
- Authors
- Name
- MLSys @UCSD
- Name
- Host: Hao Zhang
- Name
- Host: Junda Chen
This week, our MLSys seminar is pleased to present a talk by Prof. Tianqi Chen scheduled on Thursday, February 6 @ 6:30 PM (PST). We welcome all interested students and faculty to attend the talk on Zoom: https://ucsd.zoom.us/j/94713375885
Talk title: Enable Large Language Model Deployment Across Cloud and Edge with ML Compilation
Talk Abstract: In this talk, we will discuss the lessons learned in building an efficient large language model deployment system for both server and edge settings. We will cover general techniques in machine learning compilation and system support for efficient structure generation. We will also discuss the future opportunities in system co-design for cloud-edge model deployments.
Bio: Tianqi Chen is currently an Assistant Professor at the Machine Learning Department and Computer Science Department of Carnegie Mellon University. He is also a distinguished engineer at NVIDIA. He received his PhD from the Paul G. Allen School of Computer Science & Engineering at the University of Washington. He has created many major learning systems that are widely adopted: XGBoost, Apache TVM, and MLC-LLM.