UC San Diego ML Systems Group

We are a group of faculty, researchers, and students targeting at the intersection of machine learning and systems. Our current members span the Computer Science and Engineering Department (CSE) and the Halıcıoğlu Data Science Institute (HDSI) at the University of California, San Diego. Our research focuses on a broad spectrum of topics aimed at advancing next-generation systems for machine learning and developing innovative algorithms.

Research Areas

  • Systems for ML/AI
  • ML/AI for building systems
  • ML compilers and runtimes
  • Distributed ML/AI
  • Hardware software co-design for ML/AI
  • ML/AI system benchmarks and datasets
  • AIGC and agents
  • AI systems for science

    • Events

    • Published on
      MLSys-Seminar
      Speaker: Dr. Jinliang Wei, Google
      Numerous domain-specific accelerators have been developed recently to address the growing computational needs of machine learning, and the success of these DSAs hinges on effective ML compilers like Google's XLA, which enhances ML performance on various hardware and supports multiple frameworks, and is further advanced through collaborative development in OpenXLA.
      Read more →
    • Published on
      MLSys-Seminar
      Speaker: Dr. Jason Ansel, Meta AI
      PyTorch 2 leverages new technologies like TorchDynamo and TorchInductor to significantly enhance training and inference speeds without compromising its ease of use, flexibility, and Pythonic environment. TorchDynamo optimizes unmodified PyTorch code at the Python bytecode level, while TorchInductor translates programs for efficient execution on GPUs and CPUs, maintaining the dynamism inherent in PyTorch and allowing for easy user customization.
      Read more →
    • Published on
      MLSys-Seminar
      Speaker: Dr. Esha Choukse, Microsoft
      With the ubiquitous use-cases of modern LLMs, the deployment scale of these models is unforeseen. This has led to a large-scale datacenter expansion with GPUs, currently running into an energy wall worldwide. This talk will focus on the properties of generative LLMs that can be used to make the deployment of these models more power-efficient. The talk will also introduce POLCA and Splitwise, two techniques to reduce the power consumption for the LLM serving.
      Read more →