Chao Jin

I am currently a second-year Ph.D. student at the Computer Systems Research Group in the School of Computer Science at Peking University, advised by Prof. Xin Jin.

My research interests include machine learning systems, distributed systems, and cloud computing, with a recent focus on the intersection of large language models (LLMs), generative AI, and innovative system design.

I received my B.S. degree in computer science from the School of Electronics Engineering and Computer Science (EECS), Peking University in 2023.

Email: chaojin (at) pku (dot) edu (dot) cn

Recent Publications (Since 2023)

MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
Ruidong Zhu*, Ziheng Jiang*, Chao Jin*, Peng Wu, Cesar A. Stuardo, Dongyang Wang, Xinlei Zhang, Huaping Zhou, Haoran Wei, Yang Cheng, Jianzhe Xiao, Xinyi Zhang, Lingjun Liu, Haibin Lin, Li-Wen Chang, Jianxi Ye, Xiao Yu, Xuanzhe Liu, Xin Jin, Xin Liu
(* Equal Contribution)
In Preprint.
[PDF]

Towards Swift Serverless LLM Cold Starts with ParaServe
Chiheng Lou, Sheng Qi, Chao Jin, Dapeng Nie, Haoran Yang, Xuanzhe Liu, Xin Jin
In Preprint.
[PDF]

FaaSPR: Latency-oriented Placement and Routing Optimization for Serverless Workflow Processing
Yunshan Jia, Chao Jin, Qing Li, Xuanzhe Liu, Xin Jin
IEEE Transactions on Networking (TON), 2025.
[PDF]

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
Chao Jin, Zili Zhang, Xuanlin Jiang, Fangyue Liu, Xin Liu, Xuanzhe Liu, Xin Jin
In Preprint.
[PDF]

Pyxis: Scheduling Mixed Tasks in Disaggregated Datacenters
Sheng Qi, Chao Jin, Mosharaf Chowdhury, Zhenming Liu, Gang Huang, Xuanzhe Liu, Xin Jin
IEEE Transactions on Parallel and Distributed Systems (TPDS 2024), 2024.
[PDF]

Jolteon: Unleashing the Promise of Serverless for Serverless Workflows
Zili Zhang, Chao Jin, Xin Jin
USENIX Symposium on Networked Systems Design and Implementation (NSDI 2024), Santa Clara, April 16–18, 2024.
[PDF] [Slides]

Ditto: Efficient Serverless Analytics with Elastic Parallelism
Chao Jin, Zili Zhang, Xingyu Xiang, Songyun Zou, Gang Huang, Xuanzhe Liu, Xin Jin
ACM Special Interest Group on Data Communication (SIGCOMM 2023), New York City, September 10-14, 2023.
[PDF] [Slides]

Fast, Approximate Vector Queries on Very Large Unstructured Datasets
Zili Zhang, Chao Jin, Linpeng Tang, Xuanzhe Liu, Xin Jin
USENIX Symposium on Networked Systems Design and Implementation (NSDI 2023), Boston, April 17–19, 2023.
[PDF] [Slides]

Teaching

Teaching Assistant, Operating Systems (Honor Track) at PKU, 2024 Spring.
Teaching Assistant, Introduction to Computer System at PKU, 2021 Fall.

Internship

ByteDance [2023.7 - 2025.3], Advised by Ziheng Jiang and Haibin Lin, Research Intern of Seed-Foundation-MLSys.
Alibaba Cloud [2022.3 - 2022.8], Advised by Rui Miao, Research Intern of networked systems.

Honors and Awards

[2024] Merit Student (2/56)
[2024] Huawei Scholarship at School of Computer Science, Peking University
[2023] Presidential Scholarship of Peking University (highest honor for Ph.D. students at Peking University)
[2021] Learning Excellence Award at Peking University
[2020] Merit Student
[2020] Xiaomi Scholarship at Peking University