Hi there! I am Peirong Zheng (郑培荣), a PhD candidate in Computing at The Hong Kong Polytechnic University (PolyU), supervised by Prof. Wenchao Xu and Prof. Bin Xiao.

My research focuses on edge AI and efficient large language model serving, with a particular interest in making advanced AI systems practical on resource-constrained devices. I am always happy to discuss related research and potential collaborations.

🔥 News

• 2026.01One paper is accepted by WWW 2026 in Dubai (CCF-A).
• 2025.12One paper is accepted by IEEE INFOCOM 2026 in Tokyo (CCF-A).
• 2025.11One poster is accepted by ACM MobiCom 2025 in Hong Kong (CCF-A).
• 2025.06Our survey is accepted by IEEE Communications Surveys & Tutorials (Q1).
• 2024.05One paper, co-first authored, is accepted by ACM SIGKDD 2024 in Barcelona (CCF-A).
• 2023.02One paper, co-first authored, is accepted by IEEE EMBC 2023.

📝 Selected Publications

^* Equal contribution

WWW 2026 · CCF-A

Featured

Self-Speculative Decoding for On-device MoE Acceleration

Peirong Zheng, Wenchao Xu, and Haozhao Wang

[Paper] [DOI]

Algorithm-system co-design for memory-constrained MoE inference, achieving up to 3.72× decoding speedup with nearly lossless accuracy.

INFOCOM 2026 · CCF-A

Featured

HALO: Semantic-Aware Distributed LLM Inference in Lossy Edge Network

Peirong Zheng, Wenchao Xu, Haozhao Wang, Jinyu Chen, and Xuemin Sherman Shen

[Paper] [arXiv]

Semantic-aware distributed inference for unreliable edge networks, delivering up to 3.41× end-to-end speedup on a Raspberry Pi cluster.

KDD 2024 · CCF-A

Featured

FedNLR: Federated Learning with Neuron-wise Learning Rates

Haozhao Wang^*, Peirong Zheng^*, Xingshuo Han, Wenchao Xu, Ruixuan Li, and Tianwei Zhang

[Paper] [DOI]

A neuron-level view of client drift with adaptive neuron-wise learning rates for heterogeneous federated learning.

🖥️ Academic Service

• Conference reviewer: KDD, CVPR, ECCV, NeurIPS, and ICCV.
• Journal reviewer: IEEE Transactions on Mobile Computing and IEEE Transactions on Sustainable Computing.

📖 Education

Jan 2024 – Present

The Hong Kong Polytechnic University

PhD in Computing

Aug 2022 – Nov 2023

Nanyang Technological University

MSc in Communications Engineering

Aug 2018 – Jul 2022

University of Electronic Science and Technology of China

BE in Communication Engineering, Yingcai Honors Program