Jianyu Wang

Ph.D. student
Carnegie Mellon University


Pittsburgh, PA 15213
Email: jianyuw1 [at] andrew.cmu.edu
Google Scholar



My name is Jianyu Wang (王健宇 in Chinese). I am a third-year Ph.D. student at Carnegie Mellon University, advised by professor Gauri Joshi and affiliated with Optimization, Probability, and Learning (OPAL) group, Parallel Data Lab. My research has been supported by Qualcomm Ph.D. fellowship.

Before coming to CMU, I received a Bachelors with honor in Electronic Engineering at Tsinghua University, where I worked with professor Yuan Shen on several projects about statistical inference. I was also fortunate to visit professor Yu Bin's group at U.C. Berkeley in summer 2016, working on the optimization landscape of neural networks.

Research Interests

I am interested in large-scale machine learning, in particular, distributed deep learning, which lies in the intersection of statistical learning, optimization, and computer systems.

The long-term goal of my research is to develop and analyze efficient training algorithms that easily lend themselves to distributed implementations and are robust to system variability (such as unpredictable node slowdown and communication delays).

Industrial Experiences

   Facebook AI Research
      Summer 2019
      Research Intern
      Project: Communication-efficient Distributed Deep Learning


   Carnegie Mellon University
      Sept. 2017 -- Present
      Ph.D. student in ECE
      CGPA: 4.0/4.0

   Tsinghua University
      Aug. 2013 -- July. 2017
      B.Eng. in EE
      CGPA: 91/100, ranking: top 10%

Publication and Preprints

SLOWMO: Improving Communication-Efficient Distributed SGD with Slow Momentum
Jianyu Wang, Vinayak Tantia, Nicolas Ballas, Michael Rabbat
ICLR 2020: Intl. Conf. on Learning Representations / arXiv
Machine Learning on Volatile Instances
Xiaoxi Zhang, Jianyu Wang, Gauri Joshi, Carlee Joe-Wong
INFOCOM 2020: IEEE Intl. Conf. on Computer Communications / arXiv
MATCHA: Speeding up Decentralized SGD via Matching Decomposition Sampling
Jianyu Wang, Anit Kumar Sahu, Zhouyi Yang, Gauri Joshi, Soummya Kar
In submission / arXiv / slides
Abridged in NeurIPS 2019 Workshop on Federated Learning (Oral & Best Student Paper Award).
Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD
Jianyu Wang, Gauri Joshi
SysML 2019 (17% acceptance rate): The Conf. on Machine Learning and Systems / arXiv / slides / video
Abridged in NeurIPS 2018 Workshop on Systems for ML.
Cooperative SGD: A Unified Framework for the Design and Analysis of Local-Update Distributed SGD Algorithms
Jianyu Wang, Gauri Joshi
In submission / arXiv / slides / video
Abridged in ICML 2019 Workshop on Coding Theory for Large-Scale ML (Oral).
On the Discretization Schemes in Map-Aided Indoor Localization
Jianyu Wang, Yuan Shen
IEEE Communications Letters / pdf

Selected Honors and Awards

Year Honor Description
2019 Distinguished Student Paper Award Workshop on Federated Learning for Data Privacy and Confidentiality (@ NeurIPS 2019)
2019 Qualcomm Innovation Fellowship
2018 Benjamin Garver Lamme/Westinghouse Graduate Fellowship, CMU
2017 College of Engineering Dean’s Fellowship, CMU
2017 Excellent Graduate Awards, Tsinghua Awarded to top 10% among all 3000 undergraduates
2015 Fellowship of Spark Talents Program, Tsinghua Awarded to top 50 students, dedicated to scientific and technological innovations
2012 National Training Team for International Physics Olympiad Selected top 60 students in China
Year Scholorship Description
2016 Aviation Industry of China Scholarship For academic and reasearch excellence
2016 Huawei Scholarship For comprehensive excellence
2015 TP-Link Scholarship For academic, research and social work excellence
2014 Zheng Geru Scholarship For academic excellence

Graduated Courses

Machine Learning

Computer Systems