Publications

2020 + Preprints

Distributed Machine Learning



• Overlap Local-SGD: An Algorithmic Approach to Hide Communication Delays in Distributed SGD
  • Jianyu Wang, Hao Liang, Gauri Joshi
  • International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2020


• Advances and Open Problems in Federated Learning
  • 58 authors, including Peter Kairouz, Brendan McMahan, Jianyu Wang and Gauri Joshi
  • preprint


• Accelerating Deep Learning by Focusing on the Biggest Losers
  • Angela H. Jiang, Daniel L.-K. Wong, Giulio Zhou, David G. Andersen, Jeffrey Dean, Gregory R. Ganger, Gauri Joshi, Michael Kaminksy, Michael Kozuch, Zachary C. Lipton, Padmanabhan Pillai
  • preprint


• Machine Learning on Volatile Instances
  • Xiaoxi Zhang, Jianyu Wang, Gauri Joshi, Carlee Joe-Wong
  • IEEE Intl. Conf. on Computer Communications (INFOCOM), April 2020


• Slow and Stale Gradients Can Win the Race
  • Sanghamitra Dutta, Jianyu Wang and Gauri Joshi
  • preprint



Large-scale Parallel Computing



• Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-vector Multiplication
  • Ankur Mallick, Malhar Chaudhari, Ganesh Palanikumar, Utsav Sheth, Gauri Joshi
  • ACM SIGMETRICS, June 2020


• Synergy via Redundancy: Adaptive Replication Strategies and Fundamental Limits
  • Gauri Joshi and Dhruva Kaushal
  • preprint



Multi-armed Bandits and Bayesian Optimization



• Deep Probabilistic Kernels for Sample Efficient Learning
  • Ankur Mallick, Bhavya Kailkhura, Gauri Joshi, T. Yong-Jin Han
  • preprint


• Correlated Multi-armed Bandits with a Latent Random Source
  • Samarth Gupta, Gauri Joshi, Osman Yagan
  • International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2020


• Multi-armed Bandits with Correlated Arms
  • Samarth Gupta, Shreyas Chaudhari, Gauri Joshi, Osman Yagan
  • preprint


• A Unified Approach to Translate Classic Bandit Algorithms to the Structured Bandit Setting
  • Samarth Gupta, Shreyas Chaudhari, Subhojyoti Mukherjee, Gauri Joshi, Osman Yagan
  • preprint

2019

• MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling
  • Jianyu Wang, Anit Sahu, Gauri Joshi, Soummya Kar
  • NeurIPS workshop of Federated Learning for Data Privacy and Confidentiality, Dec 2019
  • Distinguished Student Paper Award


• Cooperative SGD: A Unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms
  • Jianyu Wang, Gauri Joshi
  • International Conf. on Machine Learning (ICML) CodML Workshop, June 2019


• Rateless Codes for Distributed Computations with Sparse Compressed Matrices
  • Ankur Mallick, Gauri Joshi
  • international Symposium on Information Theory (ISIT), July 2019


• Fast and Efficient Distributed Matrix-Vector Multiplication Using Rateless Fountain Codes
  • Ankur Mallick, Malhar Chaudhari, Gauri Joshi
  • International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2019


• Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD
  • Jianyu Wang, Gauri Joshi
  • SysML Conference, March 2019


• Efficient Straggler Replication in Large-scale Parallel Computing
  • Da Wang, Gauri Joshi, and Gregory Wornell,
  • ACM Trans. on Modeling and Perf. Eval. of Comp. Systems, 2019

2018

• Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD
  • Sanghamitra Dutta, Gauri Joshi, Soumyadip Ghosh, Parijat Dube, Priya Nagpurkar,
  • International Conference on Artificial Intelligence and Statistics (AISTATS), Apr 2018


• Active Distribution Learning from Indirect Samples
  • Samarth Gupta, Gauri Joshi, Osman Yagan
  • Allerton Conference on Communication, Control and Computing, Oct 2018


• Service Capacity Region of Content Access from Erasure Coded Storage
  • Sarah E. Anderson, Ann Johnston, Gauri Joshi, Gretchen L. Matthews, Carolyn Mayer, and Emina Soljanin
  • IEEE Information Theory Workshop, Nov 2018


• Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD
  • Jianyu Wang, Gauri Joshi
  • NeurIPS MLSys Workshop, Dec 2018

2017

• Synergy via Redundancy: Boosting Service Capacity via Adaptive Task Replication
  • Gauri Joshi,
  • ACM/IFIP Performance, Nov 2017


• On the Service Capacity Region of Accessing Erasure Coded Content
  • Mehmet Aktas, Sarah E. Anderson, Ann Johnston, Gauri Joshi, Swanand Kadhe, Gretchen L. Matthews, Carolyn Mayer, and Emina Soljanin
  • Allerton Conference on Communication, Control, and Computing, Oct 2017


• Efficient Redundancy Techniques for Latency Reduction in Cloud Systems
  • Gauri Joshi, Emina Soljanin and Gregory Wornell,
  • ACM Trans. on Modeling and Perf. Eval. of Comp. Systems, vol. 2, no. 12, May 2017


• Boosting Service Capacity via Adaptive Task Replication
  • Gauri Joshi,
  • ACM Sigmetrics MAMA workshop, Jun 2017

2015-2016

• Efficient Redundancy Techniques to Reduce Delay in Cloud Systems
  • Doctoral Thesis, MIT, June 2016
  
  
• Efficient Replication of Queued Tasks to Reduce Latency in Cloud Systems
  • Gauri Joshi, Emina Soljanin, and Gregory Wornell,
  • Allerton Conference on Communication, Control and Computing, Oct 2015
  
  
• Queues with Redundancy: Latency-Cost Analysis
  • Gauri Joshi, Emina Soljanin, and Gregory Wornell,
  • Mathematical Modeling and Analysis (MAMA) Workshop, Jun 2015
  
  
• Using Straggler Replication to Reduce Latency in Large-scale Parallel Computing
  • Da Wang, Gauri Joshi, and Gregory Wornell,
  • Distributed Cloud Computing (DCC) Workshop, Jun 2015
  
  
• Playback Delay in On-Demand Streaming Communication with Feedback
  • Kaveh Mahadaviani, Ashish Khisti, Gauri Joshi, and Gregory Wornell,
  • International Symposium on Information Theory, July 2015

2014

• Efficient Job Replication for Fast Response Times in Parallel Computation
  • Da Wang, Gauri Joshi, and Gregory Wornell,
  • ACM Sigmetrics short paper Jun 2014
  
  
• Throughput-Smoothness Trade-offs in Multicasting an Ordered Packet Stream
  • Gauri Joshi, Yuval Kochman, and Gregory Wornell,
  • International Symposium on Network Coding, Jun 2014
  
  
• On the Delay-Storage Trade-off in Content Download from Distributed Storage
  • Gauri Joshi, Yanpei Liu, and Emina Soljanin,
  • IEEE Journal on Selected Areas of Communications, vol. 32, no. 5, May 2014


• Effect of Block-wise Feedback on the Throughput-Delay Trade-off in Streaming
  • Gauri Joshi, Yuval Kochman, and Gregory Wornell,
  • INFOCOM workshop on Contemporary Video, Apr 2014

2012-2013

• Round-robin Overlapping Generations Coding for Fast Content Download
  • Gauri Joshi and Emina Soljanin,
  • International Symposium on Information Theory, Jul 2013
  
  
• Coding for Fast Content Download
  • Gauri Joshi, Yanpei Liu, and Emina Soljanin,
  • Allerton Conference on Communication, Control and Computing, Oct 2012
  
  
• On Playback Delay in Streaming Communication
  • Gauri Joshi, Yuval Kochman, and Gregory Wornell,
  • International Symposium on Information Theory, Jul 2012
  
  
• On Playback Delay in Streaming Communication
  • Masters Thesis, MIT, May 2012,
  • William Martin Memorial Best Thesis Award

2010-2011

• Fountain Codes
  • Gauri Joshi, Joong Bum Rhim, John Sun, Da Wang
  • Project Report 6.451, Dec 2010


• Downlink Erlang Capacity of Cellular OFDMA
  • Gauri Joshi, Harshad Maral, and Abhay Karandikar,
  • National Conference on Communications, Jan 2011
  
  
• Optimal Relay Placement for Cellular Coverage Extension
  • Gauri Joshi and Abhay Karandikar,
  • National Conference on Communications, Jan 2011
  
  
• Performance Analysis of Active Handoff in CDMA2000 Femtocells
  • Gauri Joshi, Mehmet Yavuz, and Chirag Patel,
  • National Conference on Communications, Jan 2010


• On Relay-assisted Cellular Networks
  • Masters Thesis, IIT Bombay, June 2010