publications

(*) equal contribution.

Decentralized Nonconvex Optimization under Heavy-Tailed Noise: Normalization and Optimal Convergence. Shuhua Yu, Dusan Jakovetic, Soummya Kar. arXiv preprint arXiv:2505.03736. 2025.

High-probability Convergence Bounds for Online Nonlinear Stochastic Gradient Descent Under Heavy-tailed Noise. Aleksandar Armacki, Shuhua Yu, Pranay Sharma, Gauri Joshi, Dragana Bajovic, Dusan Jakovetic, Soummya Kar. International Conference on Artificial Intelligence and Statistics (AISTATS), 2025.

Distributed Sign Momentum with Local Steps for Training Transformers. Shuhua Yu, Ding Zhou, Cong Xie, An Xu, Zhi Zhang, Xin Liu, Soummya Kar. arXiv preprint arXiv:2411.17866, 2024. [code]

Large Deviations and Improved Mean-squared Error Rates of Nonlinear SGD: Heavy-tailed Noise and Power of Symmetry. Aleksandar Armacki*, Shuhua Yu*, Dragana Bajovic, Dusan Jakovetic, Soummya Kar. arXiv preprint arXiv:2410.15637, under revision for SIAM Journal on Optimization. 2024.

Smoothed Gradient Clipping and Error Feedback for Distributed Optimization under Heavy-Tailed Noise. Shuhua Yu, Dusan Jakovetic, Soummya Kar. arXiv preprint arXiv:2310.16920, Under review for SIAM Journal on Optimization, 2023. [INFORMS 24’ slides]

Revisiting Image Classifier Training for Improved Certified Robust Defense against Adversarial Patches. Aniruddha Saha*, Shuhua Yu*, Arash Norouzzadeh, Wan-Yi Lin, Chaithanya Kumar Mummadi. Transactions on Machine Learning Research, 2023.

Secure Distributed Optimization Under Gradient Attacks. Shuhua Yu, Soummya Kar. IEEE Transactions on Signal Processing 71, 1802-1816, 2023. [MOPTA 23’ slides]

Dynamic Median Consensus Over Random Networks. Shuhua Yu, Yuan Chen, Soummya Kar. IEEE Conference on Decision and Control (CDC), 2021. [slides]

Resilient Decentralized Optimization in Multi-agent Networks with Data Injection Attack. Shuhua Yu, Yuan Chen, Soummya Kar. IEEE Asilomar Conference on Signals, Systems, and Computers (ACSSC), 2021.

An Alternating Minimization Approach to Optimizing Subarray Configuration for Large Phased Array. Wenqiang Pu, Yang Yu, Shuhua Yu, Zhi-Quan Luo. IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM), 2018.