Publications

N. Konstantinov, C. H. Lampert. Fairness-Aware PAC Learning from Corrupted Data. JMLR 23 (2022) 1-60	B. Prach, C. H. Lampert. Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks. ECCV 2022	M. Mondelli, and R. Venkataramanan, “Approximate Message Passing with Spectral Initialization for Generalized Linear Models”,STAT 2022	A. Shevchenko, V. Kungurtsev, and M. Mondelli, “Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks”, JMLR 2022
Paper	Paper	Paper	Paper
	Project

R. Venkataramanan, K. Kögler, and M. Mondelli, “Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passing”, ICML 2022	D. Fathollahi and M. Mondelli, “Polar Coded Computing: The Role of the Scaling Exponent”, ISIT 2022
Paper	Paper

2021

AC/DC: ALTERNATING COMPRESSED/DECOMPRESSED TRAINING OF DEEP NEURAL NETWORKS NeurIPS 2021 Peste, Iofinova, Vladu, Alistarh	DISTRIBUTED PRINCIPAL COMPONENT ANALYSIS WITH LIMITED COMMUNICATION NeurIPS 2021 Alimisis, Davies, Vandereycken, Alistarh	WHEN ARE SOLUTIONS CONNECTED IN DEEP NETWORKS? NeurIPS 2021 Nguyen  Bréchet  Mondelli	M-FAC: EFFICIENT MATRIX-FREE APPROXIMATIONS OF SECOND-ORDER INFORMATION NeurIPS 2021 Frantar  Kurtic  Alistarh
Project Paper	Project Paper		Project Paper
The Inductive Bias of RELU networks on orthogonally separable Data ICLR 2021 Phuong, Lampert	BYZANTINE-RESILIENT NON-CONVEX STOCHASTIC GRADIENT DESCENT ICLR 2021 Allen-Zhu, Ebrahimian, Li, Alistarh	TOWARDS TIGHT COMMUNICATION LOWER BOUNDS FOR DISTRIBUTED OPTIMIZATION NeurIPS 2021 Korhonen  Alistarh	FULLY-ASYNCHRONOUS DECENTRALIZED SGD WITH QUANTIZED AND LOCAL UPDATES NeurIPS 2021 Nadiradze, Sabour, Davies, Li, Alistarh
Project Paper	Project Paper	Project Paper	Project Paper
PCA INITIALIZATION FOR APPROXIMATE MESSAGE PASSING IN ROTATIONALLY INVARIANT MODELS NeurIPS 2021 Mondelli, Venkataramanan	APPROXIMATE MESSAGE PASSING WITH SPECTRAL INITIALIZATION FOR GENERALIZED LINEAR MODELS AISTATS 2021 Mondelli, Venkataramanan	TIGHT BOUNDS ON THE SMALLEST EIGENVALUE OF THE NEURAL TANGENT KERNEL FOR DEEP RELU NETWORKS ICML 2021 Nguyen, Mondelli, Montufar	ONE-SIDED FRANK-WOLFE ALGORITHMS FOR SADDLE PROBLEMS ICML 2021 Kolmogorov, Pock
Paper	Paper	Paper	Paper
COMMUNICATION-EFFICIENT DISTRIBUTED OPTIMIZATION WITH QUANTIZED PRECONDITIONERS ICML 2021 Alimisis, Davies, Alistarh	GENOMIC ARCHITECTURE AND PREDICTION OF CENSORED TIME-TO-EVENT PHENOTYPES WITH A BAYESIAN GENOME-WIDE ANALYSIS Nature Communications Ojavee, Robinson	PARALLELISM VERSUS LATENCY IN SIMPLIFIED SUCCESSIVE-CANCELLATION DECODING OF POLAR CODES ISIT 2021 Hashemi, Mondelli, Fazeli, Vardy, Cioffi, Goldsmith	SPARSE MULTI-DECODER RECURSIVE PROJECTION AGGREGATION FOR REED-MULLER CODES ISIT 2021 Fathollahi, Farsad, Hashemi, Mondelli
Project Paper	Project Paper	Paper	Paper
NEW BOUNDS FOR DISTRIBUTED MEAN ESTIMATION AND VARIANCE REDUCTION ICLR 2021 Davies, Gurunanthan, Moshrefi, Ashkboos, Alistarh Project Paper OPTIMAL COMBINATION OF LINEAR AND SPECTRAL ESTIMATORS FOR GENERALIZED LINEAR MODELS Foundations of Computational Mathematics Mondelli, Thrampoulidis Venkataramanan Paper	ELASTIC CONSISTENCY: A PRACTICAL CONSISTENCY MODEL FOR DISTRIBUTED STOCHASTIC GRADIENT DESCENT AAAI 2021 Nadiradze, Markov, Chatterjee, Kungurtsev, Alistarh Project Paper	SPARSITY IN DEEP LEARNING: PRUNING AND GROWTH FOR EFFICIENT INFERENCE AND TRAINING IN NEURAL NETWORKS JMLR Hoefler, Alistarh, Ben-Nun, Dryden, Peste Project Paper	SUBLINEAR LATENCY FOR SIMPLIFIED SUCCESSIVE CANCELLATION DECODING OF POLAR CODES IEEE Transactions on Wireless Communications Mondelli, Hashemi, Cioffi, Goldsmith Paper

2020

GLOBAL CONVERGENCE OF DEEP NETWORKS WITH ONE WIDE LAYER FOLLOWED BY PYRAMIDAL TOPOLOGY NeurIPS 2020 Nguyen, Mondelli Paper	WOODFISHER: EFFICIENT SECOND-ORDER APPROXIMATION FOR NEURAL NETWORK COMPRESSION NeurIPS 2020 Singh, Alistarh Project Paper	RELAXED SCHEDULING FOR SCALABLE BELIEF PROPAGATION NeurIPS 2020 Aksenov, Alistarh   Project Paper	UNSUPERVISED OBJECT-CENTRIC VIDEO GENERATION AND DECOMPOSITION IN 3D NeurIPS 2020 Henderson, Lampert Project Paper
COMPUTATIONAL DESIGN OF COLD BENT GLASS FAÇADES ACM Transactions on Graphics 39(6) (SIGGRAPH Asia 2020) Gavriil, Guseinov, Pérez, Pellis Henderson, Rist, Pottmann, Bickel Paper	BINARY LINEAR CODES WITH OPTIMAL SCALING: POLAR CODES WITH LARGE KERNELS IEEE Transactions on Information Theory Fazeli, Hassani, Mondelli, Vardy Paper	DOES SGD IMPLICITLY OPTIMIZE FOR SMOOTHNESS? GCPR 2020 Volhejn, Lampert Paper	LANDSCAPE CONNECTIVITY AND DROPOUT STABILITY OF SGD SOLUTIONS FOR OVER-PARAMETERIZED NEURAL NETWORKS ICML 2020 Shevchenko, Mondelli Paper
ON THE SAMPLE COMPLEXITY OF ADVERSARIAL MULTI-SOURCE PAC LEARNING ICML 2020 Konstantinov, Frantar, Alistarh, Lampert Paper	PROBABILISTIC INFERENCE OF THE GENETIC ARCHITECTURE OF FUNCTIONAL ENRICHMENT OF COMPLEX TRAITS medRxiv Patxot, Robinson Project Paper	BAYESIAN REASSESSMENT OF THE EPIGENETIC ARCHITECTURE OF COMPLEX TRAITS Nature Communications Trejo Banos, Robinson Paper	FUNCTIONAL VS. PARAMETRIC EQUIVALENCE OF RELU NETWORKS ICLR 2020 Phuong, Lampert Paper
LOCALIZING GROUPED INSTANCES FOR EFFICIENT DETECTION IN LOW-RESOURCE SCENARIOS WACV 2020 Royer, Lampert Project Paper	ANALYSIS OF A TWO-LAYER NEURAL NETWORK VIA DISPLACEMENT CONVEXITY Annals of Statistics Javanmard, Mondelli, Montanari Paper	A FLEXIBLE SELECTION SCHEME FOR MINIMUM-EFFORT TRANSFER LEARNING WACV 2020 Royer, Lampert Project Paper