Publications

N. Konstantinov, C. H. Lampert. Fairness-Aware PAC Learning from Corrupted Data. JMLR 23 (2022) 1-60	.	.	.
Paper
			

2021

AC/DC: ALTERNATING COMPRESSED/DECOMPRESSED TRAINING OF DEEP NEURAL NETWORKS NeurIPS 2021 Peste, Iofinova, Vladu, Alistarh	DISTRIBUTED PRINCIPAL COMPONENT ANALYSIS WITH LIMITED COMMUNICATION NeurIPS 2021 Alimisis, Davies, Vandereycken, Alistarh	WHEN ARE SOLUTIONS CONNECTED IN DEEP NETWORKS? NeurIPS 2021 Nguyen  Bréchet  Mondelli	M-FAC: EFFICIENT MATRIX-FREE APPROXIMATIONS OF SECOND-ORDER INFORMATION NeurIPS 2021 Frantar  Kurtic  Alistarh
Project Paper	Project Paper		Project Paper
The Inductive Bias of RELU networks on orthogonally separable Data ICLR 2021 Phuong, Lampert	BYZANTINE-RESILIENT NON-CONVEX STOCHASTIC GRADIENT DESCENT ICLR 2021 Allen-Zhu, Ebrahimian, Li, Alistarh	TOWARDS TIGHT COMMUNICATION LOWER BOUNDS FOR DISTRIBUTED OPTIMIZATION NeurIPS 2021 Korhonen  Alistarh	FULLY-ASYNCHRONOUS DECENTRALIZED SGD WITH QUANTIZED AND LOCAL UPDATES NeurIPS 2021 Nadiradze, Sabour, Davies, Li, Alistarh
Project Paper	Project Paper	Project Paper	Project Paper
PCA INITIALIZATION FOR APPROXIMATE MESSAGE PASSING IN ROTATIONALLY INVARIANT MODELS NeurIPS 2021 Mondelli, Venkataramanan	APPROXIMATE MESSAGE PASSING WITH SPECTRAL INITIALIZATION FOR GENERALIZED LINEAR MODELS AISTATS 2021 Mondelli, Venkataramanan	TIGHT BOUNDS ON THE SMALLEST EIGENVALUE OF THE NEURAL TANGENT KERNEL FOR DEEP RELU NETWORKS ICML 2021 Nguyen, Mondelli, Montufar	ONE-SIDED FRANK-WOLFE ALGORITHMS FOR SADDLE PROBLEMS ICML 2021 Kolmogorov, Pock
Paper	Paper	Paper	Paper
COMMUNICATION-EFFICIENT DISTRIBUTED OPTIMIZATION WITH QUANTIZED PRECONDITIONERS ICML 2021 Alimisis, Davies, Alistarh	GENOMIC ARCHITECTURE AND PREDICTION OF CENSORED TIME-TO-EVENT PHENOTYPES WITH A BAYESIAN GENOME-WIDE ANALYSIS Nature Communications Ojavee, Robinson	PARALLELISM VERSUS LATENCY IN SIMPLIFIED SUCCESSIVE-CANCELLATION DECODING OF POLAR CODES ISIT 2021 Hashemi, Mondelli, Fazeli, Vardy, Cioffi, Goldsmith	SPARSE MULTI-DECODER RECURSIVE PROJECTION AGGREGATION FOR REED-MULLER CODES ISIT 2021 Fathollahi, Farsad, Hashemi, Mondelli
Project Paper	Project Paper	Paper	Paper
NEW BOUNDS FOR DISTRIBUTED MEAN ESTIMATION AND VARIANCE REDUCTION ICLR 2021 Davies, Gurunanthan, Moshrefi, Ashkboos, Alistarh Project Paper	ELASTIC CONSISTENCY: A PRACTICAL CONSISTENCY MODEL FOR DISTRIBUTED STOCHASTIC GRADIENT DESCENT AAAI 2021 Nadiradze, Markov, Chatterjee, Kungurtsev, Alistarh Project Paper	SPARSITY IN DEEP LEARNING: PRUNING AND GROWTH FOR EFFICIENT INFERENCE AND TRAINING IN NEURAL NETWORKS JMLR Hoefler, Alistarh, Ben-Nun, Dryden, Peste Project Paper	SUBLINEAR LATENCY FOR SIMPLIFIED SUCCESSIVE CANCELLATION DECODING OF POLAR CODES IEEE Transactions on Wireless Communications Mondelli, Hashemi, Cioffi, Goldsmith Paper