Levent Sagun
Levent Sagun
Facebook AI Research
Verified email at fb.com - Homepage
Title
Cited by
Cited by
Year
Entropy-sgd: Biasing gradient descent into wide valleys
P Chaudhari, A Choromanska, S Soatto, Y LeCun, C Baldassi, C Borgs, ...
arXiv preprint arXiv:1611.01838, 2016
4312016
Searchqa: A new q&a dataset augmented with context from a search engine
M Dunn, L Sagun, M Higgins, VU Guney, V Cirik, K Cho
arXiv preprint arXiv:1704.05179, 2017
2422017
Empirical analysis of the hessian of over-parametrized neural networks
L Sagun, U Evci, VU Guney, Y Dauphin, L Bottou
arXiv preprint arXiv:1706.04454, 2017
1852017
Eigenvalues of the hessian in deep learning: Singularity and beyond
L Sagun, L Bottou, Y LeCun
arXiv preprint arXiv:1611.07476, 2016
124*2016
Scaling description of generalization with number of parameters in deep learning
M Geiger, A Jacot, S Spigler, F Gabriel, L Sagun, S d’Ascoli, G Biroli, ...
Journal of Statistical Mechanics: Theory and Experiment 2020 (2), 023401, 2020
1022020
A jamming transition from under-to over-parametrization affects generalization in deep learning
S Spigler, M Geiger, S d’Ascoli, L Sagun, G Biroli, M Wyart
Journal of Physics A: Mathematical and Theoretical 52 (47), 474001, 2019
97*2019
A tail-index analysis of stochastic gradient noise in deep neural networks
U Simsekli, L Sagun, M Gurbuzbalaban
International Conference on Machine Learning, 5827-5837, 2019
882019
Jamming transition as a paradigm to understand the loss landscape of deep neural networks
M Geiger, S Spigler, S d'Ascoli, L Sagun, M Baity-Jesi, G Biroli, M Wyart
Physical Review E 100 (1), 012115, 2019
862019
Energy landscapes for machine learning
AJ Ballard, R Das, S Martiniani, D Mehta, L Sagun, JD Stevenson, ...
Physical Chemistry Chemical Physics 19 (20), 12585-12603, 2017
852017
Comparing dynamics: Deep neural networks versus glassy systems
M Baity-Jesi, L Sagun, M Geiger, S Spigler, GB Arous, C Cammarota, ...
International Conference on Machine Learning, 314-323, 2018
722018
Explorations on high dimensional landscapes
L Sagun, VU Guney, GB Arous, Y LeCun
arXiv preprint arXiv:1412.6615, 2014
582014
Convit: Improving vision transformers with soft convolutional inductive biases
S d'Ascoli, H Touvron, M Leavitt, A Morcos, G Biroli, L Sagun
arXiv preprint arXiv:2103.10697, 2021
302021
Early Predictability of Asylum Court Decisions
M Dunn, H Sirin, L Sagun, D Chen
24*2017
Triple descent and the two kinds of overfitting: Where & why do they appear?
S d'Ascoli, L Sagun, G Biroli
arXiv preprint arXiv:2006.03509, 2020
202020
Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias
S d'Ascoli, L Sagun, J Bruna, G Biroli
arXiv preprint arXiv:1906.06766, 2019
112019
Universal halting times in optimization and machine learning
L Sagun, T Trogdon, Y LeCun
arXiv preprint arXiv:1511.06444, 2015
10*2015
Easing non-convex optimization with neural networks
D Lopez-Paz, L Sagun
52018
On the Heavy-Tailed Theory of Stochastic Gradient Descent for Deep Neural Networks
U Şimşekli, M Gürbüzbalaban, TH Nguyen, G Richard, L Sagun
arXiv preprint arXiv:1912.00018, 2019
22019
Transformed CNNs: recasting pre-trained convolutional layers with self-attention
S d'Ascoli, L Sagun, G Biroli, A Morcos
arXiv preprint arXiv:2106.05795, 2021
12021
Neural relational autoregression for high-resolution COVID-19 forecasting
M Le, M Ibrahim, L Sagun, T Lacroix, M Nickel
Facebook AI Research, 2020
12020
The system can't perform the operation now. Try again later.
Articles 1–20