Samy Bengio

Most-cited papers

Density estimation using Real NVP
Laurent Dinh, Jascha Narain Sohl-Dickstein, Samy Bengio
2016International Conference on Learning Representations4,695 citations
Semantic Scholar
Understanding deep learning (still) requires rethinking generalization
Chiyuan Zhang, Samy Bengio, Moritz Hardt, B. Recht +1 more
2021Communications of the ACM2,908 citations Open access
Semantic Scholar
Tacotron: Towards End-to-End Speech Synthesis
Yuxuan Wang, R. Skerry-Ryan, Daisy Stanton, Yong-Hui Wu +10 more
2017Interspeech2,113 citations
Semantic Scholar
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks
Wei-Lin Chiang, Xuanqing Liu, Si Si, Yang Li +2 more
2019Knowledge Discovery and Data Mining1,639 citations Open access
Semantic Scholar
Transfusion: Understanding Transfer Learning for Medical Imaging
M. Raghu, Chiyuan Zhang, J. Kleinberg, Samy Bengio
2019Neural Information Processing Systems1,392 citations
Semantic Scholar
Sharp Minima Can Generalize For Deep Nets
Laurent Dinh, Razvan Pascanu, Samy Bengio, Yoshua Bengio
2017International Conference on Machine Learning970 citations
Semantic Scholar
Revisiting Distributed Synchronous SGD
Xing-Hao Pan, Jian-Min Chen, Rajat Monga, Samy Bengio +1 more
2016arXiv.org860 citations
Semantic Scholar
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML
Aniruddh Raghu, M. Raghu, Samy Bengio, O. Vinyals
2019International Conference on Learning Representations774 citations
Semantic Scholar
Fantastic Generalization Measures and Where to Find Them
Yiding Jiang, Behnam Neyshabur, Dilip Krishnan, H. Mobahi +1 more
2019International Conference on Learning Representations761 citations
Semantic Scholar
GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
Iman Mirzadeh, Keivan Alizadeh-Vahid, Hooman Shahrokhi, O. Tuzel +2 more
2024International Conference on Learning Representations719 citations
Semantic Scholar
Insights on representational similarity in neural networks with canonical correlation
Ari S. Morcos, M. Raghu, Samy Bengio
2018Neural Information Processing Systems594 citations
Semantic Scholar
Tensor2Tensor for Neural Machine Translation
Ashish Vaswani, Samy Bengio, E. Brevdo, François Chollet +9 more
2018Conference of the Association for Machine Translation in the Americas556 citations
Semantic Scholar
The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
P. Shojaee, Iman Mirzadeh, Keivan Alizadeh-Vahid, Maxwell Horton +2 more
2025Neural Information Processing Systems526 citations
Semantic Scholar
Device Placement Optimization with Reinforcement Learning
Azalia Mirhoseini, Hieu Pham, Quoc V. Le, Benoit Steiner +6 more
2017International Conference on Machine Learning502 citations
Semantic Scholar
A Study on Overfitting in Deep Reinforcement Learning
Chiyuan Zhang, O. Vinyals, R. Munos, Samy Bengio
2018arXiv.org445 citations
Semantic Scholar
Learning to Remember Rare Events
Lukasz Kaiser, Ofir Nachum, Aurko Roy, Samy Bengio
2017International Conference on Learning Representations387 citations
Semantic Scholar
Adversarial Attacks and Defences Competition
Alexey Kurakin, I. Goodfellow, Samy Bengio, Yin-Peng Dong +19 more
2018arXiv.org366 citations Open access
Semantic Scholar
Unsupervised Speech Representation Learning Using WaveNet Autoencoders
J. Chorowski, Ron J. Weiss, Samy Bengio, A. van den Oord
2019IEEE/ACM Transactions on Audio Speech and Language Processing342 citations Open access
Semantic Scholar
Large Margin Deep Networks for Classification
G. Elsayed, Dilip Krishnan, H. Mobahi, Kevin Regan +1 more
2018Neural Information Processing Systems336 citations
Semantic Scholar
Reward Augmented Maximum Likelihood for Neural Structured Prediction
Mohammad Norouzi, Samy Bengio, Z. Chen, N. Jaitly +3 more
2016Neural Information Processing Systems273 citations
Semantic Scholar
Fast Decoding in Sequence Models using Discrete Latent Variables
Łukasz Kaiser, Aurko Roy, Ashish Vaswani, N. Parmar +3 more
2018International Conference on Machine Learning260 citations
Semantic Scholar
Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model
Yuxuan Wang, R. Skerry-Ryan, Daisy Stanton, Yong-Hui Wu +10 more
2017arXiv.org255 citations
Semantic Scholar
Characterising Bias in Compressed Models
Sara Hooker, Nyalleng Moorosi, Gregory Clark, Samy Bengio +1 more
2020arXiv.org228 citations
Semantic Scholar
Predicting the Generalization Gap in Deep Networks with Margin Distributions
Yiding Jiang, Dilip Krishnan, H. Mobahi, Samy Bengio
2018International Conference on Learning Representations228 citations
Semantic Scholar
What Algorithms can Transformers Learn? A Study in Length Generalization
Hattie Zhou, Arwen Bradley, Etai Littwin, Noam Razin +4 more
2023International Conference on Learning Representations224 citations
Semantic Scholar
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
Yang Li, Si Si, Gang Li, Cho-Jui Hsieh +1 more
2021Neural Information Processing Systems174 citations
Semantic Scholar
Are All Layers Created Equal?
Chiyuan Zhang, Samy Bengio, Y. Singer
2019Journal of machine learning research172 citations
Semantic Scholar
Context-Aware Captions from Context-Agnostic Supervision
Ramakrishna Vedantam, Samy Bengio, Kevin P. Murphy, Devi Parikh +1 more
2017Computer Vision and Pattern Recognition153 citations Open access
Semantic Scholar
Content preserving text generation with attribute controls
Lajanugen Logeswaran, Honglak Lee, Samy Bengio
2018Neural Information Processing Systems123 citations
Semantic Scholar
You Look Twice: GaterNet for Dynamic Filter Selection in CNNs
Zhou-Rong Chen, Yang Li, Samy Bengio, Si Si
2018Computer Vision and Pattern Recognition113 citations Open access
Semantic Scholar
Identity Crisis: Memorization and Generalization under Extreme Overparameterization
Chiyuan Zhang, Samy Bengio, Moritz Hardt, M. Mozer +1 more
2019International Conference on Learning Representations98 citations
Semantic Scholar
Transfusion: Understanding Transfer Learning with Applications to Medical Imaging
M. Raghu, Chiyuan Zhang, Jon M. Kleinberg, Samy Bengio
2019arXiv.org96 citations
Semantic Scholar
Semantic Redundancies in Image-Classification Datasets: The 10% You Don't Need
Vighnesh Birodkar, H. Mobahi, Samy Bengio
2019arXiv.org93 citations
Semantic Scholar
Generalization on the Unseen, Logic Reasoning and Degree Curriculum
Emmanuel Abbe, Samy Bengio, Aryo Lotfi, Kevin Rizk
2023International Conference on Machine Learning83 citations Open access
Semantic Scholar
Time-Dependent Representation for Neural Event Sequence Prediction
Yang Li, Nan Du, Samy Bengio
2017International Conference on Learning Representations65 citations
Semantic Scholar
Neural Networks Trained on Natural Scenes Exhibit Gestalt Closure
Been Kim, Emily Reif, M. Wattenberg, Samy Bengio +1 more
2021Computational Brain & Behavior62 citations Open access
Semantic Scholar
Transformers learn through gradual rank increase
Enric Boix-Adserà, Etai Littwin, Emmanuel Abbe, Samy Bengio +1 more
2023Neural Information Processing Systems61 citations Open access
Semantic Scholar
NeurIPS 2020 Competition: Predicting Generalization in Deep Learning
Yiding Jiang, Pierre Foret, Scott Yak, Daniel M. Roy +6 more
2020arXiv.org59 citations
Semantic Scholar
Discrete Autoencoders for Sequence Models
Lukasz Kaiser, Samy Bengio
2018arXiv.org55 citations
Semantic Scholar
How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad
Emmanuel Abbé, Samy Bengio, Aryo Lotfi, Colin Sandon +1 more
2024Neural Information Processing Systems53 citations Open access
Semantic Scholar
N-gram Language Modeling using Recurrent Neural Network Estimation
Ciprian Chelba, Mohammad Norouzi, Samy Bengio
2017arXiv.org50 citations
Semantic Scholar
Predicting Human Performance in Vertical Menu Selection Using Deep Learning
Yang Li, Samy Bengio, Gilles Bailly
2018International Conference on Human Factors in Computing Systems40 citations Open access
Semantic Scholar
Extreme Classification (Dagstuhl Seminar 18291)
Samy Bengio, K. Dembczynski, T. Joachims, M. Kloft +1 more
2018Dagstuhl Reports37 citations
Semantic Scholar
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization
Chiyuan Zhang, M. Raghu, J. Kleinberg, Samy Bengio
2021arXiv.org36 citations
Semantic Scholar
Memory Based Trajectory-conditioned Policies for Learning from Sparse Rewards
Yi-Jie Guo, Jongwook Choi, Marcin Moczulski, Shengyu Feng +3 more
2020Neural Information Processing Systems36 citations
Semantic Scholar
Do Neural Networks Show Gestalt Phenomena? An Exploration of the Law of Closure
Been Kim, Emily Reif, M. Wattenberg, Samy Bengio
2019arXiv.org35 citations
Semantic Scholar
ADIOS: Architectures Deep In Output Space
M. Cissé, Maruan Al-Shedivat, Samy Bengio
2016International Conference on Machine Learning29 citations
Semantic Scholar
Area Attention
Yang Li, Lukasz Kaiser, Samy Bengio, Si Si
2018International Conference on Machine Learning27 citations
Semantic Scholar
Parallel Scheduled Sampling
Daniel Duckworth, Arvind Neelakantan, Ben Goodrich, Lukasz Kaiser +1 more
2019arXiv.org25 citations
Semantic Scholar
When can transformers reason with abstract symbols?
Enric Boix-Adserà, O. Saremi, Emmanuel Abbé, Samy Bengio +2 more
2023International Conference on Learning Representations24 citations
Semantic Scholar