Nitish Shirish Keskar
Nitish Shirish Keskar
Salesforce Research
Verified email at salesforce.com - Homepage
TitleCited byYear
On large-batch training for deep learning: Generalization gap and sharp minima
NS Keskar, D Mudigere, J Nocedal, M Smelyanskiy, PTP Tang
arXiv preprint arXiv:1609.04836, 2016
5202016
Regularizing and optimizing LSTM language models
S Merity, NS Keskar, R Socher
arXiv preprint arXiv:1708.02182, 2017
2332017
Improving generalization performance by switching from adam to sgd
NS Keskar, R Socher
arXiv preprint arXiv:1712.07628, 2017
552017
An analysis of neural language modeling at multiple scales
S Merity, NS Keskar, R Socher
arXiv preprint arXiv:1803.08240, 2018
432018
The natural language decathlon: Multitask learning as question answering
B McCann, NS Keskar, C Xiong, R Socher
arXiv preprint arXiv:1806.08730, 2018
382018
Weighted transformer network for machine translation
K Ahmed, NS Keskar, R Socher
arXiv preprint arXiv:1711.02132, 2017
232017
adaqn: An adaptive quasi-newton algorithm for training rnns
NS Keskar, AS Berahas
Joint European Conference on Machine Learning and Knowledge Discovery in …, 2016
182016
Balancing communication and computation in distributed optimization
A Berahas, R Bollapragada, NS Keskar, E Wei
IEEE Transactions on Automatic Control, 2018
162018
A second-order method for convex 1-regularized optimization with active-set prediction
N Keskar, J Nocedal, F Öztoprak, A Waechter
Optimization Methods and Software 31 (3), 605-621, 2016
122016
Identifying generalization properties in neural networks
H Wang, NS Keskar, C Xiong, R Socher
arXiv preprint arXiv:1809.07402, 2018
102018
A nonmonotone learning rate strategy for SGD training of deep neural networks
NS Keskar, G Saon
2015 IEEE International Conference on Acoustics, Speech and Signal …, 2015
82015
A limited-memory quasi-Newton algorithm for bound-constrained non-smooth optimization
N Keskar, A Wächter
Optimization Methods and Software 34 (1), 150-171, 2019
72019
Coarse-grain fine-grain coattention network for multi-evidence question answering
V Zhong, C Xiong, NS Keskar, R Socher
arXiv preprint arXiv:1901.00603, 2019
32019
Using mode connectivity for loss landscape analysis
A Gotmare, NS Keskar, C Xiong, R Socher
arXiv preprint arXiv:1806.06977, 2018
22018
Unifying Question Answering and Text Classification via Span Extraction
NS Keskar, B McCann, C Xiong, R Socher
arXiv preprint arXiv:1904.09286, 2019
12019
A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation
A Gotmare, NS Keskar, C Xiong, R Socher
arXiv preprint arXiv:1810.13243, 2018
12018
Hybrid training of deep networks
NS Keskar, R Socher
US Patent App. 15/926,768, 2019
2019
XLDA: Cross-Lingual Data Augmentation for Natural Language Inference and Question Answering
J Singh, B McCann, NS Keskar, C Xiong, R Socher
arXiv preprint arXiv:1905.11471, 2019
2019
Sequence-to-sequence prediction using a neural network model
NS Keskar, K Ahmed, R Socher
US Patent App. 15/884,125, 2019
2019
Scalable Language Modeling: WikiText-103 on a Single GPU in 12 hours
S Merity, NS Keskar, J Bradbury, R Socher
2018
The system can't perform the operation now. Try again later.
Articles 1–20