| Fri Sep 03 |
Understanding the difficulty of training deep feedforward neural networks , Glorot, Bengio; 2010 |
Review both summaries |
| Sun Sep 12 |
Large-Scale Machine Learning with Stochastic Gradient Descent , Bottou; 2010 |
Coding |
| Wed Sep 15 |
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks , Salimans, Kingma; 2016 |
Draft Summary |
| Sun Sep 19 |
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks , Salimans, Kingma; 2016 |
Final Summary |
| Wed Sep 22 |
Attention Is All You Need , Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin; 2017 |
Draft Summary |
| Sun Sep 26 |
Attention Is All You Need , Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser, Polosukhin; 2017 |
Final Summary |
| Fri Oct 01 |
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context , Dai, Yang, Yang, Carbonell, Le, Salakhutdinov; 2019 |
Review both summaries |
| Sun Oct 10 |
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , Dosovitskiy, Beyer, Kolesnikov, Weissenborn, Zhai, Unterthiner, Dehghani, Minderer, Heigold, Gelly, Uszkoreit, Houlsby; 2020 |
Coding |
| Wed Oct 13 |
Implicit Geometric Regularization for Learning Shapes , Gropp, Yariv, Haim, Atzmon, Lipman; 2020 |
Draft Summary |
| Sun Oct 17 |
Implicit Geometric Regularization for Learning Shapes , Gropp, Yariv, Haim, Atzmon, Lipman; 2020 |
Final Summary |
| Wed Oct 20 |
Mask R-CNN , He, Gkioxari, Dollár, Girshick; 2017 |
Draft Summary |
| Sun Oct 24 |
Mask R-CNN , He, Gkioxari, Dollár, Girshick; 2017 |
Final Summary |
| Fri Oct 29 |
PointNet: Deep Learning on Point Sets for 3D Classification and |
|
| Segmentation , Qi, Su, Mo, Guibas; 2016 |
Review both summaries |
|
| Sun Nov 07 |
Momentum Contrast for Unsupervised Visual Representation Learning , He, Fan, Wu, Xie, Girshick; 2019 |
Coding |