Reading Group - Gatech-Flash/NLP GitHub Wiki
Time: 1:00 PM - 2:00 PM Wed
Location: Online https://bluejeans.com/5341114422
Topic
I just list some related papers, you are welcome to present your own papers and post other related papers
BERT
ICLR 2020 BERT submission: link
Low Resource NLP
NER
Machine Translation
Schedule— 2020 Fall
| Date | Moderator | Topic / Paper |
|---|---|---|
| 07/01 | Haoming Jiang | Generative Data Augmentation for Commonsense Reasoning pdf |
Schedule -- 2020 Summer
| Date | Moderator | Topic / Paper |
|---|---|---|
| 07/01 | Haoming Jiang | How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation pdf |
| Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses pdf | ||
| Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems pdf | ||
| Towards a Human-like Open-Domain Chatbot pdf | ||
| 07/01 | Lingkai Kong | Uncertainty-aware Self-training for Text Classification with Few Labels pdf |
| Siawpeng Er | Biomedical Entity Representations with Synonym Marginalization pdf | |
| Siawpeng Er | Hopfield Network is All You Need pdf | |
| 09/08 | Siawpeng Er | Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answering pdf |
| 07/08 | Yinghao Li | Tree-structured Attention with Hierarchical Accumulation pdf |
| 07/08 | Chen Liang | Pay Less Attention with Lightweight and Dynamic Convolutionspdf |
| Lite Transformer with Long-Short Range Attentionpdf | ||
| Synthesizer: Rethinking Self-Attention in Transformer Modelspdf | ||
| Hard-Coded Gaussian Attention for Neural Machine Translationpdf | ||
| 07/22 | Wendi Ren | BERT-of-Theseus: Compressing BERT by Progressive Module Replacingpdf |
| K-ADAPTER: Infusing Knowledge into Pre-Trained Models with Adapterspdf | ||
| 07/29 | Simiao Zuo | Tensorized Embedding Layers pdf |
| Multi-Head Attention: Collaborate Instead of Concatenate pdf | ||
| A Tensorized Transformer for Language Modeling pdf | ||
| 07/29 | Yue Yu | A Unified MRC Framework for Named Entity Recognition pdf |
| Description Based Text Classification with Reinforcement Learning pdf | ||
| 08/05 | Zhenghui Wang | TuckER: Tensor Factorization for Knowledge Graph Completion pdf |
| Generalizing Tensor Decomposition for N-ary Relational Knowledge Bases pdf |
Schedule -- 2020 Spring
| Date | Moderator | Topic / Paper |
|---|---|---|
| 02/19 | Jiacheng Yang | Deep Reinforcement Learning for Dialogue Generation pdf |
| 02/26 | Yujia Xie | Sequence-to-Sequence Learning as Beam-Search Optimization pdf |
| 02/26 | Yue Yu | NLNL: Negative Learning for Noisy Labels (ICCV'19) pdf |
| 03/04 | Haoming Jiang | SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization pdf |
| 03/11 | Chen Liang | Reformer: The Efficient Transformer pdf |
| 03/11 | Zhehui Chen | On Feature Normalization and Data Augmentation pdf |
| 03/18 | Siawpeng Er | Depth-Adaptive Transformer pdf |
| 04/01 | Haoming Jiang | BREAKING THE SOFTMAX BOTTLENECK: A HIGH-RANK RNN LANGUAGE MODEL pdf |
| Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities pdf | ||
| Sigsoftmax: Reanalysis of the Softmax Bottleneck Sekitoshi pdf | ||
| Mixtape: Breaking the Softmax Bottleneck Efficiently pdf | ||
| 04/08 | Yue Yu | Self-training with Noisy Student improves ImageNet classification pdf |
| 04/22 | Chen Liang | Rethinking Batch Normalization in Transformers pdf |
| How Does Batch Normalization Help Optimization? pdf | ||
| Root Mean Square Layer Normalization pdf | ||
| 04/29 | Siawpeng Er | Longformer: The Long-Document Transformer pdf |
| 05/06 | Yue Yu | Smooth Neighbors on Teacher Graphs for Semi-supervised Learning pdf |
Schedule -- 2019 Fall
| Date | Moderator | Topic / Paper |
|---|---|---|
| 08/28 | Haoming Jiang | Universal Neural Machine Translation for Extremely Low Resource Languages pdf |
| 08/28 | Lingkai Kong | Augmenting Neural Networks with First-order Logic (ACL'19) pdf Harnessing Deep Neural Networks with Logic Rules (ACL'16) pdf |
| 09/04 | Yue Yu | Learning Named Entity Tagger using Domain-Specific Dictionary (EMNLP'18) pdf |
| 09/04 | Yi Rong | Meta-Learning for Low-Resource Neural Machine Translation pdf |
| 09/11 | Rui Feng | Deep Compositional Question Answering with Neural Module Networks pdf |
| 09/11 | Chen Liang | Phrase-Based & Neural Unsupervised Machine Translation pdf |
| 09/18 | Siawpeng Er | Massively Multilingual Neural Machine Translation pdf |
| 09/25 | Yan Li | Transformer Dissection: An Unified Understanding for Transformer's Attention via the Lens of Kernel pdf |
| 09/25 | Simiao Zuo | A Compact and Language-Sensitive Multilingual Translation Method pdf |
| 10/02 | Yue Yu | Neural Rule Grounding for Low-Resource Relation Extraction (arXiv preprint 1909.02177) pdf |
| 10/02 | Lingkai Kong | The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision pdf |
| 10/09 | Chen Liang | RoBERTa: A Robustly Optimized BERT Pretraining Approach pdf & ALBERT: A Lite BERT for Self-supervised Learning of Language Representations pdf |
| 10/09 | Siawpeng Er | Six Challenges for Neural Machine Translation pdf & Three Strategies to Improve One-to-Many Multilingual Translation pdf |
| 10/16 | Haoming Jiang | Extreme Language Model Compression with Optimal Subwords and Shared Projections pdf |
| 10/23 | Simiao Zuo | Shared-Private Bilingual Word Embeddings for Neural Machine Translation pdf |
| 10/23 | Yan Li | FREELB: ENHANCED ADVERSARIAL TRAINING FOR LANGUAGE UNDERSTANDING pdf |
| 10/30 | Haoming Jiang | Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer pdf slides |
| 10/30 | Lingkai Kong | Low Resource Name Tagging Learned with Weakly Labeled Data (EMNLP'19) pdf |
| Multilingual Neural Machine Translation with Language Clustering pdf | ||
| Rapid Adaptation of Neural Machine Translation to New Languages pdf | ||
| Low-Resource Name Tagging Learned with Weakly Labeled Data (EMNLP'19) pdf | ||
| Learning to Actively Learn Neural Machine Translation pdf | ||
| Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies pdf | ||
| Bi-Directional Differentiable Input Reconstruction for Low-Resource Neural Machine Translation pdf | ||
| Addressing word-order Divergence in Multilingual Neural Machine Translation for extremely Low Resource Languages pdf | ||
| Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges pdf | ||
| Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation pdf | ||
| Density Matching for Bilingual Word Embedding pdf | ||
| Transfer Learning in Multilingual Neural Machine Translation with Dynamic Vocabulary pdf | ||
| Adapting Multilingual NMT to Extremely Low Resource Languages FBK’s Participation in the Basque-English Low-Resource MT Task, IWSLT 2018 pdf | ||
| Multi-Source Cross-Lingual Model Transfer: Learning What to Share pdf |