Past semesters - ufal/NPFL095 GitHub Wiki
Tuesday, 12:20-13:50, S7
| date | speaker | paper |
|---|---|---|
| Oct 3 | startup meeting | |
| Oct 10 | Martin Popel | Sravana Reddy, Kevin Knight: What We Know About The Voynich Manuscript, ACL 2011. |
| Oct 17 | Jan-Felix Klumpp | Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean: Efficient Estimation of Word Representations in Vector Space, ICLR 2013. Questions |
| Oct 24 | Jose Maldonado + Nam Luu | Ashish Vaswani et al.: Attention Is All You Need (The Transformer paper) (blog), NIPS 2017. Questions |
| Oct 31 | Petr Kašpárek | Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, 2018. Questions |
| Nov 7 | Prokop Hanžl | Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu: BLEU: a Method for Automatic Evaluation of Machine Translation, ACL 2002. Questions |
| Nov 14 | Darya Hryhoryeva | Sebastien Bubeck et al.: Sparks of Artificial General Intelligence: Early experiments with GPT-4, 2023. Chapters: 8, 9.3(Bias),10 Questions |
| Nov 21 | Tomas Sourada | Sennrich, Haddow, Birch: Neural Machine Translation of Rare Words with Subword Units, 2015 Questions |
| Nov 28 | Karen Li | Schick et al.: Toolformer: Language Models Can Teach Themselves to Use Tools, 2023. Questions |
| Dec 5 | Artem Tartakovskyi | Jakub Náplava, Milan Straka: Grammatical Error Correction in Low-Resource Scenarios, 2019. Questions |
| Dec 12 | Martin Biroscak | Zeming Lin et al Evolutionary-scale prediction of atomic level protein structure with a language model) Questions |
| Dec 19 | Kate Lutsai | Lightman, Kosaraju, and Burda et al.: Let’s Verify Step by Step, 2023. Questions |
| Jan 9 | Kristýna Klesnilová | Korbak et al.: Pretraining Language Models with Human Preferences, 2023. Questions |
Tuesday, 15:40-17:10, S6
| date | speaker | paper |
|---|---|---|
| Oct 4 | startup meeting, Zoom link (ask me for the passphrase) | |
| Oct 11 | Martin Popel | Sravana Reddy, Kevin Knight: What We Know About The Voynich Manuscript, ACL 2011. |
| Oct 18 | Ondřej Michálek | Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean: Efficient Estimation of Word Representations in Vector Space, ICLR 2013. Questions |
| Oct 25 | Claésia Costa | Ashish Vaswani et al.: Attention Is All You Need (The Transformer paper) (blog), NIPS 2017. Questions |
| Nov 1 | Kateřina Nová | Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, 2018. Questions |
| Nov 8 | Natalia Glazyrina | Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu: BLEU: a Method for Automatic Evaluation of Machine Translation, ACL 2002. Questions |
| Nov 15 | Kristina Szabova | Timo Schick, Hinrich Schütze: Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference, EACL 2021. Questions |
| Nov 22 | Michelle Elizabeth | Sennrich, Haddow, Birch: Neural Machine Translation of Rare Words with Subword Units, 2015 Questions |
| Nov 29 | Kirill Semenov | Brief explanation of the Chinese writing system. The paper discussion moved to Dec 20. |
| Dec 6 | Maja Szász | Bjarke Felbo, Alan Mislove, Anders Søgaard, Iyad Rahwan, Sune Lehmann: Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm, Arxiv 2017. Questions |
| Dec 13 | Miftahul Jannat | Elena Voita, Rico Sennrich, Ivan Titov: The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives, 2019. Questions. See also a blog. |
| Dec 20 | Kirill Semenov | Wei Zhang, Feifei Lin, Xiaodong Wang, Zhenshuang Liang, Zhen Huang: SubCharacter Chinese-English Neural Machine Translation with Wubi Encoding, Arxiv 2019. Questions |
Monday, 14:00-15:30, S10
| date | speaker | paper |
|---|---|---|
| Oct 4 | startup meeting, exceptionally via Zoom (ask me for the passphrase) | |
| Oct 11 | Martin Popel | Sravana Reddy, Kevin Knight: What We Know About The Voynich Manuscript, ACL 2011. |
| Oct 18 | Daniela Jurášová | Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean: Efficient Estimation of Word Representations in Vector Space, ICLR 2013. Questions |
| Oct 25 | Goutham V Karunakaran | Ashish Vaswani et al.: Attention Is All You Need (The Transformer paper) (blog), NIPS 2017. Questions |
| Nov 1 | Ekaterina Garanina | Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, 2018. Questions |
| Nov 8 | Kristýna Neumannová | Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu: BLEU: a Method for Automatic Evaluation of Machine Translation, ACL 2002. Questions |
| Nov 15 | Bittor Alkain | Mikel Artetxe, Gorka Labaka, Eneko Agirre, and Kyunghyun Cho: Unsupervised Neural Machine Translation, ICLR 2018. Questions |
| Nov 22 | Jacobo Del Valle | Timo Schick, Hinrich Schütze: Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference, EACL 2021. Questions |
| Nov 29 | Amrita H Nair | Rose, S., Engel, D., Cramer, N., & Cowley, W. (2010). Automatic keyword extraction from individual documents. Text mining: applications and theory, 1, 1-20. Questions |
| Dec 6 | Martin Popel | Popel et al. (2020): Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals (available also as a pdf). Questions |
| Dec 13 | Alexander Slávik | Wallat, Singh, Anand (2020): BERTnesia: Investigating the capture and forgetting of knowledge in BERT. Questions |
| Dec 20 | Vojtěch Lanz | Baevski et al. (2020): wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. Questions |
Tuesday, 18:00-19:30, via Zoom (ask me for the passphrase)
| date | speaker | paper |
|---|---|---|
| Sep 30 | startup meeting at 11:00 | |
| Oct 6 | Martin Popel | Sravana Reddy, Kevin Knight: What We Know About The Voynich Manuscript, ACL 2011. |
| Oct 13 | Anna Eisenreichová | Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean: Efficient Estimation of Word Representations in Vector Space, ICLR 2013. Questions |
| Oct 20 | Martin Popel | Ashish Vaswani et al.: Attention Is All You Need (The Transformer paper) (blog), NIPS 2017. Questions |
| Oct 27 | Lukáš Kyjánek | Sebastian Padó et al.: Predictability of Distributional Semantics in Derivational Word Formation, COLING 2016. Questions |
| Nov 3 | Saad Obaid | Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, 2018. Questions |
| Nov 10 | Michael Hanna | John Hewitt and Percy Liang: Designing and Interpreting Probes with Control Tasks, EMNLP 2019. Questions |
| no class | Struggle for Freedom and Democracy Day | |
| Nov 24 | Ondřej Měkota | M. Schlichtkrull, T. N. Kipf, P. Bloem, R. van den Berg, I. Titov, and M. Welling, Modeling Relational Data with Graph Convolutional Networks, 2017. Questions |
| Dec 1 | Martin Popel | Sennrich, Haddow, Birch: Neural Machine Translation of Rare Words with Subword Units, 2015 Questions |
| Dec 8 | Martin Popel | Ivan Provilkov, Dmitrii Emelianenko, Elena Voita: BPE-Dropout: Simple and Effective Subword Regularization, 2020 Questions |
| Dec 15 | Anna Eisenreichová | Atsuko Koizumi, Hirohiko Sagawa and Masaru Takeuchi: An Annotated Japanese Sign Language Corpus, 2002. Questions |
Monday, 17:30-19:00
| date | speaker | paper |
|---|---|---|
| Oct 21 | startup meeting at 17:30, western corridor of the 4th floor | |
| Oct 28 | no class (Statehood Day) | |
| Nov 4 | Martin Popel | Sravana Reddy, Kevin Knight: What We Know About The Voynich Manuscript, ACL 2011. |
| Nov 11 | Memduh Gokirmak | Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean: Efficient Estimation of Word Representations in Vector Space, ICLR 2013. Questions |
| Nov 25 | Abhishek Agrawal | Elena Voita, Rico Sennrich, Ivan Titov: The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives, 2019. Questions. See also a blog. |
| Dec 9 | Patrícia Schmidtová | Wenqiang Lei et al.: Sequicity: Simplifying Task-oriented Dialogue Systems with Single Sequence-to-Sequence Architectures, 2018. Questions. |
| Jan 6 | Memduh Gokirmak | Transformer (Attention Is All You Need) (blog) and Music Transformer |
Tuesday 19:00-20:30 in S4.
| date | speaker | paper |
|---|---|---|
| Oct 10 | startup meeting | |
| Oct 17 | Martin Popel | Kevin Knight, Beáta Megyesi and Christiane Schaefer: The Copiale Cipher, BUCC 2011, you can watch a trailer |
| Oct 24 | Thuong-Hai Pham | Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu: BLEU: a Method for Automatic Evaluation of Machine Translation, ACL 2002. Questions |
| Oct 31 | Oneka Jauregi | Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean: Efficient Estimation of Word Representations in Vector Space, ICLR 2013 Questions |
| Nov 7 | no class | cancelled because of (false) fire alarm |
| Nov 14 | Adedayo Oluokun | Sennrich, Haddow, Birch: Neural Machine Translation of Rare Words with Subword Units, 2015 Questions |
| Nov 21 | Shadasha Williams | Bahdanau et al.: Neural Machine Translation by Jointly Learning to Align and Translate, 2014 Questions |
| Nov 28 | Shadasha Williams | Bahdanau et al. (cont.) |
| Dec 5 | Ronald Cardenas | Ammar, W. et al.: Many Languages, One Parser, 2016. Questions |
| Dec 12 | Vinit Ravishankar | Chen & Manning: A Fast And Accurate Dependency Parser Using Neural Networks, 2014. Questions |
| Dec 19 | Martin Popel | Popel et al.: Udapi: Universal API for Universal Dependencies, 2017. Questions |
| Jan 9 | Rudolf Rosa | Dozat and Manning: Deep biaffine attention for neural dependency parsing, 2016. Questions |
Tuesdays 15:40, S1
| date | speaker | paper |
|---|---|---|
| Oct 4 | startup meeting | |
| Oct 11 | Martin Popel | Kevin Knight, Beáta Megyesi and Christiane Schaefer: The Copiale Cipher, BUCC 2011, you can watch a trailer |
| Oct 18 | Daniela Bodanská | Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu: BLEU: a Method for Automatic Evaluation of Machine Translation, ACL 2002. Questions |
| Oct 25 | Guanghao You | Michael Collins: Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms, EMNLP 2002. Questions |
| Nov 1 | Guanghao You | Perceptron cont. Questions |
| --- | no RG (Dean's day) | |
| Nov 15 | Martin Popel | Andrew McCallum, Dayne Freitag, Fernando Pereira: Maximum Entropy Markov Models for Information Extraction and Segmentation, Conference on Machine Learning 2000, slides. Questions, from 16:20 Den firem |
| Nov 22 | Martin Popel | MEMM cont. |
| Nov 29 | Vladan Glončák | John Lafferty, Andrew McCallum, Fernando Pereira: Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data, 2001. Questions |
| Dec 6 | Karolína Burešová | Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean: Efficient Estimation of Word Representations in Vector Space, ICLR 2013 Questions |
| Dec 13 | Lucia Bečvarová | Michael Curtotti, Eric Mccreath: Corpus Based Classification of Text in Australian Contracts, 2010 Questions |
| Jan 3 | class cancelled | |
| Jan 10 | Jesse Peacock | Jeremy Collins: The role of language contact in creating correlations between humidity and tone, Journal of Language Evolution (2016) Questions |