← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually) EMNLP 2020
MPNet: Masked and Permuted Pre-training for Language Understanding NIPS 2020
Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube EMNLP 2020
Using Pre-Trained Transformer for Better Lay Summarization EMNLP 2020
The birth of Romanian BERT EMNLP 2020
Mining Knowledge for Natural Language Inference from Wikipedia Categories EMNLP 2020
An Empirical Exploration of Local Ordering Pre-training for Structured Prediction EMNLP 2020
Self-supervised learning through the eyes of a child NIPS 2020
Pre-Training Transformers as Energy-Based Cloze Models EMNLP 2020
Multi-Stage Influence Function NIPS 2020
HLTRI at W-NUT 2020 Shared Task-3: COVID-19 Event Extraction from Twitter Using Multi-Task Hopfield Pooling EMNLP 2020
Attribute Prototype Network for Zero-Shot Learning NIPS 2020
Book QA: Stories of Challenges and Opportunities EMNLP 2019
Robust Navigation with Language Pretraining and Stochastic Sampling EMNLP 2019
Designing a Symbolic Intermediate Representation for Neural Surface Realization NAACL 2019
R-Vectors: New Technique for Adaptation to Room Acoustics INTERSPEECH 2019
Cross-lingual Transfer Learning for Japanese Named Entity Recognition NAACL 2019
Leveraging Pretrained Word Embeddings for Part-of-Speech Tagging of Code Switching Data NAACL 2019
PANLP at MEDIQA 2019: Pre-trained Language Models, Transfer Learning and Knowledge Distillation ACL 2019
Denoising based Sequence-to-Sequence Pre-training for Text Generation IJCNLP 2019
Cloze-driven Pretraining of Self-attention Networks IJCNLP 2019
Whether to Pretrain DNN or not?: An Empirical Analysis for Voice Conversion INTERSPEECH 2019
The INTERSPEECH 2019 Computational Paralinguistics Challenge: Styrian Dialects, Continuous Sleepiness, Baby Sounds & Orca Activity INTERSPEECH 2019
Learning to Ask Unanswerable Questions for Machine Reading Comprehension ACL 2019
Pretraining Methods for Dialog Context Representation Learning ACL 2019