Research Explorer
Papers
Conferences
Authors
Topics
Keywords
Trends
Achievements
Explore
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
HLTRI at W-NUT 2020 Shared Task-3: COVID-19 Event Extraction from Twitter Using Multi-Task Hopfield Pooling
EMNLP 2020
ALT at SemEval-2020 Task 12: Arabic and English Offensive Language Identification in Social Media
COLING 2020
Pretrained Language Model Embryology: The Birth of ALBERT
EMNLP 2020
Pre-training Entity Relation Encoder with Intra-span and Inter-span Information
EMNLP 2020
NLFIIT at SemEval-2020 Task 11: Neural Network Architectures for Detection of Propaganda Techniques in News Articles
COLING 2020
LTIatCMU at SemEval-2020 Task 11: Incorporating Multi-Level Features for Multi-Granular Propaganda Span Identification
COLING 2020
MPNet: Masked and Permuted Pre-training for Language Understanding
NIPS 2020
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters
COLING 2020
New Benchmark Corpus and Models for Fine-grained Event Classification: To BERT or not to BERT?
COLING 2020
A Large-Scale Corpus of E-mail Conversations with Standard and Two-Level Dialogue Act Annotations
COLING 2020
DoTheMath at SemEval-2020 Task 12 : Deep Neural Networks with Self Attention for Arabic Offensive Language Detection
SEMEVAL 2020
Pre-Training Transformers as Energy-Based Cloze Models
EMNLP 2020
Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube
EMNLP 2020
KDELAB at SemEval-2020 Task 12: A System for Estimating Aggression of Tweets Using Two Layers of BERT Features
COLING 2020
KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Media
COLING 2020
XD at SemEval-2020 Task 12: Ensemble Approach to Offensive Language Identification in Social Media Using Transformer Encoders
COLING 2020
UPSTAGE: Unsupervised Context Augmentation for Utterance Classification in Patient-Provider Communication
MLHC 2020
Self-Supervised Pretraining with DICOM metadata in Ultrasound Imaging
MLHC 2020
Multimodal Pretraining for Dense Video Captioning
AACL 2020
Belief-Grounded Networks for Accelerated Robot Learning under Partial Observability
CORL 2020
IRLab_DAIICT at SemEval-2020 Task 12: Machine Learning and Deep Learning Methods for Offensive Language Identification
COLING 2020
KAFK at SemEval-2020 Task 12: Checkpoint Ensemble of Transformers for Hate Speech Classification
COLING 2020
Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)
EMNLP 2020
The Zero Resource Speech Challenge 2020: Discovering Discrete Subword and Word Units
INTERSPEECH 2020
The Synthinel-1 dataset: a collection of high resolution synthetic overhead imagery for building segmentation
WACV 2020
<
1
…
89
90
91
…
99
>