Research Explorer
Papers
Conferences
Authors
Topics
Keywords
Trends
Achievements
Explore
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
ZQM at SemEval-2019 Task9: A Single Layer CNN Based on Pre-trained Model for Suggestion Mining
SEMEVAL 2019
Extractive NarrativeQA with Heuristic Pre-Training
EMNLP 2019
Local to Global Learning: Gradually Adding Classes for Training Deep Neural Networks
CVPR 2019
Estimating Information Flow in Deep Neural Networks
ICML 2019
On The Power of Curriculum Learning in Training Deep Networks
ICML 2019
HHU at SemEval-2019 Task 6: Context Does Matter - Tackling Offensive Language Identification and Categorization with ELMo
SEMEVAL 2019
Team Bertha von Suttner at SemEval-2019 Task 4: Hyperpartisan News Detection using ELMo Sentence Representation Convolutional Network
SEMEVAL 2019
Objects365: A Large-Scale, High-Quality Dataset for Object Detection
ICCV 2019
An Attentive Fine-Grained Entity Typing Model with Latent Type Representation
IJCNLP 2019
In Plain Sight: Media Bias Through the Lens of Factual Reporting
EMNLP 2019
Large Scale High-Resolution Land Cover Mapping With Multi-Resolution Data
CVPR 2019
Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension
EMNLP 2019
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer
EMNLP 2019
Visualizing and Understanding the Effectiveness of BERT
EMNLP 2019
Survey Talk: Modeling in Automatic Speech Recognition: Beyond Hidden Markov Models
INTERSPEECH 2019
Matching the Blanks: Distributional Similarity for Relation Learning
ACL 2019
Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling
ACL 2019
CUED@WMT19:EWC&LMs
ACL 2019
Visualizing and Understanding the Effectiveness of BERT
IJCNLP 2019
Efficient Training of BERT by Progressively Stacking
ICML 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives
IJCNLP 2019
Event Representation Learning Enhanced with External Commonsense Knowledge
IJCNLP 2019
Recycling a Pre-trained BERT Encoder for Neural Machine Translation
EMNLP 2019
UER: An Open-Source Toolkit for Pre-training Models
IJCNLP 2019
Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence Representations
IJCNLP 2019
<
1
…
93
94
95
…
99
>