Research Explorer
Papers
Conferences
Authors
Topics
Keywords
Trends
Achievements
Explore
← Techniques
Deep Learning
›
Techniques
›
Pretraining
2471 directly classified papers
Papers per year
2009: 2
2010: 1
2012: 1
2013: 1
2014: 4
2015: 5
2016: 19
2017: 26
2018: 33
2019: 117
2020: 218
2021: 311
2022: 333
2023: 451
2024: 448
2025: 373
2026: 128
Papers
Multilingual Constituency Parsing with Self-Attention and Pre-Training
ACL 2019
Putting Evaluation in Context: Contextual Embeddings Improve Machine Translation Evaluation
ACL 2019
Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension
ACL 2019
A Simple but Effective Method to Incorporate Multi-turn Context with BERT for Conversational Machine Comprehension
ACL 2019
Language Models as Knowledge Bases?
EMNLP 2019
Explicit Cross-lingual Pre-training for Unsupervised Machine Translation
EMNLP 2019
Multi-GCN: Graph Convolutional Networks for Multi-View Networks, with Applications to Global Poverty
AAAI 2019
Towards Robust Named Entity Recognition for Historic German
ACL 2019
Investigating the Lombard Effect Influence on End-to-End Audio-Visual Speech Recognition
INTERSPEECH 2019
AI-Sketcher : A Deep Generative Model for Producing High-Quality Sketches
AAAI 2019
Automated Essay Scoring with Discourse-Aware Neural Models
ACL 2019
Understanding and Visualizing Deep Visual Saliency Models
CVPR 2019
Surf at MEDIQA 2019: Improving Performance of Natural Language Inference in the Clinical Domain by Adopting Pre-trained Language Model
ACL 2019
Variational Pretraining for Semi-supervised Text Classification
ACL 2019
Deeply-Supervised Knowledge Synergy
CVPR 2019
ABC: A Big CAD Model Dataset for Geometric Deep Learning
CVPR 2019
Effective Use of Transformer Networks for Entity Tracking
EMNLP 2019
A Generative Appearance Model for End-To-End Video Object Segmentation
CVPR 2019
Opinion Mining with Deep Contextualized Embeddings
NAACL 2019
Scene Categorization From Contours: Medial Axis Based Salience Measures
CVPR 2019
Training Neural Response Selection for Task-Oriented Dialogue Systems
ACL 2019
HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization
ACL 2019
ERNIE: Enhanced Language Representation with Informative Entities
ACL 2019
Large-Scale Weakly-Supervised Pre-Training for Video Action Recognition
CVPR 2019
Contrast Prior and Fluid Pyramid Integration for RGBD Salient Object Detection
CVPR 2019
<
1
…
91
92
93
…
99
>