2022
EMNLP
EMNLP 2022
SlovakBERT: Slovak Masked Language Model
Abstract
AbstractWe introduce a new Slovak masked language model called SlovakBERT. This is to our best knowledge the first paper discussing Slovak transformers-based language models. We evaluate our model on several NLP tasks and achieve state-of-the-art results. This evaluation is likewise the first attempt to establish a benchmark for Slovak language models. We publish the masked language model, as well as the fine-tuned models for part-of-speech tagging, sentiment analysis and semantic textual similarity.
🌉
Interdisciplinary Bridge
— Deep Learning and Natural Language Processing
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Security & Privacy, Speech & Audio
Authors
Topics
Natural Language Processing > Understanding > Part-of-Speech Tagging
Natural Language Processing > Understanding > Sentiment Analysis
Natural Language Processing > Applications > Text Classification
Natural Language Processing > Resources & Methods > Large Language Models
Natural Language Processing > Resources & Methods > Text Representation
Deep Learning > Models > Transformers
Deep Learning > Models > Language Models