← Back to papers
2022 NAACL NAACL 2022

RIGA at SemEval-2022 Task 1: Scaling Recurrent Neural Networks for CODWOE Dictionary Modeling

Abstract

AbstractDescribed are our two entries “emukans” and “guntis” for the definition modeling track of CODWOE SemEval-2022 Task 1. Our approach is based on careful scaling of a GRU recurrent neural network, which exhibits double descent of errors, corresponding to significant improvements also per human judgement. Our results are in the middle of the ranking table per official automatic metrics.

🌉 Interdisciplinary Bridge — Deep Learning and Machine Learning
🐣 Hot Topic Early Bird — scaling law
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Eduards Mukans , Gus Strazds , Guntis Barzdins

Topics

Machine Learning > Core Methods > Representation Learning Machine Learning > Optimization & Theory > Optimization Deep Learning > Architectures > Neural Networks

Keywords

double descent definition modeling recurrent neural network scaling law gru network
Download PDF

Related papers

EVI: Multilingual Spoken Dialogue Tasks and Dataset for Knowledge-Based Enrolment, Verification, and Identification 2022
Generating Complement Data for Aspect Term Extraction with GPT-2 2022
Regularized Training of Nearest Neighbor Language Models 2022
Systematicity Emerges in Transformers when Abstract Grammatical Roles Guide Attention 2022
Neural Retriever and Go Beyond: A Thesis Proposal 2022