2021
ACL
ACL 2021
LIORI at SemEval-2021 Task 8: Ask Transformer for measurements
Abstract
AbstractThis work describes our approach for subtasks of SemEval-2021 Task 8: MeasEval: Counts and Measurements which took the official first place in the competition. To solve all subtasks we use multi-task learning in a question-answering-like manner. We also use learnable scalar weights to weight subtasks’ contribution to the final loss in multi-task training. We fine-tune LUKE to extract quantity spans and we fine-tune RoBERTa to extract everything related to found quantities, including quantities themselves.
🌉
Interdisciplinary Bridge
— Artificial Intelligence and Machine Learning
🧭
Keyword Pioneer
— learnable weight
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio
Authors
Topics
Artificial Intelligence > Core AI > Foundation Models
Artificial Intelligence > Core AI > Multimodal Learning
Artificial Intelligence > Learning Paradigms > Transfer Learning
Artificial Intelligence > Learning Paradigms > Meta-Learning
Machine Learning > Core Methods > Classification
Machine Learning > Core Methods > Representation Learning
Machine Learning > Learning Types > Multi-Task Learning