2023
JMLR
JMLR 2023
CodaLab Competitions: An Open Source Platform to Organize Scientific Challenges
Abstract
CodaLab Competitions is an open source web platform designed to help data scientists and research teams to crowd-source the resolution of machine learning problems through the organization of competitions, also called challenges or contests. CodaLab Competitions provides useful features such as multiple phases, results and code submissions, multi-score leaderboards, and jobs running inside Docker containers. The platform is very flexible and can handle large scale experiments, by allowing organizers to upload large datasets and provide their own CPU or GPU compute workers. [abs] [ pdf ][ bib ] [ code ] © JMLR 2023. (edit, beta)
🌉
Interdisciplinary Bridge
— Computer Science and Data Science & Analytics and Machine Learning
🧭
Keyword Pioneer
— challenge organization
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio