← Back to papers
2020 EMNLP EMNLP 2020

Cydex: Neural Search Infrastructure for the Scholarly Literature

Abstract

AbstractCydex is a platform that provides neural search infrastructure for domain-specific scholarly literature. The platform represents an abstraction of Covidex, our recently developed full-stack open-source search engine for the COVID-19 Open Research Dataset (CORD-19) from AI2. While Covidex takes advantage of the latest best practices for keyword search using the popular Lucene search library as well as state-of-the-art neural ranking models using T5, parts of the system were hard coded to only work with CORD-19. This paper describes our efforts to generalize Covidex into Cydex, which can be applied to scholarly literature in different domains. By decoupling corpus-specific configurations from the frontend implementation, we are able to demonstrate the generality of Cydex on two very different corpora: the ACL Anthology and a collection of hydrology abstracts. Our platform is entirely open source and available at cydex.ai.

🌉 Interdisciplinary Bridge — Data Science & Analytics and Deep Learning and Machine Learning and Natural Language Processing
🧭 Keyword Pioneer — text-to-text transformer
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Shane Ding , Edwin Zhang , Jimmy Lin

Topics

Machine Learning > Application Areas > Domain Adaptation Natural Language Processing > Applications > Information Retrieval Data Science & Analytics > Applications > Information Retrieval Deep Learning > Models > Transformers Machine Learning > Application Areas > Information Retrieval Deep Learning > Models > Language Models

Keywords

domain adaptation information retrieval neural ranking text-to-text transformer search engine neural search scholarly literature search infrastructure
Download PDF

Related papers

Fast semantic parsing with well-typedness guarantees 2020
Detecting Objectifying Language in Online Professor Reviews 2020
Analogous Process Structure Induction for Sub-event Sequence Prediction 2020
Aspect Sentiment Classification with Aspect-Specific Opinion Spans 2020
Robust and Interpretable Grounding of Spatial References with Relation Networks 2020