← Back to papers
2023 INTERSPEECH INTERSPEECH 2023

NeMo Forced Aligner and its application to word alignment for subtitle generation

Abstract

We present NeMo Forced Aligner (NFA): an efficient and accurate forced aligner which is part of the NeMo conversational AI open-source toolkit. NFA can produce token, word, and segment-level alignments, and can generate subtitle files for highlighting words or tokens as they are spoken. We present a demo which shows this functionality, and demonstrate that NFA has the best word alignment accuracy and speed of alignment generation compared with other aligners.

🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Robotics, Security & Privacy, Speech & Audio

Authors

Elena Rastorgueva , Vitaly Lavrukhin , Boris Ginsburg

Topics

Machine Learning > Core Methods > Classification Machine Learning > Application Areas > Efficient Computing

Keywords

speech processing word alignment subtitle generation forced alignment
Download PDF

Related papers

Multimodal Turn-Taking Model Using Visual Cues for End-of-Utterance Prediction in Spoken Dialogue Systems 2023
Audio-Visual Praise Estimation for Conversational Video based on Synchronization-Guided Multimodal Transformer 2023
Improving the response timing estimation for spoken dialogue systems by reducing the effect of speech recognition delay 2023
Improving Code-Switching and Name Entity Recognition in ASR with Speech Editing based Data Augmentation 2023
What are differences? Comparing DNN and Human by Their Performance and Characteristics in Speaker Age Estimation 2023