← Back to papers
2022 ACL ACL 2022

ColorCode: A Bayesian Approach to Augmentative and Alternative Communication with Two Buttons

Abstract

AbstractMany people with severely limited muscle control can only communicate through augmentative and alternative communication (AAC) systems with a small number of buttons. In this paper, we present the design for ColorCode, which is an AAC system with two buttons that uses Bayesian inference to determine what the user wishes to communicate. Our information-theoretic analysis of ColorCode simulations shows that it is efficient in extracting information from the user, even in the presence of errors, achieving nearly optimal error correction. ColorCode is provided as open source software.

🌉 Interdisciplinary Bridge — Artificial Intelligence and Machine Learning
🧭 Keyword Pioneer — information theoretic analysis
🐣 Hot Topic Early Bird — error correction
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio

Authors

Matthew Daly

Topics

Artificial Intelligence > Core AI > Human-AI Interaction Artificial Intelligence > Bayesian & Probabilistic > Bayesian Learning Artificial Intelligence > Bayesian & Probabilistic > Bayesian Inference Machine Learning > Bayesian & Probabilistic > Bayesian Inference

Keywords

information theory bayesian inference error correction augmentative communication assistive technology augmentative and alternative communication information theoretic analysis
Download PDF

Related papers

HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsing 2022
KG-CRuSE: Recurrent Walks over Knowledge Graph for Explainable Conversation Reasoning using Semantic Embeddings 2022
Toward Knowledge-Enriched Conversational Recommendation Systems 2022
Investigating the Medical Coverage of a Translation System into Pictographs for Patients with an Intellectual Disability 2022
TableFormer: Robust Transformer Modeling for Table-Text Encoding 2022