← Authors

Wonyong Sung

14 papers · 2016–2024 · 8 conferences · across top CS/AI conferences

Achievements

🐣 Hot Topic Early Bird 🧭 Keyword Pioneer 🌍 Conference Polyglot (8) πŸƒ Academic Marathon (8) 🐝 Cross-Pollinator (12) 🌈 Renaissance Researcher (5) πŸ—ΊοΈ Taxonomy Completionist (25) πŸŒ‰ Interdisciplinary Bridge πŸ† Grand Slam 🌱 Topic Pioneer 🧬 Topic Evolution πŸ’Ž Century Club (14) πŸ—ƒοΈ Keyword Collector (62) πŸ”₯ Unstoppable (5)

Conferences

INTERSPEECH (4) NIPS (3) AAAI (2) ACL (1) EACL (1) EMNLP (1) ICLR (1) ICML (1)

Top co-authors

Jungwook Choi (6) Jinhwan Park (5) Yoonho Boo (5) Kyuhong Shim (4) Minsoo Kim (4) Iksoo Choi (4) Sungho Shin (3) Janghwan Lee (2) Sihwa Lee (2) Seok Hwang (1)

Keywords

model compression (5) recurrent neural network (3) knowledge distillation (3) speech recognition (3) connectionist temporal classification (3) neural network optimization (2) model quantization (2) automatic speech recognition (2) neural network quantization (2) activation quantization (2) language model (2) weight quantization (2) ensemble learning (1) language modeling (1) neural machine translation (1) online learning (1) phoneme classification (1) singular value decomposition (1) matrix factorization (1) acoustic modeling (1)

Papers

RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models ACL 2024
Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization EMNLP 2023
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NIPS 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
Similarity and Content-based Phonetic Self Attention for Speech Recognition INTERSPEECH 2022
Understanding the Role of Self Attention for Efficient Speech Recognition ICLR 2022
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks AAAI 2021
HLHLp: Quantized Neural Networks Training for Reaching Flat Minima in Loss Surface AAAI 2020
Effect of Adding Positional Information on Convolutional Neural Networks for End-to-End Speech Recognition INTERSPEECH 2020
Character-level Language Modeling with Gated Hierarchical Recurrent Neural Networks INTERSPEECH 2018
Hierarchical Recurrent Neural Networks for Acoustic Modeling INTERSPEECH 2018
Fully Neural Network Based Speech Recognition on Mobile and Embedded Devices NIPS 2018
SVD-Softmax: Fast Softmax Approximation on Large Vocabulary Neural Networks NIPS 2017
Sequence to Sequence Training of CTC-RNNs with Partial Windowing ICML 2016