Wonyong Sung
14 papers · 2016–2024 · 8 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+5 more ↓ Show less ↑
π£ Hot Topic Early Bird π Conference Polyglot Β· Silver π Academic Marathon Β· Sprint π Interdisciplinary Bridge Β· Bronze πΊοΈ Taxonomy Completionist (22)
π
Grand Slam
π§¬
Topic Evolution
ποΈ
Keyword Collector
(64)
π
Century Club Β· Bronze
π₯
Unstoppable Β· Bronze
Top co-authors
Research topics
Machine Learning
(12)
Deep Learning
(11)
Architectures
(7)
Application Areas
(6)
Artificial Intelligence
(4)
Natural Language Processing
(4)
Speech & Audio
(4)
Core AI
(4)
Optimization & Theory Β· Machine Learning
(4)
Optimization & Theory Β· Deep Learning
(4)
Recognition
(4)
Techniques
(4)
Learning Types
(3)
Core Methods
(2)
Generation
(2)
Keywords
model compression
(5)
speech recognition
(4)
recurrent neural network
(3)
knowledge distillation
(3)
connectionist temporal classification
(3)
neural network optimization
(2)
model quantization
(2)
automatic speech recognition
(2)
neural network quantization
(2)
weight quantization
(2)
language model
(2)
activation quantization
(2)
ensemble learning
(1)
language modeling
(1)
neural machine translation
(1)
online learning
(1)
singular value decomposition
(1)
acoustic modeling
(1)
matrix factorization
(1)
computational efficiency
(1)
Papers
RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models
ACL 2024
Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization
EMNLP 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers
EACL 2023
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models
NeurIPS 2023
Similarity and Content-based Phonetic Self Attention for Speech Recognition
Interspeech 2022
Understanding the Role of Self Attention for Efficient Speech Recognition
ICLR 2022
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks
AAAI 2021
Effect of Adding Positional Information on Convolutional Neural Networks for End-to-End Speech Recognition
Interspeech 2020
HLHLp: Quantized Neural Networks Training for Reaching Flat Minima in Loss Surface
AAAI 2020
Character-level Language Modeling with Gated Hierarchical Recurrent Neural Networks
Interspeech 2018
Fully Neural Network Based Speech Recognition on Mobile and Embedded Devices
NeurIPS 2018
Hierarchical Recurrent Neural Networks for Acoustic Modeling
Interspeech 2018
SVD-Softmax: Fast Softmax Approximation on Large Vocabulary Neural Networks
NeurIPS 2017
Sequence to Sequence Training of CTC-RNNs with Partial Windowing
ICML 2016