Ruiyi Zhang

68 papers · 2018–2026 · 13 conferences · across top CS/AI conferences

Achievements

🏃 Academic Marathon (7) 🗺️ Taxonomy Completionist (117) 🌍 Conference Polyglot (13) 🌈 Renaissance Researcher (12) 🐝 Cross-Pollinator (13) 🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🤝 Dynamic Duo (22) 👑 Triple Crown 🏆 Grand Slam 👥 Mega-Team (34) 🔬 Deep Specialist (10) 🧬 Topic Evolution 🏆 Keyword Champion ⚡ Prolific Year (10) ❓ The Questioner 💎 Century Club (64) 🔥 Unstoppable (8) 🗃️ Keyword Collector (284) 🚀 Conference Pioneer

Conferences

ACL (10) EMNLP (10) AAAI (9) ICLR (7) ICML (6) NAACL (6) NIPS (5) AISTATS (4) CVPR (3) EACL (3) ICCV (2) WACV (2) COLING (1)

Top co-authors

Tong Yu (24) Changyou Chen (22) Jiuxiang Gu (19) Tong Sun (14) Lawrence Carin (13) Yufan Zhou (12) Handong Zhao (11) Sungchul Kim (10) Ryan A. Rossi (10) Junda Wu (10)

Keywords

large language model (9) few-shot learning (6) reinforcement learning (5) prompt tuning (4) variational inference (4) optimal transport (4) text generation (4) generative adversarial network (4) named entity recognition (4) question answering (4) wasserstein gradient flow (3) multimodal large language model (3) pretrained language model (3) diffusion model (3) generative model (3) particle optimization (3) multimodal learning (3) text-to-image generation (3) posterior distribution (3) wasserstein distance (2)

Papers

Decomposition-Enhanced Training for Post-Hoc Attributions in Language Models EACL 2026

VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use AAAI 2026

OIDA-QA: A Multimodal Benchmark for Analyzing the Opioid Industry Documents Archive AAAI 2026

A Survey on LLM-based Conversational User Simulation EACL 2026

Defense against Prompt Injection Attacks via Mixture of Encodings NAACL 2025

SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding ICLR 2025

Multimodal LLMs as Customized Reward Models for Text-to-Image Generation ICCV 2025

Numerical Pruning for Efficient Autoregressive Models AAAI 2025

GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration EMNLP 2025

Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs EMNLP 2025

A High-Quality Text-Rich Image Instruction Tuning Dataset via Hybrid Instruction Generation COLING 2025

Doc-React: Multi-page Heterogeneous Document Question-answering ACL 2025

GUI Agents: A Survey ACL 2025

From Selection to Generation: A Survey of LLM-based Active Learning ACL 2025

ARTIST: Improving the Generation of Text-Rich Images with Disentangled Diffusion Models and Large Language Models WACV 2025

Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes NAACL 2025

Personalized Federated Learning for Text Classification with Gradient-Free Prompt Tuning NAACL 2024

Knowledge Graph Prompting for Multi-Document Question Answering AAAI 2024

Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models ACL 2024

KaPQA: Knowledge-Augmented Product Question-Answering ACL 2024

Customization Assistant for Text-to-Image Generation CVPR 2024

TRINS: Towards Multimodal Language Models that Can Read CVPR 2024

Few-Shot Dialogue Summarization via Skeleton-Assisted Prompt Transfer in Prompt Tuning EACL 2024

TextLap: Customizing Language Models for Text-to-Layout Planning EMNLP 2024

Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints ICLR 2024

SOHES: Self-supervised Open-world Hierarchical Entity Segmentation ICLR 2024

ADOPD: A Large-Scale Document Page Decomposition Dataset ICLR 2024

BLO-SAM: Bi-level Optimization Based Finetuning of the Segment Anything Model for Overfitting-Preventing Semantic Segmentation ICML 2024

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning NAACL 2024

Self-Cleaning: Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances NAACL 2024

A Critical Analysis of Document Out-of-Distribution Detection EMNLP 2023

Few-Shot Composition Learning for Image Retrieval with Prompt Tuning AAAI 2023

InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding NIPS 2023

Learning Navigational Visual Representations with Semantic Map Supervision ICCV 2023

Label-Retrieval-Augmented Diffusion Models for Learning from Noisy Labels NIPS 2023

Understanding Demonstration-based Learning from a Causal Perspective ACL 2023

Federated Domain Adaptation for Named Entity Recognition via Distilling with Heterogeneous Tag Sets ACL 2023

TiGAN: Text-Based Interactive Image Generation and Manipulation AAAI 2022

Robustness of Demonstration-based Learning Under Limited Data Scenario EMNLP 2022

Context-aware Information-theoretic Causal De-biasing for Interactive Sequence Labeling EMNLP 2022

Few-Shot Class-Incremental Learning for Named Entity Recognition ACL 2022

Text-Based Interactive Recommendation via Offline Reinforcement Learning AAAI 2022

Learning Adaptive Axis Attentions in Fine-tuning: Beyond Fixed Sparse Attention Patterns ACL 2022

Towards Language-Free Training for Text-to-Image Generation CVPR 2022

Graphine: A Dataset for Graph-aware Terminology Definition Generation EMNLP 2021

Unsupervised Abstractive Dialogue Summarization for Tete-a-Tetes AAAI 2021

Improving Zero-Shot Voice Style Transfer via Disentangled Representation Learning ICLR 2021

Stochastic Particle-Optimization Sampling and the Non-Asymptotic Convergence Theory AISTATS 2020

Bayesian Meta Sampling for Fast Uncertainty Adaptation ICLR 2020

Nested-Wasserstein Self-Imitation Learning for Sequence Generation AISTATS 2020

Semantic Matching for Sequence-to-Sequence Learning EMNLP 2020

Improving Adversarial Text Generation by Modeling the Distant Future ACL 2020

Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitions AAAI 2020

Figure Captioning with Relation Maps for Reasoning WACV 2020

Graphical Models Meet Bandits: A Variational Thompson Sampling Approach ICML 2020

Improving Text Generation with Student-Forcing Optimal Transport EMNLP 2020

Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference EMNLP 2020

Improving Sequence-to-Sequence Learning via Optimal Transport ICLR 2019

Understanding and Accelerating Particle-Based Variational Inference ICML 2019

Variational Annealing of GANs: A Langevin Perspective ICML 2019

Topic-Guided Variational Auto-Encoder for Text Generation NAACL 2019

Text-Based Interactive Recommendation via Constraint-Augmented Reinforcement Learning NIPS 2019

Scalable Thompson Sampling via Optimal Transport AISTATS 2019

Improving Textual Network Learning with Variational Homophilic Embeddings NIPS 2019

Adversarial Text Generation via Feature-Mover's Distance NIPS 2018

Policy Optimization as Wasserstein Gradient Flows ICML 2018

Variational Inference and Model Selection with Generalized Evidence Bounds ICML 2018

Learning Structural Weight Uncertainty for Sequential Decision-Making AISTATS 2018