PPaperPicks

Zhou Zhao

Zhejiang University, College of Computer Science, Hangzhou, China

112 papers at tracked venues · 101 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0001-6121-0384 ↗Google Scholar ↗

Venues

ACL ×36NeurIPS ×18ACM MM ×12ICML ×9ICLR ×7CVPR ×6AAAI ×5EMNLP ×5SIGKDD ×3ICCV ×2InterSpeech ×2NAACL ×2WWW ×2FSE ×1IJCAI ×1IUI ×1

Frequent coauthors

Tao Jin
×35
Rongjie Huang
×32
Xize Cheng
×28
Zehan Wang
×27
Shengpeng Ji
×23
Ziyue Jiang
×18
Ruiqi Li
×14
Fei Wu
×14
Yu Zhang
×13
Minghui Fang
×13
Wang Lin
×13
Changhao Pan
×11

Papers

  1. Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search
    ACL 2026 ·
    Zequn Xie
    ,
    Guijin Luo
    ,
    Chuxin Wang
    ,
    Sihang Cai
    ,
    Tao Jin
    , Zhou Zhao,
    Yixuan Tang
  2. Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios
    ACL 2026 ·
    Changhao Pan
    ,
    Rui Yang
    ,
    Han Wang
    ,
    Zhuan Zhou
    ,
    Xuming He
    ,
    Wenxiang Guo
    ,
    Ziyue Jiang
    ,
    Ruiqi Li
    ,
    Yu Zhang
    ,
    Chenyuhao Wen
    ,
    Ke Lei
    ,
    Xiang Yin
    ,
    Jingyu Lu
    ,
    Zhiyuan Zhu
    , Zhou Zhao
  3. DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration
    ACL 2026 ·
    Yanru Huo
    ,
    Ziyue Jiang
    ,
    Zuoli Tang
    ,
    Qingyang Hong
    , Zhou Zhao
  4. Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models
    ACL 2026 ·
    Yifu Chen
    ,
    Shengpeng Ji
    ,
    Zhengqing Liu
    ,
    Qian Chen
    ,
    Wen Wang
    ,
    Ziqing Wang
    ,
    Yangzhuo Li
    ,
    Tianle Liang
    , Zhou Zhao
  5. Hallucinations in LLM-Based Code Summarization: Unveiling, Detection, and Mitigation
    FSE 2026 ·
    Guanghua Wan
    ,
    Yuanning Feng
    ,
    Yao Wan
    ,
    Zhaoyang Chu
    ,
    Zhangqian Bi
    ,
    Junxiao Han
    , Zhou Zhao,
    Hongyu Zhang
    ,
    Pingpeng Yuan
    ,
    Xuanhua Shi
    ,
    Hai Jin
  6. Iterative Self-Correction for Text-Driven Person Re-Identification with Large Vision-Language Models
    ACL 2026 ·
    Guijin Luo
    ,
    Zequn Xie
    ,
    Sihang Cai
    ,
    Chuxin Wang
    , Zhou Zhao,
    Yixuan Tang
  7. Masked Text-to-Audio Flow-Matching and Reward Feedback Optimization
    ACL 2026 ·
    Rongjie Huang
    ,
    Dongchao Yang
    ,
    Wenxiang Guo
    ,
    Huadai Liu
    ,
    Xize Cheng
    ,
    Zehan Wang
    , Zhou Zhao,
    Xixin Wu
    ,
    Helen M. Meng
  8. Rectifying the Emotional Flow: Aligning Priors and Dynamic Guidance for High-Arousal Text-to-Speech
    ACL 2026 ·
    Fangming Feng
    ,
    Dongjie Fu
    ,
    Zequn Xie
    ,
    Yu Zhang
    ,
    Yangyang Wu
    , Zhou Zhao,
    Tao Jin
  9. SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness
    ACL 2026 ·
    Jingyu Lu
    ,
    Yuhan Wang
    ,
    Fan Zhuo
    ,
    Xize Cheng
    ,
    Changhao Pan
    ,
    Xueyi Pu
    ,
    Yifu Chen
    ,
    Chenyuhao Wen
    ,
    Tianle Liang
    , Zhou Zhao
  10. Unified Thinker: A General Reasoning Core for Image Generation
    ACL 2026 ·
    Sashuai Zhou
    ,
    Qiang Zhou
    ,
    Jijin Hu
    ,
    Hanqing Yang
    ,
    Yue Cao
    ,
    Junpeng Ma
    ,
    Yinchao Ma
    ,
    Jun Song
    ,
    Tiezheng Ge
    ,
    Cheng Yu
    ,
    Bo Zheng
    , Zhou Zhao
  11. View-R1: Asymmetric Policy Optimization for Difficulty-Aware Multimodal Reinforcement Learning
    ACL 2026 ·
    Minjie Hong
    ,
    Zirun Guo
    ,
    Jiabao Zhang
    ,
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Tao Jin
    , Zhou Zhao
  12. VoxMind: An End-to-End Agentic Spoken Dialogue System
    ACL 2026 ·
    Tianle Liang
    ,
    Yifu Chen
    ,
    Shengpeng Ji
    ,
    Yijun Chen
    ,
    Zhiyang Jia
    ,
    Jingyu Lu
    ,
    Fan Zhuo
    ,
    Xueyi Pu
    ,
    Yangzhuo Li
    , Zhou Zhao
  13. WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training
    ACL 2026 ·
    Yifu Chen
    ,
    Shengpeng Ji
    ,
    Qian Chen
    ,
    Tianle Liang
    ,
    Yangzhuo Li
    ,
    Ziqing Wang
    ,
    Wen Wang
    ,
    Jingyu Lu
    ,
    Haoxiao Wang
    ,
    Xueyi Pu
    ,
    Fan Zhuo
    , Zhou Zhao
  14. A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference
    ACM MM 2025 ·
    Changhao Pan
    ,
    Wenxiang Guo
    ,
    Yu Zhang
    ,
    Zhiyuan Zhu
    ,
    Zhetao Chen
    ,
    Han Wang
    , Zhou Zhao
  15. AHa-Bench: Benchmarking Audio Hallucinations in Large Audio-Language Models
    NeurIPS 2025 ·
    Xize Cheng
    ,
    Dongjie Fu
    ,
    Chenyuhao Wen
    ,
    Shannon Yu
    ,
    Zehan Wang
    ,
    Shengpeng Ji
    ,
    Siddhant Arora
    ,
    Tao Jin
    ,
    Shinji Watanabe
    , Zhou Zhao
  16. AnomalyCoT: A Multi-Scenario Chain-of-Thought Dataset for Multimodal Large Language Models
    NeurIPS 2025 ·
    Jiaxi Cheng
    ,
    Yuliang Xu
    ,
    Shoupeng Wang
    ,
    Tao Ma
    ,
    Yuchen He
    ,
    Jinghe Zhang
    ,
    Sihang Cai
    ,
    Jiawei Zhen
    ,
    Jingyi Jia
    ,
    Yao Wan
    ,
    Yan Xia
    , Zhou Zhao
  17. Bridging Domain Generalization to Multimodal Domain Generalization via Unified Representations
    ICCV 2025 ·
    Hai Huang
    ,
    Yan Xia
    ,
    Sashuai Zhou
    ,
    Hanting Wang
    ,
    Shulei Wang
    , Zhou Zhao
  18. CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling
    ACL 2025 ·
    Minghui Fang
    ,
    Shengpeng Ji
    ,
    Jialong Zuo
    ,
    Hai Huang
    ,
    Yan Xia
    ,
    Jieming Zhu
    ,
    Xize Cheng
    ,
    Xiaoda Yang
    ,
    Wenrui Liu
    ,
    Gang Wang
    ,
    Zhenhua Dong
    , Zhou Zhao
  19. CodeSync: Synchronizing Large Language Models with Dynamic Code Evolution at Scale
    ICML 2025 ·
    Chenlong Wang
    ,
    Zhaoyang Chu
    ,
    Zhengxiang Cheng
    ,
    Xuyi Yang
    ,
    Kaiyue Qiu
    ,
    Yao Wan
    , Zhou Zhao,
    Xuanhua Shi
    ,
    Hai Jin
    ,
    Dongping Chen
  20. ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control
    ACL 2025 ·
    Shengpeng Ji
    ,
    Qian Chen
    ,
    Wen Wang
    ,
    Jialong Zuo
    ,
    Minghui Fang
    ,
    Ziyue Jiang
    ,
    Hai Huang
    ,
    Zehan Wang
    ,
    Xize Cheng
    ,
    Siqi Zheng
    , Zhou Zhao
  21. Data-Efficiently Learn Large Language Model for Universal 3D Scene Perception
    NAACL 2025 ·
    Zehan Wang
    ,
    Haifeng Huang
    ,
    Yang Zhao
    ,
    Ziang Zhang
    ,
    Tao Jin
    , Zhou Zhao
  22. Dataflow-Guided Neuro-Symbolic Language Models for Type Inference
    ICML 2025 ·
    Ge Li
    ,
    Yao Wan
    ,
    Hongyu Zhang
    , Zhou Zhao,
    Wenbin Jiang
    ,
    Xuanhua Shi
    ,
    Hai Jin
    ,
    Zheng Wang
  23. EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration
    WWW 2025 ·
    Minjie Hong
    ,
    Yan Xia
    ,
    Zehan Wang
    ,
    Jieming Zhu
    ,
    Ye Wang
    ,
    Sihang Cai
    ,
    Xiaoda Yang
    ,
    Quanyu Dai
    ,
    Zhenhua Dong
    ,
    Zhimeng Zhang
    , Zhou Zhao
  24. EcoFace: Audio-Visual Emotional Co-Disentanglement Speech-Driven 3D Talking Face Generation
    ICLR 2025 ·
    Jiajian Xie
    ,
    Shengyu Zhang
    ,
    Mengze Li
    ,
    Chengfei Lv
    , Zhou Zhao,
    Fei Wu
  25. Enhancing Multimodal Unified Representations for Cross Modal Generalization
    ACL 2025 ·
    Hai Huang
    ,
    Yan Xia
    ,
    Shengpeng Ji
    ,
    Shulei Wang
    ,
    Hanting Wang
    ,
    Minghui Fang
    ,
    Jieming Zhu
    ,
    Zhenhua Dong
    ,
    Sashuai Zhou
    , Zhou Zhao
  26. ExpTalk: Diverse Emotional Expression via Adaptive Disentanglement and Refined Alignment for Speech-Driven 3D Facial Animation
    IJCAI 2025 ·
    Zhan Qu
    ,
    Shengyu Zhang
    ,
    Mengze Li
    ,
    Zhuo Chen
    ,
    Chengfei Lv
    , Zhou Zhao,
    Fei Wu
  27. FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation
    CVPR 2025 ·
    Tianyun Zhong
    ,
    Chao Liang
    ,
    Jianwen Jiang
    ,
    Gaojie Lin
    ,
    Jiaqi Yang
    , Zhou Zhao
  28. FlashAudio: Rectified Flow for Fast and High-Fidelity Text-to-Audio Generation
    ACL 2025 ·
    Huadai Liu
    ,
    Jialei Wang
    ,
    Rongjie Huang
    ,
    Yang Liu
    ,
    Heng Lu
    , Zhou Zhao,
    Wei Xue
  29. GTA: Towards Generative Text-To-Audio Retrieval via Multi-Scale Tokenizer
    InterSpeech 2025 ·
    Minghui Fang
    ,
    Shengpeng Ji
    ,
    Jialong Zuo
    ,
    Xize Cheng
    ,
    Wenrui Liu
    ,
    Xiaoda Yang
    ,
    Ruofan Hu
    ,
    Jieming Zhu
    , Zhou Zhao
  30. GenSpace: Benchmarking Spatially-Aware Image Generation
    NeurIPS 2025 ·
    Zehan Wang
    ,
    Jiayang Xu
    ,
    Ziang Zhang
    ,
    Tianyu Pang
    ,
    Chao Du
    ,
    Hengshuang Zhao
    , Zhou Zhao
  31. ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment
    EMNLP 2025 ·
    Zhipeng Bian
    ,
    Jieming Zhu
    ,
    Qijiong Liu
    ,
    Wang Lin
    ,
    Guohao Cai
    ,
    Zhaocheng Du
    ,
    Jiacheng Sun
    , Zhou Zhao,
    Zhenhua Dong
  32. IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models
    ICML 2025 ·
    Hanting Wang
    ,
    Tao Jin
    ,
    Wang Lin
    ,
    Shulei Wang
    ,
    Hai Huang
    ,
    Shengpeng Ji
    , Zhou Zhao
  33. ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting
    ACM MM 2025 ·
    Yu Zhang
    ,
    Wenxiang Guo
    ,
    Changhao Pan
    ,
    Zhiyuan Zhu
    ,
    Tao Jin
    , Zhou Zhao
  34. InteractSpeech: A Speech Dialogue Interaction Corpus for Spoken Dialogue Model
    EMNLP 2025 ·
    Yifu Chen
    ,
    Shengpeng Ji
    ,
    Ziqing Wang
    ,
    Hanting Wang
    , Zhou Zhao
  35. Language-Codec: Bridging Discrete Codec Representations and Speech Language Models
    ACL 2025 ·
    Shengpeng Ji
    ,
    Minghui Fang
    ,
    Jialong Zuo
    ,
    Ziyue Jiang
    ,
    Dingdong Wang
    ,
    Hanting Wang
    ,
    Hai Huang
    , Zhou Zhao
  36. MIRA: Empowering One-Touch AI Services on Smartphones with MLLM-based Instruction Recommendation
    ACL 2025 ·
    Zhipeng Bian
    ,
    Jieming Zhu
    ,
    Xuyang Xie
    ,
    Quanyu Dai
    , Zhou Zhao,
    Zhenhua Dong
  37. MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations
    NeurIPS 2025 ·
    Wenxiang Guo
    ,
    Changhao Pan
    ,
    Zhiyuan Zhu
    ,
    Xintong Hu
    ,
    Yu Zhang
    ,
    Li Tang
    ,
    Rui Yang
    ,
    Han Wang
    ,
    Zongbao Zhang
    ,
    Yuhan Wang
    ,
    Yixuan Chen
    ,
    Hankun Xu
    ,
    Ke Xu
    ,
    Pengfei Fan
    ,
    Zhetao Chen
    ,
    Yanhao Yu
    ,
    Qiange Huang
    ,
    Fei Wu
    , Zhou Zhao
  38. MelodyEdit: Zero-shot Music Editing with Disentangled Inversion Control
    ACM MM 2025 ·
    Huadai Liu
    ,
    Jialei Wang
    ,
    Xiangtai Li
    ,
    Wen Wang
    ,
    Qian Chen
    ,
    Rongjie Huang
    ,
    Yang Liu
    ,
    Jiayang Xu
    , Zhou Zhao,
    Wei Xue
  39. MergeNet: Knowledge Migration Across Heterogeneous Models, Tasks, and Modalities
    AAAI 2025 ·
    Kunxi Li
    ,
    Tianyu Zhan
    ,
    Kairui Fu
    ,
    Shengyu Zhang
    ,
    Kun Kuang
    ,
    Jiwei Li
    , Zhou Zhao,
    Fan Wu
    ,
    Fei Wu
  40. Multimodal Conditional Retrieval with High Controllability
    SIGKDD 2025 ·
    Xiaoda Yang
    ,
    Xize Cheng
    ,
    Minghui Fang
    ,
    Hongshun Qiu
    ,
    Yuhang Ma
    ,
    Junyu Lu
    ,
    Jiaqi Duan
    ,
    Sihang Cai
    ,
    Zehan Wang
    ,
    Ruofan Hu
    ,
    Dongjie Fu
    , Zhou Zhao,
    Tao Jin
  41. Non-Natural Image Understanding with Advancing Frequency-based Vision Encoders
    CVPR 2025 ·
    Wang Lin
    ,
    Qingsong Wang
    ,
    Yueying Feng
    ,
    Shulei Wang
    ,
    Tao Jin
    , Zhou Zhao,
    Fei Wu
    ,
    Chang Yao
    ,
    Jingyuan Chen
  42. OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use
    ACL 2025 ·
    Xueyu Hu
    ,
    Tao Xiong
    ,
    Biao Yi
    ,
    Zishu Wei
    ,
    Ruixuan Xiao
    ,
    Yurun Chen
    ,
    Jiasheng Ye
    ,
    Meiling Tao
    ,
    Xiangxin Zhou
    ,
    Ziyu Zhao
    ,
    Yuhuai Li
    ,
    Shengze Xu
    ,
    Shenzhi Wang
    ,
    Xinchen Xu
    ,
    Shuofei Qiao
    ,
    Zhaokai Wang
    ,
    Kun Kuang
    ,
    Tieyong Zeng
    ,
    Liang Wang
    ,
    Jiwei Li
    ,
    Yuchen Eleanor Jiang
    ,
    Wangchunshu Zhou
    ,
    Guoyin Wang
    ,
    Keting Yin
    , Zhou Zhao,
    Hongxia Yang
    ,
    Fan Wu
    ,
    Shengyu Zhang
    ,
    Fei Wu
  43. OmniAudio: Generating Spatial Audio from 360-Degree Video
    ICML 2025 ·
    Huadai Liu
    ,
    Tianyi Luo
    ,
    Kaicheng Luo
    ,
    Qikai Jiang
    ,
    Peiwen Sun
    ,
    Jialei Wang
    ,
    Rongjie Huang
    ,
    Qian Chen
    ,
    Wen Wang
    ,
    Xiangtai Li
    ,
    Shiliang Zhang
    ,
    Zhijie Yan
    , Zhou Zhao,
    Wei Xue
  44. OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces
    ICLR 2025 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Minjie Hong
    ,
    Hang Zhang
    ,
    Luping Liu
    ,
    Rongjie Huang
    ,
    Xize Cheng
    ,
    Shengpeng Ji
    ,
    Tao Jin
    ,
    Hengshuang Zhao
    , Zhou Zhao
  45. OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup
    ICLR 2025 ·
    Xize Cheng
    ,
    Siqi Zheng
    ,
    Zehan Wang
    ,
    Minghui Fang
    ,
    Ziang Zhang
    ,
    Rongjie Huang
    ,
    Shengpeng Ji
    ,
    Jialong Zuo
    ,
    Tao Jin
    , Zhou Zhao
  46. Open-Set Cross Modal Generalization via Multimodal Unified Representation
    ICCV 2025 ·
    Hai Huang
    ,
    Yan Xia
    ,
    Shulei Wang
    ,
    Hanting Wang
    ,
    Minghui Fang
    ,
    Shengpeng Ji
    ,
    Sashuai Zhou
    ,
    Tao Jin
    , Zhou Zhao
  47. Orient Anything V2: Unifying Orientation and Rotation Understanding
    NeurIPS 2025 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Jiayang Xu
    ,
    Jialei Wang
    ,
    Tianyu Pang
    ,
    Chao Du
    ,
    Hengshuang Zhao
    , Zhou Zhao
  48. Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Models
    ICML 2025 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Tianyu Pang
    ,
    Chao Du
    ,
    Hengshuang Zhao
    , Zhou Zhao
  49. RecBase: Generative Foundation Model Pretraining for Zero-Shot Recommendation
    EMNLP 2025 ·
    Sashuai Zhou
    ,
    Weinan Gan
    ,
    Qijiong Liu
    ,
    Ke Lei
    ,
    Jieming Zhu
    ,
    Hai Huang
    ,
    Yan Xia
    ,
    Ruiming Tang
    ,
    Zhenhua Dong
    , Zhou Zhao
  50. Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching
    ACL 2025 ·
    Jialong Zuo
    ,
    Shengpeng Ji
    ,
    Minghui Fang
    ,
    Mingze Li
    ,
    Ziyue Jiang
    ,
    Xize Cheng
    ,
    Xiaoda Yang
    ,
    Feiyang Chen
    ,
    Xinyu Duan
    , Zhou Zhao
  51. RoboGround: Robotic Manipulation with Grounded Vision-Language Priors
    CVPR 2025 ·
    Haifeng Huang
    ,
    Xinyi Chen
    ,
    Yilun Chen
    ,
    Hao Li
    ,
    Xiaoshen Han
    ,
    Zehan Wang
    ,
    Tai Wang
    ,
    Jiangmiao Pang
    , Zhou Zhao
  52. SPMDM: Enhancing Masked Diffusion Models through Simplifying Sampling Path
    NeurIPS 2025 ·
    Yichen Zhu
    ,
    Weiyu Chen
    ,
    James Kwok
    , Zhou Zhao
  53. STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation
    ACL 2025 ·
    Wenxiang Guo
    ,
    Yu Zhang
    ,
    Changhao Pan
    ,
    Zhiyuan Zhu
    ,
    Ruiqi Li
    ,
    ZheTao Chen
    ,
    Wenhao Xu
    ,
    Fei Wu
    , Zhou Zhao
  54. Seeking and Updating with Live Visual Knowledge
    NeurIPS 2025 ·
    Mingyang Fu
    ,
    Yuyang Peng
    ,
    Dongping Chen
    ,
    Zetong Zhou
    ,
    Benlin Liu
    ,
    Yao Wan
    , Zhou Zhao,
    Philip S. Yu
    ,
    Ranjay Krishna
  55. Sign2Vis: Automated Data Visualization from Sign Language
    ACL 2025 ·
    Yao Wan
    ,
    Yang Wu
    ,
    Zhen Li
    ,
    Guobiao Zhang
    ,
    Hongyu Zhang
    , Zhou Zhao,
    Hai Jin
    ,
    April Yi Wang
  56. SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models
    IUI 2025 ·
    Bo Lin
    ,
    Yingjing Xu
    ,
    Xuanwen Bao
    , Zhou Zhao,
    Zhouyang Wang
    ,
    Jianwei Yin
  57. SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language
    CVPR 2025 ·
    Zehan Wang
    ,
    Sashuai Zhou
    ,
    Shaoxuan He
    ,
    Haifeng Huang
    ,
    Lihe Yang
    ,
    Ziang Zhang
    ,
    Xize Cheng
    ,
    Shengpeng Ji
    ,
    Tao Jin
    ,
    Hengshuang Zhao
    , Zhou Zhao
  58. Speech Watermarking with Discrete Intermediate Representations
    AAAI 2025 ·
    Shengpeng Ji
    ,
    Ziyue Jiang
    ,
    Jialong Zuo
    ,
    Minghui Fang
    ,
    Yifu Chen
    ,
    Tao Jin
    , Zhou Zhao
  59. T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback
    ACL 2025 ·
    Zehan Wang
    ,
    Ke Lei
    ,
    Chen Zhu
    ,
    Jiawei Huang
    ,
    Sashuai Zhou
    ,
    Luping Liu
    ,
    Xize Cheng
    ,
    Shengpeng Ji
    ,
    Zhenhui Ye
    ,
    Tao Jin
    , Zhou Zhao
  60. TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis
    ACL 2025 ·
    Yu Zhang
    ,
    Wenxiang Guo
    ,
    Changhao Pan
    ,
    Dongyu Yao
    ,
    Zhiyuan Zhu
    ,
    Ziyue Jiang
    ,
    Yuhan Wang
    ,
    Tao Jin
    , Zhou Zhao
  61. TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching
    AAAI 2025 ·
    Wenxiang Guo
    ,
    Yu Zhang
    ,
    Changhao Pan
    ,
    Rongjie Huang
    ,
    Li Tang
    ,
    Ruiqi Li
    ,
    Zhiqing Hong
    ,
    Yongqi Wang
    , Zhou Zhao
  62. ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing
    NeurIPS 2025 ·
    Huadai Liu
    ,
    Kaicheng Luo
    ,
    Jialei Wang
    ,
    Wen Wang
    ,
    Qian Chen
    , Zhou Zhao,
    Wei Xue
  63. Towards Transformer-Based Aligned Generation with Self-Coherence Guidance
    CVPR 2025 ·
    Shulei Wang
    ,
    Wang Lin
    ,
    Hai Huang
    ,
    Hanting Wang
    ,
    Sihang Cai
    ,
    WenKang Han
    ,
    Tao Jin
    ,
    Jingyuan Chen
    ,
    Jiacheng Sun
    ,
    Jieming Zhu
    , Zhou Zhao
  64. Versatile Framework for Song Generation with Prompt-based Control
    EMNLP 2025 ·
    Yu Zhang
    ,
    Wenxiang Guo
    ,
    Changhao Pan
    ,
    Zhiyuan Zhu
    ,
    Ruiqi Li
    ,
    Jingyu Lu
    ,
    Rongjie Huang
    ,
    Ruiyuan Zhang
    ,
    Zhiqing Hong
    ,
    Ziyue Jiang
    , Zhou Zhao
  65. Vinci: Deep Thinking in Text-to-Image Generation using Unified Model with Reinforcement Learning
    NeurIPS 2025 ·
    Wang Lin
    ,
    Wentao Hu
    ,
    Liyu Jia
    ,
    Kaihang Pan
    ,
    Majun Zhang
    , Zhou Zhao,
    Fei Wu
    ,
    Jingyuan Chen
    ,
    Hanwang Zhang
  66. VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?
    ICLR 2025 ·
    Xize Cheng
    ,
    Ruofan Hu
    ,
    Xiaoda Yang
    ,
    Jingyu Lu
    ,
    Dongjie Fu
    ,
    Zehan Wang
    ,
    Shengpeng Ji
    ,
    Rongjie Huang
    ,
    Boyang Zhang
    ,
    Tao Jin
    , Zhou Zhao
  67. WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling
    ICLR 2025 ·
    Shengpeng Ji
    ,
    Ziyue Jiang
    ,
    Wen Wang
    ,
    Yifu Chen
    ,
    Minghui Fang
    ,
    Jialong Zuo
    ,
    Qian Yang
    ,
    Xize Cheng
    ,
    Zehan Wang
    ,
    Ruiqi Li
    ,
    Ziang Zhang
    ,
    Xiaoda Yang
    ,
    Rongjie Huang
    ,
    Yidi Jiang
    ,
    Qian Chen
    ,
    Siqi Zheng
    , Zhou Zhao
  68. AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
    ACL 2024 ·
    Qian Yang
    ,
    Jin Xu
    ,
    Wenrui Liu
    ,
    Yunfei Chu
    ,
    Ziyue Jiang
    ,
    Xiaohuan Zhou
    ,
    Yichong Leng
    ,
    Yuanjun Lv
    , Zhou Zhao,
    Chang Zhou
    ,
    Jingren Zhou
  69. Action Imitation in Common Action Space for Customized Action Image Synthesis
    NeurIPS 2024 ·
    Wang Lin
    ,
    Jingyuan Chen
    ,
    Jiaxin Shi
    ,
    Zirun Guo
    ,
    Yichen Zhu
    ,
    Zehan Wang
    ,
    Tao Jin
    , Zhou Zhao,
    Fei Wu
    ,
    Shuicheng Yan
    ,
    Hanwang Zhang
  70. AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
    AAAI 2024 ·
    Rongjie Huang
    ,
    Mingze Li
    ,
    Dongchao Yang
    ,
    Jiatong Shi
    ,
    Xuankai Chang
    ,
    Zhenhui Ye
    ,
    Yuning Wu
    ,
    Zhiqing Hong
    ,
    Jiawei Huang
    ,
    Jinglin Liu
    ,
    Yi Ren
    ,
    Yuexian Zou
    , Zhou Zhao,
    Shinji Watanabe
  71. AudioLCM: Efficient and High-Quality Text-to-Audio Generation with Minimal Inference Steps
    ACM MM 2024 ·
    Huadai Liu
    ,
    Rongjie Huang
    ,
    Yang Liu
    ,
    Hengyuan Cao
    ,
    Jialei Wang
    ,
    Xize Cheng
    ,
    Siqi Zheng
    , Zhou Zhao
  72. Boosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts
    ACM MM 2024 ·
    Dongjie Fu
    ,
    Xize Cheng
    ,
    Xiaoda Yang
    ,
    Hanting Wang
    , Zhou Zhao,
    Tao Jin
  73. Calibrating Prompt from History for Continual Vision-Language Retrieval and Grounding
    ACM MM 2024 ·
    Tao Jin
    ,
    Weicai Yan
    ,
    Ye Wang
    ,
    Sihang Cai
    ,
    Qifan Shuai
    , Zhou Zhao
  74. Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers
    NeurIPS 2024 ·
    Haifeng Huang
    ,
    Yilun Chen
    ,
    Zehan Wang
    ,
    Rongjie Huang
    ,
    Runsen Xu
    ,
    Tai Wang
    ,
    Luping Liu
    ,
    Xize Cheng
    ,
    Yang Zhao
    ,
    Jiangmiao Pang
    , Zhou Zhao
  75. Classifier-guided Gradient Modulation for Enhanced Multimodal Learning
    NeurIPS 2024 ·
    Zirun Guo
    ,
    Tao Jin
    ,
    Jingyuan Chen
    , Zhou Zhao
  76. Cross-modal Observation Hypothesis Inference
    ACM MM 2024 ·
    Mengze Li
    ,
    Kairong Han
    ,
    Jiahe Xu
    ,
    Yueying Li
    ,
    Tao Wu
    , Zhou Zhao,
    Jiaxu Miao
    ,
    Shengyu Zhang
    ,
    Jingyuan Chen
  77. E3: Exploring Embodied Emotion Through A Large-Scale Egocentric Video Dataset
    NeurIPS 2024 ·
    Wang Lin
    ,
    Yueying Feng
    ,
    WenKang Han
    ,
    Tao Jin
    , Zhou Zhao,
    Fei Wu
    ,
    Chang Yao
    ,
    Jingyuan Chen
  78. EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration
    SIGKDD 2024 ·
    Ye Wang
    ,
    Jiahao Xun
    ,
    Minjie Hong
    ,
    Jieming Zhu
    ,
    Tao Jin
    ,
    Wang Lin
    ,
    Haoyuan Li
    ,
    Linjun Li
    ,
    Yan Xia
    , Zhou Zhao,
    Zhenhua Dong
  79. Extending Multi-modal Contrastive Representations
    NeurIPS 2024 ·
    Ziang Zhang
    ,
    Zehan Wang
    ,
    Luping Liu
    ,
    Rongjie Huang
    ,
    Xize Cheng
    ,
    Zhenhui Ye
    ,
    Wang Lin
    ,
    Huadai Liu
    ,
    Haifeng Huang
    ,
    Yang Zhao
    ,
    Tao Jin
    ,
    Siqi Zheng
    , Zhou Zhao
  80. FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion
    ICML 2024 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Xize Cheng
    ,
    Rongjie Huang
    ,
    Luping Liu
    ,
    Zhenhui Ye
    ,
    Haifeng Huang
    ,
    Yang Zhao
    ,
    Tao Jin
    ,
    Peng Gao
    , Zhou Zhao
  81. Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching
    NeurIPS 2024 ·
    Yongqi Wang
    ,
    Wenxiang Guo
    ,
    Rongjie Huang
    ,
    Jiawei Huang
    ,
    Zehan Wang
    ,
    Fuming You
    ,
    Ruiqi Li
    , Zhou Zhao
  82. GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks
    NeurIPS 2024 ·
    Yu Zhang
    ,
    Changhao Pan
    ,
    Wenxiang Guo
    ,
    Ruiqi Li
    ,
    Zhiyuan Zhu
    ,
    Jialei Wang
    ,
    Wenhao Xu
    ,
    Jingyu Lu
    ,
    Zhiqing Hong
    ,
    Chuxin Wang
    ,
    Lichao Zhang
    ,
    Jinzheng He
    ,
    Ziyue Jiang
    ,
    Yuxin Chen
    ,
    Chen Yang
    ,
    Jiecheng Zhou
    ,
    Xinyu Cheng
    , Zhou Zhao
  83. InstructSpeech: Following Speech Editing Instructions via Large Language Models
    ICML 2024 ·
    Rongjie Huang
    ,
    Ruofan Hu
    ,
    Yongqi Wang
    ,
    Zehan Wang
    ,
    Xize Cheng
    ,
    Ziyue Jiang
    ,
    Zhenhui Ye
    ,
    Dongchao Yang
    ,
    Luping Liu
    ,
    Peng Gao
    , Zhou Zhao
  84. Low-rank Prompt Interaction for Continual Vision-Language Retrieval
    ACM MM 2024 ·
    Weicai Yan
    ,
    Ye Wang
    ,
    Wang Lin
    ,
    Zirun Guo
    , Zhou Zhao,
    Tao Jin
  85. MART: Learning Hierarchical Music Audio Representations with Part-Whole Transformer
    WWW 2024 ·
    Dong Yao
    ,
    Jieming Zhu
    ,
    Jiahao Xun
    ,
    Shengyu Zhang
    , Zhou Zhao,
    Liqun Deng
    ,
    Wenqiao Zhang
    ,
    Zhenhua Dong
    ,
    Xin Jiang
  86. MPOD123: One Image to 3D Content Generation Using Mask-Enhanced Progressive Outline-to-Detail Optimization
    CVPR 2024 ·
    Jimin Xu
    ,
    Tianbao Wang
    ,
    Tao Jin
    ,
    Shengyu Zhang
    ,
    Dongjie Fu
    ,
    Zhe Wang
    ,
    Jiangjing Lyu
    ,
    Chengfei Lv
    ,
    Chaoyue Niu
    ,
    Zhou Yu
    , Zhou Zhao,
    Fei Wu
  87. MSceneSpeech: A Multi-Scene Speech Dataset For Expressive Speech Synthesis
    InterSpeech 2024 ·
    Qian Yang
    ,
    Jialong Zuo
    ,
    Zhe Su
    ,
    Ziyue Jiang
    ,
    Mingze Li
    , Zhou Zhao,
    Feiyang Chen
    ,
    Zhefeng Wang
    ,
    Baoxing Huai
  88. Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners
    ACL 2024 ·
    Rongjie Huang
    ,
    Chunlei Zhang
    ,
    Yongqi Wang
    ,
    Dongchao Yang
    ,
    Jinchuan Tian
    ,
    Zhenhui Ye
    ,
    Luping Liu
    ,
    Zehan Wang
    ,
    Ziyue Jiang
    ,
    Xuankai Chang
    ,
    Jiatong Shi
    ,
    Chao Weng
    , Zhou Zhao,
    Dong Yu
  89. Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis
    ICLR 2024 ·
    Ziyue Jiang
    ,
    Jinglin Liu
    ,
    Yi Ren
    ,
    Jinzheng He
    ,
    Zhenhui Ye
    ,
    Shengpeng Ji
    ,
    Qian Yang
    ,
    Chen Zhang
    ,
    Pengfei Wei
    ,
    Chunfeng Wang
    ,
    Xiang Yin
    ,
    Zejun Ma
    , Zhou Zhao
  90. MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes
    NeurIPS 2024 ·
    Zhenhui Ye
    ,
    Tianyun Zhong
    ,
    Yi Ren
    ,
    Ziyue Jiang
    ,
    Jiawei Huang
    ,
    Rongjie Huang
    ,
    Jinglin Liu
    ,
    Jinzheng He
    ,
    Chen Zhang
    ,
    Zehan Wang
    ,
    Xize Cheng
    ,
    Xiang Yin
    , Zhou Zhao
  91. MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence
    NeurIPS 2024 ·
    Fuming You
    ,
    Minghui Fang
    ,
    Li Tang
    ,
    Rongjie Huang
    ,
    Yongqi Wang
    , Zhou Zhao
  92. MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech
    ACL 2024 ·
    Shengpeng Ji
    ,
    Ziyue Jiang
    ,
    Hanting Wang
    ,
    Jialong Zuo
    , Zhou Zhao
  93. Multimodal Pretraining, Adaptation, and Generation for Recommendation: A Survey
    SIGKDD 2024 ·
    Qijiong Liu
    ,
    Jieming Zhu
    ,
    Yanting Yang
    ,
    Quanyu Dai
    ,
    Zhaocheng Du
    ,
    Xiao-Ming Wu
    , Zhou Zhao,
    Rui Zhang
    ,
    Zhenhua Dong
  94. Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition
    ACL 2024 ·
    Zirun Guo
    ,
    Tao Jin
    , Zhou Zhao
  95. Non-confusing Generation of Customized Concepts in Diffusion Models
    ICML 2024 ·
    Wang Lin
    ,
    Jingyuan Chen
    ,
    Jiaxin Shi
    ,
    Yichen Zhu
    ,
    Chen Liang
    ,
    Junzhong Miao
    ,
    Tao Jin
    , Zhou Zhao,
    Fei Wu
    ,
    Shuicheng Yan
    ,
    Hanwang Zhang
  96. Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt
    NAACL 2024 ·
    Yongqi Wang
    ,
    Ruofan Hu
    ,
    Rongjie Huang
    ,
    Zhiqing Hong
    ,
    Ruiqi Li
    ,
    Wenrui Liu
    ,
    Fuming You
    ,
    Tao Jin
    , Zhou Zhao
  97. Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis
    ICLR 2024 ·
    Zhenhui Ye
    ,
    Tianyun Zhong
    ,
    Yi Ren
    ,
    Jiaqi Yang
    ,
    Weichuang Li
    ,
    Jiawei Huang
    ,
    Ziyue Jiang
    ,
    Jinzheng He
    ,
    Rongjie Huang
    ,
    Jinglin Liu
    ,
    Chen Zhang
    ,
    Xiang Yin
    ,
    Zejun Ma
    , Zhou Zhao
  98. Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment
    ACL 2024 ·
    Tao Jin
    ,
    Wang Lin
    ,
    Ye Wang
    ,
    Linjun Li
    ,
    Xize Cheng
    , Zhou Zhao
  99. Robust Singing Voice Transcription Serves Synthesis
    ACL 2024 ·
    Ruiqi Li
    ,
    Yu Zhang
    ,
    Yongqi Wang
    ,
    Zhiqing Hong
    ,
    Rongjie Huang
    , Zhou Zhao
  100. Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion
    ACL 2024 ·
    Ruiqi Li
    ,
    Rongjie Huang
    ,
    Yongqi Wang
    ,
    Zhiqing Hong
    , Zhou Zhao
  101. Semantic Alignment for Multimodal Large Language Models
    ACM MM 2024 ·
    Tao Wu
    ,
    Mengze Li
    ,
    Jingyuan Chen
    ,
    Wei Ji
    ,
    Wang Lin
    ,
    Jinyang Gao
    ,
    Kun Kuang
    , Zhou Zhao,
    Fei Wu
  102. Semantic Codebook Learning for Dynamic Recommendation Models
    ACM MM 2024 ·
    Zheqi Lv
    ,
    Shaoxuan He
    ,
    Tianyu Zhan
    ,
    Shengyu Zhang
    ,
    Wenqiao Zhang
    ,
    Jingyuan Chen
    , Zhou Zhao,
    Fei Wu
  103. Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer
    ACL 2024 ·
    Yongqi Wang
    ,
    Jionghao Bai
    ,
    Rongjie Huang
    ,
    Ruiqi Li
    ,
    Zhiqing Hong
    , Zhou Zhao
  104. StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis
    AAAI 2024 ·
    Yu Zhang
    ,
    Rongjie Huang
    ,
    Ruiqi Li
    ,
    Jinzheng He
    ,
    Yan Xia
    ,
    Feiyang Chen
    ,
    Xinyu Duan
    ,
    Baoxing Huai
    , Zhou Zhao
  105. SyncTalklip: Highly Synchronized Lip-Readable Speaker Generation with Multi-Task Learning
    ACM MM 2024 ·
    Xiaoda Yang
    ,
    Xize Cheng
    ,
    Dongjie Fu
    ,
    Minghui Fang
    ,
    Jialong Zuo
    ,
    Shengpeng Ji
    , Zhou Zhao,
    Tao Jin
  106. TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control
    EMNLP 2024 ·
    Yu Zhang
    ,
    Ziyue Jiang
    ,
    Ruiqi Li
    ,
    Changhao Pan
    ,
    Jinzheng He
    ,
    Rongjie Huang
    ,
    Chuxin Wang
    , Zhou Zhao
  107. Text-to-Song: Towards Controllable Music Generation Incorporating Vocal and Accompaniment
    ACL 2024 ·
    Zhiqing Hong
    ,
    Rongjie Huang
    ,
    Xize Cheng
    ,
    Yongqi Wang
    ,
    Ruiqi Li
    ,
    Fuming You
    , Zhou Zhao,
    Zhimeng Zhang
  108. TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation
    ACL 2024 ·
    Xize Cheng
    ,
    Rongjie Huang
    ,
    Linjun Li
    ,
    Zehan Wang
    ,
    Tao Jin
    ,
    Aoxiong Yin
    ,
    Feiyang Chen
    ,
    Xinyu Duan
    ,
    Baoxing Huai
    , Zhou Zhao
  109. Uni-Dubbing: Zero-Shot Speech Synthesis from Visual Articulation
    ACL 2024 ·
    Songju Lei
    ,
    Xize Cheng
    ,
    Mengjiao Lyu
    ,
    Jianqiao Hu
    ,
    Jintao Tan
    ,
    Runlin Liu
    ,
    Lingyu Xiong
    ,
    Tao Jin
    ,
    Xiandong Li
    , Zhou Zhao
  110. UniAudio: Towards Universal Audio Generation with Large Language Models
    ICML 2024 ·
    Dongchao Yang
    ,
    Jinchuan Tian
    ,
    Xu Tan
    ,
    Rongjie Huang
    ,
    Songxiang Liu
    ,
    Haohan Guo
    ,
    Xuankai Chang
    ,
    Jiatong Shi
    ,
    Sheng Zhao
    ,
    Jiang Bian
    , Zhou Zhao,
    Xixin Wu
    ,
    Helen M. Meng
  111. VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation
    ACM MM 2024 ·
    Rongjie Huang
    ,
    Yongqi Wang
    ,
    Ruofan Hu
    ,
    Xiaoshan Xu
    ,
    Zhiqing Hong
    ,
    Dongchao Yang
    ,
    Xize Cheng
    ,
    Zehan Wang
    ,
    Ziyue Jiang
    ,
    Zhenhui Ye
    ,
    Luping Liu
    ,
    Siqi Zheng
    , Zhou Zhao
  112. Wav2SQL: Direct Generalizable Speech-To-SQL Parsing
    ACL 2024 ·
    Huadai Liu
    ,
    Rongjie Huang
    ,
    Jinzheng He
    ,
    Gang Sun
    ,
    Ran Shen
    ,
    Xize Cheng
    , Zhou Zhao