PPaperPicks

Zhiyong Wu

Tsinghua University, Joint Research Center for Media Sciences, Beijing, China

30 papers at tracked venues · 19 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0001-8533-0524 ↗Homepage ↗

Venues

InterSpeech ×10ACM MM ×7AAAI ×6ACL ×2NeurIPS ×2CVPR ×1ICLR ×1IJCAI ×1

Frequent coauthors

Helen Meng
×8
Xixin Wu
×8
Yixuan Zhou
×7
Yaoxun Xu
×7
Hangting Chen
×5
Shun Lei
×5
Dongchao Yang
×4
Yunrui Cai
×4
Jia Jia
×4
Jianwei Yu
×4
Xu He
×3
Runchuan Ye
×3

Papers

  1. DualSpeechLM: Towards Unified Speech Understanding and Generation via Dual Speech Token Modeling with Large Language Models
    AAAI 2026 ·
    Yuanyuan Wang
    ,
    Dongchao Yang
    ,
    Yiwen Shao
    ,
    Hangting Chen
    ,
    Jiankun Zhao
    , Zhiyong Wu,
    Helen Meng
    ,
    Xixin Wu
  2. Human-Centric Video Generation via Collaborative Multi-Modal Conditioning
    AAAI 2026 ·
    Liyang Chen
    ,
    Tianxiang Ma
    ,
    Jiawei Liu
    ,
    Bingchuan Li
    ,
    Zhuowei Chen
    ,
    Lijie Liu
    ,
    Xu He
    ,
    Gen Li
    ,
    Qian He
    , Zhiyong Wu
  3. Truth or Sophistry? LoFa: A Benchmark for LLM Robustness Against Logical Fallacies
    ACL 2026 ·
    Xudong Shen
    ,
    Li Yuan
    ,
    Ye Chen
    ,
    Xin Wu
    ,
    Yi Cai
    , Zhiyong Wu
  4. UniSRM: A Unified Speech Reward Model for Reasoning-Based Fine-grained Assessment
    ACL 2026 ·
    Yuanyuan Wang
    ,
    Dongchao Yang
    ,
    Yayue Deng
    , Zhiyong Wu,
    Steven Y. Guo
    ,
    Helen M. Meng
    ,
    Xixin Wu
  5. A Dual-Branch Ensemble Framework for Personality Recognition Based on Multimodal Emotion Features
    ACM MM 2025 ·
    Renjie Yu
    ,
    Yunrui Cai
    ,
    Yixuan Zhou
    ,
    Runchuan Ye
    , Zhiyong Wu
  6. DAFMSVC: One-Shot Singing Voice Conversion with Dual Attention Mechanism and Flow Matching
    InterSpeech 2025 ·
    Wei Chen
    ,
    Binzhu Sha
    ,
    Dan Luo
    ,
    Jing Yang
    ,
    Zhuo Wang
    ,
    Fan Fan
    , Zhiyong Wu
  7. DiffDSR: Dysarthric Speech Reconstruction Using Latent Diffusion Model
    InterSpeech 2025 ·
    Xueyuan Chen
    ,
    Dongchao Yang
    ,
    Wenxuan Wu
    ,
    Minglin Wu
    ,
    Jing Xu
    ,
    Xixin Wu
    , Zhiyong Wu,
    Helen Meng
  8. Enhancing Generalization of Speech Large Language Models with Multi-Task Behavior Imitation and Speech-Text Interleaving
    InterSpeech 2025 ·
    Jingran Xie
    ,
    Xiang Li
    ,
    Hui Wang
    ,
    Yue Yu
    ,
    Yang Xiang
    ,
    Xixin Wu
    , Zhiyong Wu
  9. HarmoniVox: Painting Voices to Match the Avatar's Soul
    ACM MM 2025 ·
    Songtao Zhou
    ,
    Xiaoyu Qin
    ,
    Yixuan Zhou
    ,
    Qixin Wang
    ,
    Zeyu Jin
    ,
    Zixuan Wang
    , Zhiyong Wu,
    Jia Jia
  10. LeVo: High-Quality Song Generation with Multi-Preference Alignment
    NeurIPS 2025 ·
    Shun Lei
    ,
    Yaoxun Xu
    ,
    Zhiwei Lin
    ,
    Huaicheng Zhang
    ,
    Wei Tan
    ,
    Hangting Chen
    ,
    Yixuan Zhang
    ,
    Chenyu Yang
    ,
    Haina Zhu
    ,
    Shuai Wang
    , Zhiyong Wu,
    Dong Yu
  11. MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinement
    AAAI 2025 ·
    Xu He
    , Zhiyong Wu,
    Xiaoyu Li
    ,
    Di Kang
    ,
    Chaopeng Zhang
    ,
    Jiangnan Ye
    ,
    Liyang Chen
    ,
    Xiangjun Gao
    ,
    Han Zhang
    ,
    Haolin Zhuang
  12. MuCodec: Ultra Low-Bitrate Music Codec for Music Generation
    ACM MM 2025 ·
    Yaoxun Xu
    ,
    Hangting Chen
    ,
    Jianwei Yu
    ,
    Wei Tan
    ,
    Shun Lei
    ,
    Zhiwei Lin
    ,
    Rongzhi Gu
    , Zhiyong Wu
  13. RFWave: Multi-band Rectified Flow for Audio Waveform Reconstruction
    ICLR 2025 ·
    Peng Liu
    ,
    Dongyang Dai
    , Zhiyong Wu
  14. StarVC: A Unified Auto-Regressive Framework for Joint Text and Speech Generation in Voice Conversion
    InterSpeech 2025 ·
    Fengjin Li
    ,
    Jie Wang
    ,
    Yadong Niu
    ,
    Yongqing Wang
    ,
    Meng Meng
    ,
    Jian Luan
    , Zhiyong Wu
  15. VideoHumanMIB: Unlocking Appearance Decoupling for Video Human Motion In-betweening
    IJCAI 2025 ·
    Haiwei Xue
    ,
    Zhensong Zhang
    ,
    Minglei Li
    ,
    Zonghong Dai
    ,
    Fei Yu
    ,
    Fei Ma
    , Zhiyong Wu
  16. WAKE: Watermarking Audio with Key Enrichment
    InterSpeech 2025 ·
    Yaoxun Xu
    ,
    Jianwei Yu
    ,
    Hangting Chen
    , Zhiyong Wu,
    Xixin Wu
    ,
    Dong Yu
    ,
    Rongzhi Gu
    ,
    Yi Luo
  17. Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model
    CVPR 2024 ·
    Xu He
    ,
    Qiaochu Huang
    ,
    Zhensong Zhang
    ,
    Zhiwei Lin
    , Zhiyong Wu,
    Sicheng Yang
    ,
    Minglei Li
    ,
    Zhiyi Chen
    ,
    Songcen Xu
    ,
    Xiaofei Wu
  18. CoLM-DSR: Leveraging Neural Codec Language Modeling for Multi-Modal Dysarthric Speech Reconstruction
    InterSpeech 2024 ·
    Xueyuan Chen
    ,
    Dongchao Yang
    ,
    Dingdong Wang
    ,
    Xixin Wu
    , Zhiyong Wu,
    Helen Meng
  19. Comparing Discrete and Continuous Space LLMs for Speech Recognition
    InterSpeech 2024 ·
    Yaoxun Xu
    ,
    Shi-Xiong Zhang
    ,
    Jianwei Yu
    , Zhiyong Wu,
    Dong Yu
  20. Explore 3D Dance Generation via Reward Model from Automatically-Ranked Demonstrations
    AAAI 2024 ·
    Zilin Wang
    ,
    Haolin Zhuang
    ,
    Lu Li
    ,
    Yinmin Zhang
    ,
    Junjie Zhong
    ,
    Jun Chen
    ,
    Yu Yang
    ,
    Boshi Tang
    , Zhiyong Wu
  21. LoRA-MER: Low-Rank Adaptation of Pre-Trained Speech Models for Multimodal Emotion Recognition Using Mutual Information
    InterSpeech 2024 ·
    Yunrui Cai
    , Zhiyong Wu,
    Jia Jia
    ,
    Helen Meng
  22. Multimodal Emotion Captioning Using Large Language Model with Prompt Engineering
    ACM MM 2024 ·
    Yaoxun Xu
    ,
    Yixuan Zhou
    ,
    Yunrui Cai
    ,
    Jingran Xie
    ,
    Runchuan Ye
    , Zhiyong Wu
  23. Robust Representation Learning for Multimodal Emotion Recognition with Contrastive Learning and Mixup
    ACM MM 2024 ·
    Yunrui Cai
    ,
    Runchuan Ye
    ,
    Jingran Xie
    ,
    Yixuan Zhou
    ,
    Yaoxun Xu
    , Zhiyong Wu
  24. SECap: Speech Emotion Captioning with Large Language Model
    AAAI 2024 ·
    Yaoxun Xu
    ,
    Hangting Chen
    ,
    Jianwei Yu
    ,
    Qiaochu Huang
    , Zhiyong Wu,
    Shi-Xiong Zhang
    ,
    Guangzhi Li
    ,
    Yi Luo
    ,
    Rongzhi Gu
  25. SimCalib: Graph Neural Network Calibration Based on Similarity between Nodes
    AAAI 2024 ·
    Boshi Tang
    , Zhiyong Wu,
    Xixin Wu
    ,
    Qiaochu Huang
    ,
    Jun Chen
    ,
    Shun Lei
    ,
    Helen Meng
  26. SongCreator: Lyrics-based Universal Song Generation
    NeurIPS 2024 ·
    Shun Lei
    ,
    Yixuan Zhou
    ,
    Boshi Tang
    ,
    Max W. Y. Lam
    ,
    Feng Liu
    ,
    Hangyu Liu
    ,
    Jingcheng Wu
    ,
    Shiyin Kang
    , Zhiyong Wu,
    Helen Meng
  27. Speaker Change Detection with Weighted-sum Knowledge Distillation based on Self-supervised Pre-trained Models
    InterSpeech 2024 ·
    Hang Su
    ,
    Yuxiang Kong
    ,
    Lichun Fan
    ,
    Peng Gao
    ,
    Yujun Wang
    , Zhiyong Wu
  28. SpeechCraft: A Fine-Grained Expressive Speech Dataset with Natural Language Description
    ACM MM 2024 ·
    Zeyu Jin
    ,
    Jia Jia
    ,
    Qixin Wang
    ,
    Kehan Li
    ,
    Shuoyi Zhou
    ,
    Songtao Zhou
    ,
    Xiaoyu Qin
    , Zhiyong Wu
  29. Spontaneous Style Text-to-Speech Synthesis with Controllable Spontaneous Behaviors Based on Language Models
    InterSpeech 2024 ·
    Weiqin Li
    ,
    Peiji Yang
    ,
    Yicheng Zhong
    ,
    Yixuan Zhou
    ,
    Zhisheng Wang
    , Zhiyong Wu,
    Xixin Wu
    ,
    Helen Meng
  30. VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling
    ACM MM 2024 ·
    Yixuan Zhou
    ,
    Xiaoyu Qin
    ,
    Zeyu Jin
    ,
    Shuoyi Zhou
    ,
    Shun Lei
    ,
    Songtao Zhou
    , Zhiyong Wu,
    Jia Jia