PPaperPicks

Rongjie Huang

Zhejiang University, College of Computer Science and Software, Hangzhou, China

36 papers at tracked venues · 33 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0002-1695-9000 ↗Google Scholar ↗Homepage ↗

Venues

ACL ×10NeurIPS ×7ICLR ×6ICML ×4AAAI ×3ACM MM ×3EMNLP ×2NAACL ×1

Frequent coauthors

Zhou Zhao
×32
Xize Cheng
×15
Zehan Wang
×15
Ruiqi Li
×11
Yongqi Wang
×11
Zhiqing Hong
×9
Ziyue Jiang
×8
Zhenhui Ye
×8
Dongchao Yang
×7
Huadai Liu
×7
Luping Liu
×7
Tao Jin
×7

Papers

  1. Masked Text-to-Audio Flow-Matching and Reward Feedback Optimization
    ACL 2026 · Rongjie Huang,
    Dongchao Yang
    ,
    Wenxiang Guo
    ,
    Huadai Liu
    ,
    Xize Cheng
    ,
    Zehan Wang
    ,
    Zhou Zhao
    ,
    Xixin Wu
    ,
    Helen M. Meng
  2. FlashAudio: Rectified Flow for Fast and High-Fidelity Text-to-Audio Generation
    ACL 2025 ·
    Huadai Liu
    ,
    Jialei Wang
    , Rongjie Huang,
    Yang Liu
    ,
    Heng Lu
    ,
    Zhou Zhao
    ,
    Wei Xue
  3. Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization on Multi-party Conversation
    ACL 2025 ·
    Luyao Cheng
    ,
    Hui Wang
    ,
    Chong Deng
    ,
    Siqi Zheng
    ,
    Yafeng Chen
    , Rongjie Huang,
    Qinglin Zhang
    ,
    Qian Chen
    ,
    Xihao Li
    ,
    Wen Wang
  4. Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation
    ICLR 2025 ·
    Peng Gao
    ,
    Le Zhuo
    ,
    Dongyang Liu
    ,
    Ruoyi Du
    ,
    Xu Luo
    ,
    Longtian Qiu
    ,
    Yuhang Zhang
    , Rongjie Huang,
    Shijie Geng
    ,
    Renrui Zhang
    ,
    Junlin Xie
    ,
    Wenqi Shao
    ,
    Zhengkai Jiang
    ,
    Tianshuo Yang
    ,
    Weicai Ye
    ,
    Tong He
    ,
    Jingwen He
    ,
    Junjun He
    ,
    Yu Qiao
    ,
    Hongsheng Li
  5. MelodyEdit: Zero-shot Music Editing with Disentangled Inversion Control
    ACM MM 2025 ·
    Huadai Liu
    ,
    Jialei Wang
    ,
    Xiangtai Li
    ,
    Wen Wang
    ,
    Qian Chen
    , Rongjie Huang,
    Yang Liu
    ,
    Jiayang Xu
    ,
    Zhou Zhao
    ,
    Wei Xue
  6. OmniAudio: Generating Spatial Audio from 360-Degree Video
    ICML 2025 ·
    Huadai Liu
    ,
    Tianyi Luo
    ,
    Kaicheng Luo
    ,
    Qikai Jiang
    ,
    Peiwen Sun
    ,
    Jialei Wang
    , Rongjie Huang,
    Qian Chen
    ,
    Wen Wang
    ,
    Xiangtai Li
    ,
    Shiliang Zhang
    ,
    Zhijie Yan
    ,
    Zhou Zhao
    ,
    Wei Xue
  7. OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces
    ICLR 2025 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Minjie Hong
    ,
    Hang Zhang
    ,
    Luping Liu
    , Rongjie Huang,
    Xize Cheng
    ,
    Shengpeng Ji
    ,
    Tao Jin
    ,
    Hengshuang Zhao
    ,
    Zhou Zhao
  8. OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup
    ICLR 2025 ·
    Xize Cheng
    ,
    Siqi Zheng
    ,
    Zehan Wang
    ,
    Minghui Fang
    ,
    Ziang Zhang
    , Rongjie Huang,
    Shengpeng Ji
    ,
    Jialong Zuo
    ,
    Tao Jin
    ,
    Zhou Zhao
  9. TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching
    AAAI 2025 ·
    Wenxiang Guo
    ,
    Yu Zhang
    ,
    Changhao Pan
    , Rongjie Huang,
    Li Tang
    ,
    Ruiqi Li
    ,
    Zhiqing Hong
    ,
    Yongqi Wang
    ,
    Zhou Zhao
  10. Versatile Framework for Song Generation with Prompt-based Control
    EMNLP 2025 ·
    Yu Zhang
    ,
    Wenxiang Guo
    ,
    Changhao Pan
    ,
    Zhiyuan Zhu
    ,
    Ruiqi Li
    ,
    Jingyu Lu
    , Rongjie Huang,
    Ruiyuan Zhang
    ,
    Zhiqing Hong
    ,
    Ziyue Jiang
    ,
    Zhou Zhao
  11. VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?
    ICLR 2025 ·
    Xize Cheng
    ,
    Ruofan Hu
    ,
    Xiaoda Yang
    ,
    Jingyu Lu
    ,
    Dongjie Fu
    ,
    Zehan Wang
    ,
    Shengpeng Ji
    , Rongjie Huang,
    Boyang Zhang
    ,
    Tao Jin
    ,
    Zhou Zhao
  12. WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling
    ICLR 2025 ·
    Shengpeng Ji
    ,
    Ziyue Jiang
    ,
    Wen Wang
    ,
    Yifu Chen
    ,
    Minghui Fang
    ,
    Jialong Zuo
    ,
    Qian Yang
    ,
    Xize Cheng
    ,
    Zehan Wang
    ,
    Ruiqi Li
    ,
    Ziang Zhang
    ,
    Xiaoda Yang
    , Rongjie Huang,
    Yidi Jiang
    ,
    Qian Chen
    ,
    Siqi Zheng
    ,
    Zhou Zhao
  13. AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
    AAAI 2024 · Rongjie Huang,
    Mingze Li
    ,
    Dongchao Yang
    ,
    Jiatong Shi
    ,
    Xuankai Chang
    ,
    Zhenhui Ye
    ,
    Yuning Wu
    ,
    Zhiqing Hong
    ,
    Jiawei Huang
    ,
    Jinglin Liu
    ,
    Yi Ren
    ,
    Yuexian Zou
    ,
    Zhou Zhao
    ,
    Shinji Watanabe
  14. AudioLCM: Efficient and High-Quality Text-to-Audio Generation with Minimal Inference Steps
    ACM MM 2024 ·
    Huadai Liu
    , Rongjie Huang,
    Yang Liu
    ,
    Hengyuan Cao
    ,
    Jialei Wang
    ,
    Xize Cheng
    ,
    Siqi Zheng
    ,
    Zhou Zhao
  15. Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers
    NeurIPS 2024 ·
    Haifeng Huang
    ,
    Yilun Chen
    ,
    Zehan Wang
    , Rongjie Huang,
    Runsen Xu
    ,
    Tai Wang
    ,
    Luping Liu
    ,
    Xize Cheng
    ,
    Yang Zhao
    ,
    Jiangmiao Pang
    ,
    Zhou Zhao
  16. Extending Multi-modal Contrastive Representations
    NeurIPS 2024 ·
    Ziang Zhang
    ,
    Zehan Wang
    ,
    Luping Liu
    , Rongjie Huang,
    Xize Cheng
    ,
    Zhenhui Ye
    ,
    Wang Lin
    ,
    Huadai Liu
    ,
    Haifeng Huang
    ,
    Yang Zhao
    ,
    Tao Jin
    ,
    Siqi Zheng
    ,
    Zhou Zhao
  17. FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion
    ICML 2024 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Xize Cheng
    , Rongjie Huang,
    Luping Liu
    ,
    Zhenhui Ye
    ,
    Haifeng Huang
    ,
    Yang Zhao
    ,
    Tao Jin
    ,
    Peng Gao
    ,
    Zhou Zhao
  18. Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching
    NeurIPS 2024 ·
    Yongqi Wang
    ,
    Wenxiang Guo
    , Rongjie Huang,
    Jiawei Huang
    ,
    Zehan Wang
    ,
    Fuming You
    ,
    Ruiqi Li
    ,
    Zhou Zhao
  19. InstructSpeech: Following Speech Editing Instructions via Large Language Models
    ICML 2024 · Rongjie Huang,
    Ruofan Hu
    ,
    Yongqi Wang
    ,
    Zehan Wang
    ,
    Xize Cheng
    ,
    Ziyue Jiang
    ,
    Zhenhui Ye
    ,
    Dongchao Yang
    ,
    Luping Liu
    ,
    Peng Gao
    ,
    Zhou Zhao
  20. Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT
    NeurIPS 2024 ·
    Le Zhuo
    ,
    Ruoyi Du
    ,
    Han Xiao
    ,
    Yangguang Li
    ,
    Dongyang Liu
    , Rongjie Huang,
    Wenze Liu
    ,
    Xiangyang Zhu
    ,
    Fu-Yun Wang
    ,
    Zhanyu Ma
    ,
    Xu Luo
    ,
    Zehan Wang
    ,
    Kaipeng Zhang
    ,
    Lirui Zhao
    ,
    Si Liu
    ,
    Xiangyu Yue
    ,
    Wanli Ouyang
    ,
    Yu Qiao
    ,
    Hongsheng Li
    ,
    Peng Gao
  21. Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners
    ACL 2024 · Rongjie Huang,
    Chunlei Zhang
    ,
    Yongqi Wang
    ,
    Dongchao Yang
    ,
    Jinchuan Tian
    ,
    Zhenhui Ye
    ,
    Luping Liu
    ,
    Zehan Wang
    ,
    Ziyue Jiang
    ,
    Xuankai Chang
    ,
    Jiatong Shi
    ,
    Chao Weng
    ,
    Zhou Zhao
    ,
    Dong Yu
  22. MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes
    NeurIPS 2024 ·
    Zhenhui Ye
    ,
    Tianyun Zhong
    ,
    Yi Ren
    ,
    Ziyue Jiang
    ,
    Jiawei Huang
    , Rongjie Huang,
    Jinglin Liu
    ,
    Jinzheng He
    ,
    Chen Zhang
    ,
    Zehan Wang
    ,
    Xize Cheng
    ,
    Xiang Yin
    ,
    Zhou Zhao
  23. MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence
    NeurIPS 2024 ·
    Fuming You
    ,
    Minghui Fang
    ,
    Li Tang
    , Rongjie Huang,
    Yongqi Wang
    ,
    Zhou Zhao
  24. Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt
    NAACL 2024 ·
    Yongqi Wang
    ,
    Ruofan Hu
    , Rongjie Huang,
    Zhiqing Hong
    ,
    Ruiqi Li
    ,
    Wenrui Liu
    ,
    Fuming You
    ,
    Tao Jin
    ,
    Zhou Zhao
  25. Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis
    ICLR 2024 ·
    Zhenhui Ye
    ,
    Tianyun Zhong
    ,
    Yi Ren
    ,
    Jiaqi Yang
    ,
    Weichuang Li
    ,
    Jiawei Huang
    ,
    Ziyue Jiang
    ,
    Jinzheng He
    , Rongjie Huang,
    Jinglin Liu
    ,
    Chen Zhang
    ,
    Xiang Yin
    ,
    Zejun Ma
    ,
    Zhou Zhao
  26. Robust Singing Voice Transcription Serves Synthesis
    ACL 2024 ·
    Ruiqi Li
    ,
    Yu Zhang
    ,
    Yongqi Wang
    ,
    Zhiqing Hong
    , Rongjie Huang,
    Zhou Zhao
  27. Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion
    ACL 2024 ·
    Ruiqi Li
    , Rongjie Huang,
    Yongqi Wang
    ,
    Zhiqing Hong
    ,
    Zhou Zhao
  28. Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer
    ACL 2024 ·
    Yongqi Wang
    ,
    Jionghao Bai
    , Rongjie Huang,
    Ruiqi Li
    ,
    Zhiqing Hong
    ,
    Zhou Zhao
  29. StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis
    AAAI 2024 ·
    Yu Zhang
    , Rongjie Huang,
    Ruiqi Li
    ,
    Jinzheng He
    ,
    Yan Xia
    ,
    Feiyang Chen
    ,
    Xinyu Duan
    ,
    Baoxing Huai
    ,
    Zhou Zhao
  30. TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control
    EMNLP 2024 ·
    Yu Zhang
    ,
    Ziyue Jiang
    ,
    Ruiqi Li
    ,
    Changhao Pan
    ,
    Jinzheng He
    , Rongjie Huang,
    Chuxin Wang
    ,
    Zhou Zhao
  31. Text-to-Song: Towards Controllable Music Generation Incorporating Vocal and Accompaniment
    ACL 2024 ·
    Zhiqing Hong
    , Rongjie Huang,
    Xize Cheng
    ,
    Yongqi Wang
    ,
    Ruiqi Li
    ,
    Fuming You
    ,
    Zhou Zhao
    ,
    Zhimeng Zhang
  32. TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation
    ACL 2024 ·
    Xize Cheng
    , Rongjie Huang,
    Linjun Li
    ,
    Zehan Wang
    ,
    Tao Jin
    ,
    Aoxiong Yin
    ,
    Feiyang Chen
    ,
    Xinyu Duan
    ,
    Baoxing Huai
    ,
    Zhou Zhao
  33. UniAudio 1.5: Large Language Model-Driven Audio Codec is A Few-Shot Audio Task Learner
    NeurIPS 2024 ·
    Dongchao Yang
    ,
    Haohan Guo
    ,
    Yuanyuan Wang
    , Rongjie Huang,
    Xiang Li
    ,
    Xu Tan
    ,
    Xixin Wu
    ,
    Helen Meng
  34. UniAudio: Towards Universal Audio Generation with Large Language Models
    ICML 2024 ·
    Dongchao Yang
    ,
    Jinchuan Tian
    ,
    Xu Tan
    , Rongjie Huang,
    Songxiang Liu
    ,
    Haohan Guo
    ,
    Xuankai Chang
    ,
    Jiatong Shi
    ,
    Sheng Zhao
    ,
    Jiang Bian
    ,
    Zhou Zhao
    ,
    Xixin Wu
    ,
    Helen M. Meng
  35. VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation
    ACM MM 2024 · Rongjie Huang,
    Yongqi Wang
    ,
    Ruofan Hu
    ,
    Xiaoshan Xu
    ,
    Zhiqing Hong
    ,
    Dongchao Yang
    ,
    Xize Cheng
    ,
    Zehan Wang
    ,
    Ziyue Jiang
    ,
    Zhenhui Ye
    ,
    Luping Liu
    ,
    Siqi Zheng
    ,
    Zhou Zhao
  36. Wav2SQL: Direct Generalizable Speech-To-SQL Parsing
    ACL 2024 ·
    Huadai Liu
    , Rongjie Huang,
    Jinzheng He
    ,
    Gang Sun
    ,
    Ran Shen
    ,
    Xize Cheng
    ,
    Zhou Zhao