PPaperPicks

Ziyang Ma

Shanghai Jiao Tong University, Department of Computer Science and Engineering, AI Institute, MoE Key Lab of Artificial Intelligence, Shanghai, China

30 papers at tracked venues · 22 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0002-8195-3262 ↗Google Scholar ↗Homepage ↗

Venues

ACL ×11InterSpeech ×5AAAI ×4ACM MM ×3EMNLP ×2NeurIPS ×2ICLR ×1ICML ×1IJCAI ×1

Frequent coauthors

Xie Chen
×28
Wenxi Chen
×10
Zhikang Niu
×8
Guanrou Yang
×8
Yifan Yang
×8
Kai Yu
×8
Xiquan Li
×7
Tianrui Wang
×5
Zhuo Chen
×5
Zhisheng Zheng
×5
Yuzhe Liang
×4
Yakun Song
×4

Papers

  1. Evaluating the Expressive Appropriateness of Speech in Rich Contexts
    ACL 2026 ·
    Tianrui Wang
    , Ziyang Ma,
    Yizhou Peng
    ,
    Haoyu Wang
    ,
    Zhikang Niu
    ,
    Zikang Huang
    ,
    Yihao Wu
    ,
    Yi-Wen Chao
    ,
    Yu Jiang
    ,
    Yuheng Lu
    ,
    Guanrou Yang
    ,
    Xuanchen Li
    ,
    Hexin Liu
    ,
    Chunyu Qiang
    ,
    Cheng Gong
    ,
    Yifan Yang
    ,
    Tianchi Liu
    ,
    Junyu Wang
    ,
    Nana Hou
    ,
    Meng Ge
    ,
    Fuming You
    ,
    Yang Wei
    ,
    Zhongqian Sun
    ,
    Haifeng Hu
    ,
    Xiaobao Wang
    ,
    Eng Siong Chng
    ,
    Xie Chen
    ,
    Longbiao Wang
    ,
    Jianwu Dang
  2. FineLAP: Taming Heterogeneous Supervision for Fine-grained Language-Audio Pretraining
    ACL 2026 ·
    Xiquan Li
    ,
    Xuenan Xu
    , Ziyang Ma,
    Wenxi Chen
    ,
    Haolin He
    ,
    Qiuqiang Kong
    ,
    Xie Chen
  3. SAC: Neural Speech Codec with Semantic-Acoustic Dual-Stream Quantization
    ACL 2026 ·
    Wenxi Chen
    ,
    Ruiqi Yan
    ,
    Yushen Chen
    ,
    Zhikang Niu
    , Ziyang Ma,
    Xiquan Li
    ,
    Yuzhe Liang
    ,
    Wenhan Lin
    ,
    Shunshun Yin
    ,
    Ming Tao
    ,
    Xinsheng Wang
    ,
    Xie Chen
  4. Towards Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training
    ACL 2026 ·
    Yifan Yang
    ,
    Bing Han
    ,
    Hui Wang
    ,
    Wei Wang
    , Ziyang Ma,
    Long Zhou
    ,
    Zengrui Jin
    ,
    Guanrou Yang
    ,
    Tianrui Wang
    ,
    Xu Tan
    ,
    Xie Chen
  5. Accelerating Flow-Matching-Based Text-to-Speech via Empirically Pruned Step Sampling
    InterSpeech 2025 ·
    Qixi Zheng
    ,
    Yushen Chen
    ,
    Zhikang Niu
    , Ziyang Ma,
    Xiaofei Wang
    ,
    Kai Yu
    ,
    Xie Chen
  6. ELLA-V: Stable Neural Codec Language Modeling with Alignment-Guided Sequence Reordering
    AAAI 2025 ·
    Yakun Song
    ,
    Zhuo Chen
    ,
    Xiaofei Wang
    , Ziyang Ma,
    Xie Chen
  7. EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting
    ACM MM 2025 ·
    Guanrou Yang
    ,
    Chen Yang
    ,
    Qian Chen
    , Ziyang Ma,
    Wenxi Chen
    ,
    Wen Wang
    ,
    Tianrui Wang
    ,
    Yifan Yang
    ,
    Zhikang Niu
    ,
    Wenrui Liu
    ,
    Fan Yu
    ,
    Zhihao Du
    ,
    Zhifu Gao
    ,
    Shiliang Zhang
    ,
    Xie Chen
  8. Enhancing Speech-to-Speech Dialogue Modeling with End-to-End Retrieval-Augmented Generation
    EMNLP 2025 ·
    Pengchao Feng
    , Ziyang Ma,
    Wenxi Chen
    ,
    Yao Li
    ,
    Sheng Wang
    ,
    Kai Yu
    ,
    Xie Chen
  9. F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching
    ACL 2025 ·
    Yushen Chen
    ,
    Zhikang Niu
    , Ziyang Ma,
    Keqi Deng
    ,
    Chunhui Wang
    ,
    Jian Zhao
    ,
    Kai Yu
    ,
    Xie Chen
  10. GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement
    ACL 2025 ·
    Yifan Yang
    ,
    Zheshu Song
    ,
    Jianheng Zhuo
    ,
    Mingyu Cui
    ,
    Jinpeng Li
    ,
    Bo Yang
    ,
    Yexing Du
    , Ziyang Ma,
    Xunying Liu
    ,
    Ziyuan Wang
    ,
    Ke Li
    ,
    Shuai Fan
    ,
    Kai Yu
    ,
    Wei-Qiang Zhang
    ,
    Guoguo Chen
    ,
    Xie Chen
  11. Language Model Can Listen While Speaking
    AAAI 2025 · Ziyang Ma,
    Yakun Song
    ,
    Chenpeng Du
    ,
    Jian Cong
    ,
    Zhuo Chen
    ,
    Yuping Wang
    ,
    Yuxuan Wang
    ,
    Xie Chen
  12. MER 2025: When Affective Computing Meets Large Language Models
    ACM MM 2025 ·
    Zheng Lian
    ,
    Rui Liu
    ,
    Kele Xu
    ,
    Bin Liu
    ,
    Xuefei Liu
    ,
    Yazhou Zhang
    ,
    Xin Liu
    ,
    Yong Li
    ,
    Zebang Cheng
    ,
    Haolin Zuo
    , Ziyang Ma,
    Xiaojiang Peng
    ,
    Xie Chen
    ,
    Ya Li
    ,
    Erik Cambria
    ,
    Guoying Zhao
    ,
    Björn W. Schuller
    ,
    Jianhua Tao
  13. MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
    NeurIPS 2025 · Ziyang Ma,
    Yinghao Ma
    ,
    Yanqiao Zhu
    ,
    Chen Yang
    ,
    Yi-Wen Chao
    ,
    Ruiyang Xu
    ,
    Wenxi Chen
    ,
    Yuanzhe Chen
    ,
    Zhuo Chen
    ,
    Jian Cong
    ,
    Kai Li
    ,
    Keliang Li
    ,
    Siyou Li
    ,
    Xinfeng Li
    ,
    Xiquan Li
    ,
    Zheng Lian
    ,
    Yuzhe Liang
    ,
    Minghao Liu
    ,
    Zhikang Niu
    ,
    Tianrui Wang
    ,
    Yuping Wang
    ,
    Yuxuan Wang
    ,
    Yihao Wu
    ,
    Guanrou Yang
    ,
    Jianwei Yu
    ,
    Ruibin Yuan
    ,
    Zhisheng Zheng
    ,
    Ziya Zhou
    ,
    Haina Zhu
    ,
    Wei Xue
    ,
    Emmanouil Benetos
    ,
    Kai Yu
    ,
    Eng-Siong Chng
    ,
    Xie Chen
  14. Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learning
    ACL 2025 ·
    Yexing Du
    ,
    Youcheng Pan
    , Ziyang Ma,
    Bo Yang
    ,
    Yifan Yang
    ,
    Keqi Deng
    ,
    Xie Chen
    ,
    Yang Xiang
    ,
    Ming Liu
    ,
    Bing Qin
  15. MuPT: A Generative Symbolic Music Pretrained Transformer
    ICLR 2025 ·
    Xingwei Qu
    ,
    Yuelin Bai
    ,
    Yinghao Ma
    ,
    Ziya Zhou
    ,
    Ka Man Lo
    ,
    Jiaheng Liu
    ,
    Ruibin Yuan
    ,
    Lejun Min
    ,
    Xueling Liu
    ,
    Tianyu Zhang
    ,
    Xeron Du
    ,
    Shuyue Guo
    ,
    Yiming Liang
    ,
    Yizhi Li
    ,
    Shangda Wu
    ,
    Junting Zhou
    ,
    Tianyu Zheng
    , Ziyang Ma,
    Fengze Han
    ,
    Wei Xue
    ,
    Gus Xia
    ,
    Emmanouil Benetos
    ,
    Xiang Yue
    ,
    Chenghua Lin
    ,
    Xu Tan
    ,
    Wenhao Huang
    ,
    Jie Fu
    ,
    Ge Zhang
  16. SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training
    ACL 2025 ·
    Wenxi Chen
    , Ziyang Ma,
    Ruiqi Yan
    ,
    Yuzhe Liang
    ,
    Xiquan Li
    ,
    Ruiyang Xu
    ,
    Zhikang Niu
    ,
    Yanqiao Zhu
    ,
    Yifan Yang
    ,
    Zhanxun Liu
    ,
    Kai Yu
    ,
    Yuxuan Hu
    ,
    Jinyu Li
    ,
    Yan Lu
    ,
    Shujie Liu
    ,
    Xie Chen
  17. Speech Recognition Meets Large Language Model: Benchmarking, Models, and Exploration
    AAAI 2025 · Ziyang Ma,
    Guanrou Yang
    ,
    Yifan Yang
    ,
    Zhifu Gao
    ,
    Jiaming Wang
    ,
    Zhihao Du
    ,
    Fan Yu
    ,
    Qian Chen
    ,
    Siqi Zheng
    ,
    Shiliang Zhang
    ,
    Xie Chen
  18. Towards Reliable Large Audio Language Model
    ACL 2025 · Ziyang Ma,
    Xiquan Li
    ,
    Yakun Song
    ,
    Wenxi Chen
    ,
    Chenpeng Du
    ,
    Jian Wu
    ,
    Yuanzhe Chen
    ,
    Zhuo Chen
    ,
    Yuping Wang
    ,
    Yuxuan Wang
    ,
    Xie Chen
  19. URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models
    EMNLP 2025 ·
    Ruiqi Yan
    ,
    Xiquan Li
    ,
    Wenxi Chen
    ,
    Zhikang Niu
    ,
    Chen Yang
    , Ziyang Ma,
    Kai Yu
    ,
    Xie Chen
  20. VQTalker: Towards Multilingual Talking Avatars Through Facial Motion Tokenization
    AAAI 2025 ·
    Tao Liu
    , Ziyang Ma,
    Qi Chen
    ,
    Feilong Chen
    ,
    Shuai Fan
    ,
    Xie Chen
    ,
    Kai Yu
  21. Word-Level Emotional Expression Control in Zero-Shot Text-to-Speech Synthesis
    NeurIPS 2025 ·
    Tianrui Wang
    ,
    Haoyu Wang
    ,
    Meng Ge
    ,
    Cheng Gong
    ,
    Chunyu Qiang
    , Ziyang Ma,
    Zikang Huang
    ,
    Guanrou Yang
    ,
    Xiaobao Wang
    ,
    Eng-Siong Chng
    ,
    Xie Chen
    ,
    Longbiao Wang
    ,
    Jianwu Dang
  22. BAT: Learning to Reason about Spatial Sounds with Large Language Models
    ICML 2024 ·
    Zhisheng Zheng
    ,
    Puyuan Peng
    , Ziyang Ma,
    Xie Chen
    ,
    Eunsol Choi
    ,
    David Harwath
  23. ChatMusician: Understanding and Generating Music Intrinsically with LLM
    ACL 2024 ·
    Ruibin Yuan
    ,
    Hanfeng Lin
    ,
    Yi Wang
    ,
    Zeyue Tian
    ,
    Shangda Wu
    ,
    Tianhao Shen
    ,
    Ge Zhang
    ,
    Yuhang Wu
    ,
    Cong Liu
    ,
    Ziya Zhou
    ,
    Liumeng Xue
    , Ziyang Ma,
    Qin Liu
    ,
    Tianyu Zheng
    ,
    Yizhi Li
    ,
    Yinghao Ma
    ,
    Yiming Liang
    ,
    Xiaowei Chi
    ,
    Ruibo Liu
    ,
    Zili Wang
    ,
    Chenghua Lin
    ,
    Qifeng Liu
    ,
    Tao Jiang
    ,
    Wenhao Huang
    ,
    Wenhu Chen
    ,
    Jie Fu
    ,
    Emmanouil Benetos
    ,
    Gus Xia
    ,
    Roger B. Dannenberg
    ,
    Wei Xue
    ,
    Shiyin Kang
    ,
    Yike Guo
  24. EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
    IJCAI 2024 ·
    Wenxi Chen
    ,
    Yuzhe Liang
    , Ziyang Ma,
    Zhisheng Zheng
    ,
    Xie Chen
  25. EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark
    InterSpeech 2024 · Ziyang Ma,
    Mingjie Chen
    ,
    Hezhao Zhang
    ,
    Zhisheng Zheng
    ,
    Wenxi Chen
    ,
    Xiquan Li
    ,
    Jiaxin Ye
    ,
    Xie Chen
    ,
    Thomas Hain
  26. LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR
    InterSpeech 2024 ·
    Zheshu Song
    ,
    Jianheng Zhuo
    ,
    Yifan Yang
    , Ziyang Ma,
    Shixiong Zhang
    ,
    Xie Chen
  27. MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognition
    ACM MM 2024 ·
    Zheng Lian
    ,
    Haiyang Sun
    ,
    Licai Sun
    ,
    Zhuofan Wen
    ,
    Siyuan Zhang
    ,
    Shun Chen
    ,
    Hao Gu
    ,
    Jinming Zhao
    , Ziyang Ma,
    Xie Chen
    ,
    Jiangyan Yi
    ,
    Rui Liu
    ,
    Kele Xu
    ,
    Bin Liu
    ,
    Erik Cambria
    ,
    Guoying Zhao
    ,
    Björn W. Schuller
    ,
    Jianhua Tao
  28. MaLa-ASR: Multimedia-Assisted LLM-Based ASR
    InterSpeech 2024 ·
    Guanrou Yang
    , Ziyang Ma,
    Fan Yu
    ,
    Zhifu Gao
    ,
    Shiliang Zhang
    ,
    Xie Chen
  29. TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers
    InterSpeech 2024 ·
    Yakun Song
    ,
    Zhuo Chen
    ,
    Xiaofei Wang
    , Ziyang Ma,
    Guanrou Yang
    ,
    Xie Chen
  30. emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
    ACL 2024 · Ziyang Ma,
    Zhisheng Zheng
    ,
    Jiaxin Ye
    ,
    Jinchao Li
    ,
    Zhifu Gao
    ,
    Shiliang Zhang
    ,
    Xie Chen