Xize Cheng

32 papers at tracked venues · 29 at CORE A* · active 2024–2026

DBLP profile ↗ORCID search ↗

Venues

ACL ×11 ACM MM ×5 ICLR ×4 NeurIPS ×4 EMNLP ×2 ICML ×2 AAAI ×1 CVPR ×1 InterSpeech ×1 SIGKDD ×1

Frequent coauthors

Zhou Zhao

×28

Zehan Wang

×17

Tao Jin

×17

Rongjie Huang

×15

Shengpeng Ji

×13

Xiaoda Yang

×10

Minghui Fang

×9

Jialong Zuo

×8

Luping Liu

×7

Dongjie Fu

×6

Siqi Zheng

×6

Ziang Zhang

×6

Papers

Masked Text-to-Audio Flow-Matching and Reward Feedback Optimization
ACL 2026 ·
Rongjie Huang
,
Dongchao Yang
,
Wenxiang Guo
,
Huadai Liu
, Xize Cheng,
Zehan Wang
,
Zhou Zhao
,
Xixin Wu
,
Helen M. Meng
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness
ACL 2026 ·
Jingyu Lu
,
Yuhan Wang
,
Fan Zhuo
, Xize Cheng,
Changhao Pan
,
Xueyi Pu
,
Yifu Chen
,
Chenyuhao Wen
,
Tianle Liang
,
Zhou Zhao
A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter
AAAI 2025 ·
Zirun Guo
, Xize Cheng,
Yangyang Wu
,
Tao Jin
AHa-Bench: Benchmarking Audio Hallucinations in Large Audio-Language Models
NeurIPS 2025 · Xize Cheng,
Dongjie Fu
,
Chenyuhao Wen
,
Shannon Yu
,
Zehan Wang
,
Shengpeng Ji
,
Siddhant Arora
,
Tao Jin
,
Shinji Watanabe
,
Zhou Zhao
CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling
ACL 2025 ·
Minghui Fang
,
Shengpeng Ji
,
Jialong Zuo
,
Hai Huang
,
Yan Xia
,
Jieming Zhu
, Xize Cheng,
Xiaoda Yang
,
Wenrui Liu
,
Gang Wang
,
Zhenhua Dong
,
Zhou Zhao
ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control
ACL 2025 ·
Shengpeng Ji
,
Qian Chen
,
Wen Wang
,
Jialong Zuo
,
Minghui Fang
,
Ziyue Jiang
,
Hai Huang
,
Zehan Wang
, Xize Cheng,
Siqi Zheng
,
Zhou Zhao
GTA: Towards Generative Text-To-Audio Retrieval via Multi-Scale Tokenizer
InterSpeech 2025 ·
Minghui Fang
,
Shengpeng Ji
,
Jialong Zuo
, Xize Cheng,
Wenrui Liu
,
Xiaoda Yang
,
Ruofan Hu
,
Jieming Zhu
,
Zhou Zhao
Multimodal Conditional Retrieval with High Controllability
SIGKDD 2025 ·
Xiaoda Yang
, Xize Cheng,
Minghui Fang
,
Hongshun Qiu
,
Yuhang Ma
,
Junyu Lu
,
Jiaqi Duan
,
Sihang Cai
,
Zehan Wang
,
Ruofan Hu
,
Dongjie Fu
,
Zhou Zhao
,
Tao Jin
OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces
ICLR 2025 ·
Zehan Wang
,
Ziang Zhang
,
Minjie Hong
,
Hang Zhang
,
Luping Liu
,
Rongjie Huang
, Xize Cheng,
Shengpeng Ji
,
Tao Jin
,
Hengshuang Zhao
,
Zhou Zhao
OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup
ICLR 2025 · Xize Cheng,
Siqi Zheng
,
Zehan Wang
,
Minghui Fang
,
Ziang Zhang
,
Rongjie Huang
,
Shengpeng Ji
,
Jialong Zuo
,
Tao Jin
,
Zhou Zhao
PACHAT: Persona-Aware Speech Assistant for Multi-party Dialogue
EMNLP 2025 ·
Dongjie Fu
, Xize Cheng,
Linjun Li
,
Xiaoda Yang
,
Lujia Yang
,
Tao Jin
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching
ACL 2025 ·
Jialong Zuo
,
Shengpeng Ji
,
Minghui Fang
,
Mingze Li
,
Ziyue Jiang
, Xize Cheng,
Xiaoda Yang
,
Feiyang Chen
,
Xinyu Duan
,
Zhou Zhao
SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language
CVPR 2025 ·
Zehan Wang
,
Sashuai Zhou
,
Shaoxuan He
,
Haifeng Huang
,
Lihe Yang
,
Ziang Zhang
, Xize Cheng,
Shengpeng Ji
,
Tao Jin
,
Hengshuang Zhao
,
Zhou Zhao
T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback
ACL 2025 ·
Zehan Wang
,
Ke Lei
,
Chen Zhu
,
Jiawei Huang
,
Sashuai Zhou
,
Luping Liu
, Xize Cheng,
Shengpeng Ji
,
Zhenhui Ye
,
Tao Jin
,
Zhou Zhao
VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?
ICLR 2025 · Xize Cheng,
Ruofan Hu
,
Xiaoda Yang
,
Jingyu Lu
,
Dongjie Fu
,
Zehan Wang
,
Shengpeng Ji
,
Rongjie Huang
,
Boyang Zhang
,
Tao Jin
,
Zhou Zhao
WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling
ICLR 2025 ·
Shengpeng Ji
,
Ziyue Jiang
,
Wen Wang
,
Yifu Chen
,
Minghui Fang
,
Jialong Zuo
,
Qian Yang
, Xize Cheng,
Zehan Wang
,
Ruiqi Li
,
Ziang Zhang
,
Xiaoda Yang
,
Rongjie Huang
,
Yidi Jiang
,
Qian Chen
,
Siqi Zheng
,
Zhou Zhao
AudioLCM: Efficient and High-Quality Text-to-Audio Generation with Minimal Inference Steps
ACM MM 2024 ·
Huadai Liu
,
Rongjie Huang
,
Yang Liu
,
Hengyuan Cao
,
Jialei Wang
, Xize Cheng,
Siqi Zheng
,
Zhou Zhao
AudioVSR: Enhancing Video Speech Recognition with Audio Data
EMNLP 2024 ·
Xiaoda Yang
, Xize Cheng,
Jiaqi Duan
,
Hongshun Qiu
,
Minjie Hong
,
Minghui Fang
,
Shengpeng Ji
,
Jialong Zuo
,
Zhiqing Hong
,
Zhimeng Zhang
,
Tao Jin
Boosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts
ACM MM 2024 ·
Dongjie Fu
, Xize Cheng,
Xiaoda Yang
,
Hanting Wang
,
Zhou Zhao
,
Tao Jin
Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers
NeurIPS 2024 ·
Haifeng Huang
,
Yilun Chen
,
Zehan Wang
,
Rongjie Huang
,
Runsen Xu
,
Tai Wang
,
Luping Liu
, Xize Cheng,
Yang Zhao
,
Jiangmiao Pang
,
Zhou Zhao
Extending Multi-modal Contrastive Representations
NeurIPS 2024 ·
Ziang Zhang
,
Zehan Wang
,
Luping Liu
,
Rongjie Huang
, Xize Cheng,
Zhenhui Ye
,
Wang Lin
,
Huadai Liu
,
Haifeng Huang
,
Yang Zhao
,
Tao Jin
,
Siqi Zheng
,
Zhou Zhao
FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion
ICML 2024 ·
Zehan Wang
,
Ziang Zhang
, Xize Cheng,
Rongjie Huang
,
Luping Liu
,
Zhenhui Ye
,
Haifeng Huang
,
Yang Zhao
,
Tao Jin
,
Peng Gao
,
Zhou Zhao
InstructSpeech: Following Speech Editing Instructions via Large Language Models
ICML 2024 ·
Rongjie Huang
,
Ruofan Hu
,
Yongqi Wang
,
Zehan Wang
, Xize Cheng,
Ziyue Jiang
,
Zhenhui Ye
,
Dongchao Yang
,
Luping Liu
,
Peng Gao
,
Zhou Zhao
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes
NeurIPS 2024 ·
Zhenhui Ye
,
Tianyun Zhong
,
Yi Ren
,
Ziyue Jiang
,
Jiawei Huang
,
Rongjie Huang
,
Jinglin Liu
,
Jinzheng He
,
Chen Zhang
,
Zehan Wang
, Xize Cheng,
Xiang Yin
,
Zhou Zhao
Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment
ACL 2024 ·
Tao Jin
,
Wang Lin
,
Ye Wang
,
Linjun Li
, Xize Cheng,
Zhou Zhao
SegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing
ACM MM 2024 ·
Lingyu Xiong
, Xize Cheng,
Jintao Tan
,
Xianjia Wu
,
Xiandong Li
,
Lei Zhu
,
Fei Ma
,
Minglei Li
,
Huang Xu
,
Zhihui Hu
SyncTalklip: Highly Synchronized Lip-Readable Speaker Generation with Multi-Task Learning
ACM MM 2024 ·
Xiaoda Yang
, Xize Cheng,
Dongjie Fu
,
Minghui Fang
,
Jialong Zuo
,
Shengpeng Ji
,
Zhou Zhao
,
Tao Jin
Text-to-Song: Towards Controllable Music Generation Incorporating Vocal and Accompaniment
ACL 2024 ·
Zhiqing Hong
,
Rongjie Huang
, Xize Cheng,
Yongqi Wang
,
Ruiqi Li
,
Fuming You
,
Zhou Zhao
,
Zhimeng Zhang
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation
ACL 2024 · Xize Cheng,
Rongjie Huang
,
Linjun Li
,
Zehan Wang
,
Tao Jin
,
Aoxiong Yin
,
Feiyang Chen
,
Xinyu Duan
,
Baoxing Huai
,
Zhou Zhao
Uni-Dubbing: Zero-Shot Speech Synthesis from Visual Articulation
ACL 2024 ·
Songju Lei
, Xize Cheng,
Mengjiao Lyu
,
Jianqiao Hu
,
Jintao Tan
,
Runlin Liu
,
Lingyu Xiong
,
Tao Jin
,
Xiandong Li
,
Zhou Zhao
VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation
ACM MM 2024 ·
Rongjie Huang
,
Yongqi Wang
,
Ruofan Hu
,
Xiaoshan Xu
,
Zhiqing Hong
,
Dongchao Yang
, Xize Cheng,
Zehan Wang
,
Ziyue Jiang
,
Zhenhui Ye
,
Luping Liu
,
Siqi Zheng
,
Zhou Zhao
Wav2SQL: Direct Generalizable Speech-To-SQL Parsing
ACL 2024 ·
Huadai Liu
,
Rongjie Huang
,
Jinzheng He
,
Gang Sun
,
Ran Shen
, Xize Cheng,
Zhou Zhao