Jiatong Shi

35 papers at tracked venues · 11 at CORE A* · active 2024–2026

DBLP profile ↗ORCID search ↗

Venues

InterSpeech ×19 ACL ×4 NAACL ×3 ICLR ×2 AAAI ×1 ACM MM ×1 EACL ×1 EMNLP ×1 ICML ×1 NeurIPS ×1 SIGKDD ×1

Frequent coauthors

Shinji Watanabe

×23

Jinchuan Tian

×14

Siddhant Arora

×10

William Chen

×9

Yuxun Tang

×7

Xuankai Chang

×7

Yuning Wu

×6

Yifan Peng

×5

Qin Jin

×5

Hung-yi Lee

×3

Hayato Futami

×3

Yosuke Kashiwagi

×3

Papers

BSCodec: A Band-Split Neural Codec for High-Quality Universal Audio Reconstruction
EACL 2026 ·
Haoran Wang
, Jiatong Shi,
Jinchuan Tian
,
Bohan Li
,
Kai Yu
,
Shinji Watanabe
Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examiner
ACL 2026 ·
Guan-Ting Lin
,
Shih-Yun Shan Kuan
, Jiatong Shi,
Kai-Wei Chang
,
Siddhant Arora
,
Shinji Watanabe
,
Hung-Yi Lee
Optimizing Conversational Quality in Spoken Dialogue Systems with Reinforcement Learning from AI Feedback
ACL 2026 ·
Siddhant Arora
,
Jinchuan Tian
, Jiatong Shi,
Hayato Futami
,
Yosuke Kashiwagi
,
Emiru Tsunoo
,
Shinji Watanabe
ARECHO: Autoregressive Evaluation via Chain-Based Hypothesis Optimization for Speech Multi-Metric Estimation
NeurIPS 2025 · Jiatong Shi,
Yifan Cheng
,
Bo-Hao Su
,
Hye-jin Shim
,
Jinchuan Tian
,
Samuele Cornell
,
Yiwen Zhao
,
Siddhant Arora
,
Shinji Watanabe
Bridging Speech and Singing: Multi-stage Speech-Prompted Singing Voice Conversion with Speaker Embedding Adaptation
InterSpeech 2025 ·
Mingda Liu
, Jiatong Shi
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems
InterSpeech 2025 ·
Siddhant Arora
,
Jinchuan Tian
,
Hayato Futami
,
Jee-weon Jung
, Jiatong Shi,
Yosuke Kashiwagi
,
Emiru Tsunoo
,
Shinji Watanabe
Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks
ICLR 2025 ·
Chien-yu Huang
,
Wei-Chih Chen
,
Shu-Wen Yang
,
Andy T. Liu
,
Chen-An Li
,
Yu-Xiang Lin
,
Wei-Cheng Tseng
,
Anuj Diwan
,
Yi-Jen Shih
, Jiatong Shi,
William Chen
,
Chih-Kai Yang
,
Xuanjun Chen
,
Chi-Yuan Hsiao
,
Puyuan Peng
,
Shih-Heng Wang
,
Chun-Yi Kuan
,
Ke-Han Lu
,
Kai-Wei Chang
,
Fabian Alejandro Ritter Gutierrez
,
et al.
ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems
NAACL 2025 ·
Siddhant Arora
,
Yifan Peng
, Jiatong Shi,
Jinchuan Tian
,
William Chen
,
Shikhar Bharadwaj
,
Hayato Futami
,
Yosuke Kashiwagi
,
Emiru Tsunoo
,
Shuichiro Shimizu
,
Vaibhav Srivastav
,
Shinji Watanabe
ESPnet-SpeechLM: An Open Speech Language Model Toolkit
NAACL 2025 ·
Jinchuan Tian
, Jiatong Shi,
William Chen
,
Siddhant Arora
,
Yoshiki Masuyama
,
Takashi Maekaku
,
Yihan Wu
,
Junyi Peng
,
Shikhar Bharadwaj
,
Yiwen Zhao
,
Samuele Cornell
,
Yifan Peng
,
Xiang Yue
,
Chao-Han Huck Yang
,
Graham Neubig
,
Shinji Watanabe
FoodPuzzle: Toward Developing Large Language Model Agents as Autonomous Flavor Scientists
SIGKDD 2025 ·
Tenghao Huang
,
Dong Hee Lee
,
John Sweeney
, Jiatong Shi,
Emily Steliotes
,
Matthew Lange
,
Jonathan May
,
Muhao Chen
MIKU-PAL: An Automated and Standardized Multimodal Method for Speech Paralinguistic and Affect Labeling
InterSpeech 2025 ·
Yifan Cheng
,
Ruoyi Zhang
, Jiatong Shi
OpusLM: A Family of Open Unified Speech Language Models
InterSpeech 2025 ·
Jinchuan Tian
,
William Chen
,
Yifan Peng
, Jiatong Shi,
Siddhant Arora
,
Shikhar Bharadwaj
,
Takashi Maekaku
,
Yusuke Shinohara
,
Keita Goto
,
Xiang Yue
,
Huck Yang
,
Shinji Watanabe
Scalable Spontaneous Speech Dataset (SSSD): Crowdsourcing Data Collection to Promote Dialogue Research
InterSpeech 2025 ·
Zaid Sheikh
,
Shuichiro Shimizu
,
Siddhant Arora
, Jiatong Shi,
Samuele Cornell
,
Xinjian Li
,
Shinji Watanabe
The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties
InterSpeech 2025 ·
William Chen
,
Chutong Meng
, Jiatong Shi,
Martijn Bartelds
,
Shih-Heng Wang
,
Hsiu-Hsuan Wang
,
Rafael Mosquera
,
Sara Hincapie
,
Dan Jurafsky
,
Antonis Anastasopoulos
,
Hung-yi Lee
,
Karen Livescu
,
Shinji Watanabe
Uni-VERSA: Versatile Speech Assessment with a Unified Network
InterSpeech 2025 · Jiatong Shi,
Hye-jin Shim
,
Shinji Watanabe
VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music
NAACL 2025 · Jiatong Shi,
Hye-jin Shim
,
Jinchuan Tian
,
Siddhant Arora
,
Haibin Wu
,
Darius Petermann
,
Jia Qi Yip
,
You Zhang
,
Yuxun Tang
,
Wangyou Zhang
,
Dareen Alharthi
,
Yichen Huang
,
Koichi Saito
,
Jionghao Han
,
Yiwen Zhao
,
Chris Donahue
,
Shinji Watanabe
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
AAAI 2024 ·
Rongjie Huang
,
Mingze Li
,
Dongchao Yang
, Jiatong Shi,
Xuankai Chang
,
Zhenhui Ye
,
Yuning Wu
,
Zhiqing Hong
,
Jiawei Huang
,
Jinglin Liu
,
Yi Ren
,
Yuexian Zou
,
Zhou Zhao
,
Shinji Watanabe
CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection
InterSpeech 2024 ·
Yongyi Zang
, Jiatong Shi,
You Zhang
,
Ryuichi Yamamoto
,
Jionghao Han
,
Yuxun Tang
,
Shengyuan Xu
,
Wenxiao Zhao
,
Jing Guo
,
Tomoki Toda
,
Zhiyao Duan
EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Low Resource and Multilingual Scenarios
InterSpeech 2024 ·
Tejes Srivastava
, Jiatong Shi,
William Chen
,
Shinji Watanabe
ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models
InterSpeech 2024 ·
Jee-weon Jung
,
Wangyou Zhang
, Jiatong Shi,
Zakaria Aldeneh
,
Takuya Higuchi
,
Alex Gichamba
,
Barry-John Theobald
,
Ahmed Hussen Abdelaziz
,
Shinji Watanabe
ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets
InterSpeech 2024 · Jiatong Shi,
Shih-Heng Wang
,
William Chen
,
Martijn Bartelds
,
Vanya Bannihatti Kumar
,
Jinchuan Tian
,
Xuankai Chang
,
Dan Jurafsky
,
Karen Livescu
,
Hung-yi Lee
,
Shinji Watanabe
MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model
InterSpeech 2024 · Jiatong Shi,
Xutai Ma
,
Hirofumi Inaguma
,
Anna Sun
,
Shinji Watanabe
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners
ACL 2024 ·
Rongjie Huang
,
Chunlei Zhang
,
Yongqi Wang
,
Dongchao Yang
,
Jinchuan Tian
,
Zhenhui Ye
,
Luping Liu
,
Zehan Wang
,
Ziyue Jiang
,
Xuankai Chang
, Jiatong Shi,
Chao Weng
,
Zhou Zhao
,
Dong Yu
Multi-resolution HuBERT: Multi-resolution Speech Self-Supervised Learning with Masked Unit Prediction
ICLR 2024 · Jiatong Shi,
Hirofumi Inaguma
,
Xutai Ma
,
Ilia Kulikov
,
Anna Y. Sun
Muskits-ESPnet: A Comprehensive Toolkit for Singing Voice Synthesis in New Paradigm
ACM MM 2024 ·
Yuning Wu
, Jiatong Shi,
Yifeng Yu
,
Yuxun Tang
,
Tao Qian
,
Yueqian Lin
,
Jionghao Han
,
Xinyi Bai
,
Shinji Watanabe
,
Qin Jin
OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer
InterSpeech 2024 ·
Yifan Peng
,
Jinchuan Tian
,
William Chen
,
Siddhant Arora
,
Brian Yan
,
Yui Sudo
,
Muhammad Shakeel
,
Kwanghee Choi
, Jiatong Shi,
Xuankai Chang
,
Jee-weon Jung
,
Shinji Watanabe
PL-TTS: A Generalizable Prompt-based Diffusion TTS Augmented by Large Language Model
InterSpeech 2024 ·
Shuhua Li
,
Qirong Mao
, Jiatong Shi
Self-supervised Speech Representations Still Struggle with African American Vernacular English
InterSpeech 2024 ·
Kalvin Chang
,
Yi-Hui Chou
, Jiatong Shi,
Hsuan-Ming Chen
,
Nicole Holliday
,
Odette Scharenborg
,
David R. Mortensen
SingOMD: Singing Oriented Multi-resolution Discrete Representation Construction from Speech Models
InterSpeech 2024 ·
Yuxun Tang
,
Yuning Wu
, Jiatong Shi,
Qin Jin
Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and ACE-KiSing
InterSpeech 2024 · Jiatong Shi,
Yueqian Lin
,
Xinyi Bai
,
Keyi Zhang
,
Yuning Wu
,
Yuxun Tang
,
Yifeng Yu
,
Qin Jin
,
Shinji Watanabe
The Interspeech 2024 Challenge on Speech Processing Using Discrete Units
InterSpeech 2024 ·
Xuankai Chang
, Jiatong Shi,
Jinchuan Tian
,
Yuning Wu
,
Yuxun Tang
,
Yihan Wu
,
Shinji Watanabe
,
Yossi Adi
,
Xie Chen
,
Qin Jin
TokSing: Singing Voice Synthesis based on Discrete Tokens
InterSpeech 2024 ·
Yuning Wu
,
Chunlei Zhang
, Jiatong Shi,
Yuxun Tang
,
Shan Yang
,
Qin Jin
Towards Robust Speech Representation Learning for Thousands of Languages
EMNLP 2024 ·
William Chen
,
Wangyou Zhang
,
Yifan Peng
,
Xinjian Li
,
Jinchuan Tian
, Jiatong Shi,
Xuankai Chang
,
Soumi Maiti
,
Karen Livescu
,
Shinji Watanabe
UniAudio: Towards Universal Audio Generation with Large Language Models
ICML 2024 ·
Dongchao Yang
,
Jinchuan Tian
,
Xu Tan
,
Rongjie Huang
,
Songxiang Liu
,
Haohan Guo
,
Xuankai Chang
, Jiatong Shi,
Sheng Zhao
,
Jiang Bian
,
Zhou Zhao
,
Xixin Wu
,
Helen M. Meng
Wav2Gloss: Generating Interlinear Glossed Text from Speech
ACL 2024 ·
Taiqi He
,
Kwanghee Choi
,
Lindia Tjuatja
,
Nathaniel R. Robinson
, Jiatong Shi,
Shinji Watanabe
,
Graham Neubig
,
David R. Mortensen
,
Lori S. Levin