PPaperPicks

Shinji Watanabe

Carnegie Mellon University, Pittsburgh, PA, USA

76 papers at tracked venues · 18 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0002-5970-8631 ↗Google Scholar ↗Homepage ↗

Venues

InterSpeech ×46ACL ×10NAACL ×6EMNLP ×3AAAI ×2EACL ×2ICLR ×2NeurIPS ×2ACM MM ×1ICML ×1IJCAI ×1

Frequent coauthors

Jiatong Shi
×23
Siddhant Arora
×21
Jinchuan Tian
×20
Yifan Peng
×18
William Chen
×16
Jee-weon Jung
×10
Hayato Futami
×9
Yosuke Kashiwagi
×9
Emiru Tsunoo
×9
Karen Livescu
×9
Kwanghee Choi
×8
Wangyou Zhang
×8

Papers

  1. BSCodec: A Band-Split Neural Codec for High-Quality Universal Audio Reconstruction
    EACL 2026 ·
    Haoran Wang
    ,
    Jiatong Shi
    ,
    Jinchuan Tian
    ,
    Bohan Li
    ,
    Kai Yu
    , Shinji Watanabe
  2. CSPB: Conversational Speech Processing Benchmark for Self-supervised Speech Models
    EACL 2026 ·
    Zili Huang
    ,
    Matthew Maciejewski
    ,
    Leibny Paola García-Perera
    , Shinji Watanabe,
    Sanjeev Khudanpur
  3. Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examiner
    ACL 2026 ·
    Guan-Ting Lin
    ,
    Shih-Yun Shan Kuan
    ,
    Jiatong Shi
    ,
    Kai-Wei Chang
    ,
    Siddhant Arora
    , Shinji Watanabe,
    Hung-Yi Lee
  4. Optimizing Conversational Quality in Spoken Dialogue Systems with Reinforcement Learning from AI Feedback
    ACL 2026 ·
    Siddhant Arora
    ,
    Jinchuan Tian
    ,
    Jiatong Shi
    ,
    Hayato Futami
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    , Shinji Watanabe
  5. POWSM: A Phonetic Open Whisper-Style Speech Foundation Model
    ACL 2026 ·
    Chin-Jou Li
    ,
    Kalvin Chang
    ,
    Shikhar Bharadwaj
    ,
    Eunjung Yeo
    ,
    Kwanghee Choi
    ,
    Jian Zhu
    ,
    David R. Mortensen
    , Shinji Watanabe
  6. PRiSM: Benchmarking Phone Realization in Speech Models
    ACL 2026 ·
    Shikhar Bharadwaj
    ,
    Chin-Jou Li
    ,
    Yoonjae Kim
    ,
    Kwanghee Choi
    ,
    Eunjung Yeo
    ,
    Ryan Soh-Eun Shim
    ,
    Hanyu Zhou
    ,
    Brendon Boldt
    ,
    Karen Rosero
    ,
    Kalvin Chang
    ,
    Darsh Agrawal
    ,
    Keer Xu
    ,
    Chao-Han Huck Yang
    ,
    Jian Zhu
    , Shinji Watanabe,
    David R. Mortensen
  7. PlanRAG-Audio: Planning and Retrieval Augmented Generation for Long-form Audio Understanding
    ACL 2026 ·
    Masao Someki
    ,
    Chien-Yu Huang
    ,
    Siddhant Arora
    ,
    Samuele Cornell
    ,
    Markus Müller
    ,
    Nathan Susanj
    ,
    Rupak Vignesh Swaminathan
    ,
    Grant P. Strimel
    ,
    Jing Liu
    , Shinji Watanabe
  8. Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception
    ACL 2026 ·
    Zhen Wan
    ,
    Chao-Han Huck Yang
    ,
    Jinchuan Tian
    ,
    Hanrong Ye
    ,
    Ankita Pasad
    ,
    Szu-Wei Fu
    ,
    Arushi Goel
    ,
    Ryo Hachiuma
    ,
    Shizhe Diao
    ,
    Kunal Dhawan
    ,
    Sreyan Ghosh
    ,
    Yusuke Hirota
    ,
    Zhehuai Chen
    ,
    Rafael Valle
    ,
    Chenhui Chu
    , Shinji Watanabe,
    Boris Ginsburg
    ,
    Yu-Chiang Frank Wang
  9. AHa-Bench: Benchmarking Audio Hallucinations in Large Audio-Language Models
    NeurIPS 2025 ·
    Xize Cheng
    ,
    Dongjie Fu
    ,
    Chenyuhao Wen
    ,
    Shannon Yu
    ,
    Zehan Wang
    ,
    Shengpeng Ji
    ,
    Siddhant Arora
    ,
    Tao Jin
    , Shinji Watanabe,
    Zhou Zhao
  10. ARECHO: Autoregressive Evaluation via Chain-Based Hypothesis Optimization for Speech Multi-Metric Estimation
    NeurIPS 2025 ·
    Jiatong Shi
    ,
    Yifan Cheng
    ,
    Bo-Hao Su
    ,
    Hye-jin Shim
    ,
    Jinchuan Tian
    ,
    Samuele Cornell
    ,
    Yiwen Zhao
    ,
    Siddhant Arora
    , Shinji Watanabe
  11. CS-FLEURS: A Massively Multilingual and Code-Switched Speech Dataset
    InterSpeech 2025 ·
    Brian Yan
    ,
    Injy Hamed
    ,
    Shuichiro Shimizu
    ,
    Vasista Sai Lodagala
    ,
    William Chen
    ,
    Olga Iakovenko
    ,
    Bashar Talafha
    ,
    Amir Hussein
    ,
    Alexander Polok
    ,
    Kalvin Chang
    ,
    Dominik Klement
    ,
    Sara Althubaiti
    ,
    Puyuan Peng
    ,
    Matthew Wiesner
    ,
    Thamar Solorio
    ,
    Ahmed Ali
    ,
    Sanjeev Khudanpur
    , Shinji Watanabe
  12. Chain-of-Thought Training for Open E2E Spoken Dialogue Systems
    InterSpeech 2025 ·
    Siddhant Arora
    ,
    Jinchuan Tian
    ,
    Hayato Futami
    ,
    Jee-weon Jung
    ,
    Jiatong Shi
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    , Shinji Watanabe
  13. Context-Driven Dynamic Pruning for Large Speech Foundation Models
    InterSpeech 2025 ·
    Masao Someki
    ,
    Shikhar Bharadwaj
    ,
    Atharva Anand Joshi
    ,
    Chyi-Jiunn Lin
    ,
    Jinchuan Tian
    ,
    Jee-weon Jung
    ,
    Markus Müller
    ,
    Nathan Susanj
    ,
    Jing Liu
    , Shinji Watanabe
  14. Context-aware Dynamic Pruning for Speech Foundation Models
    ICLR 2025 ·
    Masao Someki
    ,
    Yifan Peng
    ,
    Siddhant Arora
    ,
    Markus Müller
    ,
    Athanasios Mouchtaris
    ,
    Grant P. Strimel
    ,
    Jing Liu
    , Shinji Watanabe
  15. DYNAC: Dynamic Vocabulary-based Non-Autoregressive Contextualization for Speech Recognition
    InterSpeech 2025 ·
    Yui Sudo
    ,
    Yosuke Fukumoto
    ,
    Muhammad Shakeel
    ,
    Yifan Peng
    ,
    Chyi-Jiunn Lin
    , Shinji Watanabe
  16. DiceHuBERT: Distilling HuBERT with a Self-Supervised Learning Objective
    InterSpeech 2025 ·
    Hyung-Gun Chi
    ,
    Zakaria Aldeneh
    ,
    Tatiana Likhomanenko
    ,
    Oggi Rudovic
    ,
    Takuya Higuchi
    ,
    Li-Wei Chen
    , Shinji Watanabe,
    Ahmed Hussen Abdelaziz
  17. Differentiable K-means for Fully-optimized Discrete Token-based ASR
    InterSpeech 2025 ·
    Kentaro Onda
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    ,
    Hayato Futami
    , Shinji Watanabe
  18. ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems
    NAACL 2025 ·
    Siddhant Arora
    ,
    Yifan Peng
    ,
    Jiatong Shi
    ,
    Jinchuan Tian
    ,
    William Chen
    ,
    Shikhar Bharadwaj
    ,
    Hayato Futami
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    ,
    Shuichiro Shimizu
    ,
    Vaibhav Srivastav
    , Shinji Watanabe
  19. ESPnet-SpeechLM: An Open Speech Language Model Toolkit
    NAACL 2025 ·
    Jinchuan Tian
    ,
    Jiatong Shi
    ,
    William Chen
    ,
    Siddhant Arora
    ,
    Yoshiki Masuyama
    ,
    Takashi Maekaku
    ,
    Yihan Wu
    ,
    Junyi Peng
    ,
    Shikhar Bharadwaj
    ,
    Yiwen Zhao
    ,
    Samuele Cornell
    ,
    Yifan Peng
    ,
    Xiang Yue
    ,
    Chao-Han Huck Yang
    ,
    Graham Neubig
    , Shinji Watanabe
  20. Enhancing Audiovisual Speech Recognition Through Bifocal Preference Optimization
    AAAI 2025 ·
    Yihan Wu
    ,
    Yichen Lu
    ,
    Yifan Peng
    ,
    Xihua Wang
    ,
    Ruihua Song
    , Shinji Watanabe
  21. Explainable Depression Detection using Masked Hard Instance Mining
    InterSpeech 2025 ·
    Patawee Prakrankamanant
    , Shinji Watanabe,
    Ekapol Chuangsuwanich
  22. Exploring Linear Variant Transformers and k-NN Memory Inference for Long-Form ASR
    InterSpeech 2025 ·
    Carlos Carvalho
    ,
    Jinchuan Tian
    ,
    William Chen
    ,
    Yifan Peng
    ,
    Alberto Abad
    , Shinji Watanabe
  23. GALAXY: A Large-Scale Open-Domain Dataset for Multimodal Learning
    InterSpeech 2025 ·
    Yihan Wu
    ,
    Yichen Lu
    ,
    Yijing Chen
    ,
    Jiaqi Song
    ,
    William Chen
    ,
    Ruihua Song
    , Shinji Watanabe
  24. Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC
    InterSpeech 2025 ·
    Qingzheng Wang
    ,
    Jiancheng Sun
    ,
    Yifan Peng
    , Shinji Watanabe
  25. Interspeech 2025 URGENT Speech Enhancement Challenge
    InterSpeech 2025 ·
    Kohei Saijo
    ,
    Wangyou Zhang
    ,
    Samuele Cornell
    ,
    Robin Scheibler
    ,
    Chenda Li
    ,
    Zhaoheng Ni
    ,
    Anurag Kumar
    ,
    Marvin Sach
    ,
    Yihui Fu
    ,
    Wei Wang
    ,
    Tim Fingscheidt
    , Shinji Watanabe
  26. Lessons Learned from the URGENT 2024 Speech Enhancement Challenge
    InterSpeech 2025 ·
    Wangyou Zhang
    ,
    Kohei Saijo
    ,
    Samuele Cornell
    ,
    Robin Scheibler
    ,
    Chenda Li
    ,
    Zhaoheng Ni
    ,
    Anurag Kumar
    ,
    Marvin Sach
    ,
    Wei Wang
    ,
    Yihui Fu
    , Shinji Watanabe,
    Tim Fingscheidt
    ,
    Yanmin Qian
  27. Leveraging Allophony in Self-Supervised Speech Models for Atypical Pronunciation Assessment
    NAACL 2025 ·
    Kwanghee Choi
    ,
    Eunjung Yeo
    ,
    Kalvin Chang
    , Shinji Watanabe,
    David R. Mortensen
  28. OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models
    ICML 2025 ·
    William Chen
    ,
    Jinchuan Tian
    ,
    Yifan Peng
    ,
    Brian Yan
    ,
    Chao-Han Huck Yang
    , Shinji Watanabe
  29. OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning
    InterSpeech 2025 ·
    Yifan Peng
    ,
    Muhammad Shakeel
    ,
    Yui Sudo
    ,
    William Chen
    ,
    Jinchuan Tian
    ,
    Chyi-Jiunn Lin
    , Shinji Watanabe
  30. On-device Streaming Discrete Speech Units
    InterSpeech 2025 ·
    Kwanghee Choi
    ,
    Masao Someki
    ,
    Emma Strubell
    , Shinji Watanabe
  31. OpusLM: A Family of Open Unified Speech Language Models
    InterSpeech 2025 ·
    Jinchuan Tian
    ,
    William Chen
    ,
    Yifan Peng
    ,
    Jiatong Shi
    ,
    Siddhant Arora
    ,
    Shikhar Bharadwaj
    ,
    Takashi Maekaku
    ,
    Yusuke Shinohara
    ,
    Keita Goto
    ,
    Xiang Yue
    ,
    Huck Yang
    , Shinji Watanabe
  32. Pick and Summarize: Integrating Extractive and Abstractive Speech Summarization
    InterSpeech 2025 ·
    Takatomo Kano
    ,
    Atsunori Ogawa
    ,
    Marc Delcroix
    ,
    Ryo Fukuda
    ,
    William Chen
    , Shinji Watanabe
  33. Scalable Spontaneous Speech Dataset (SSSD): Crowdsourcing Data Collection to Promote Dialogue Research
    InterSpeech 2025 ·
    Zaid Sheikh
    ,
    Shuichiro Shimizu
    ,
    Siddhant Arora
    ,
    Jiatong Shi
    ,
    Samuele Cornell
    ,
    Xinjian Li
    , Shinji Watanabe
  34. Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs
    InterSpeech 2025 ·
    Hayato Futami
    ,
    Emiru Tsunoo
    ,
    Yosuke Kashiwagi
    ,
    Yuki Ito
    ,
    Hassan Shahmohammadi
    ,
    Siddhant Arora
    , Shinji Watanabe
  35. SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models
    ACL 2025 ·
    Zhen Wan
    ,
    Chao-Han Huck Yang
    ,
    Yahan Yu
    ,
    Jinchuan Tian
    ,
    Sheng Li
    ,
    Ke Hu
    ,
    Zhehuai Chen
    , Shinji Watanabe,
    Fei Cheng
    ,
    Chenhui Chu
    ,
    Sadao Kurohashi
  36. Summarizing Speech: A Comprehensive Survey
    EMNLP 2025 ·
    Fabian Retkowski
    ,
    Maike Züfle
    ,
    Andreas Sudmann
    ,
    Dinah Pfau
    , Shinji Watanabe,
    Jan Niehues
    ,
    Alexander Waibel
  37. Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
    ICLR 2025 ·
    Siddhant Arora
    ,
    Zhiyun Lu
    ,
    Chung-Cheng Chiu
    ,
    Ruoming Pang
    , Shinji Watanabe
  38. The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties
    InterSpeech 2025 ·
    William Chen
    ,
    Chutong Meng
    ,
    Jiatong Shi
    ,
    Martijn Bartelds
    ,
    Shih-Heng Wang
    ,
    Hsiu-Hsuan Wang
    ,
    Rafael Mosquera
    ,
    Sara Hincapie
    ,
    Dan Jurafsky
    ,
    Antonis Anastasopoulos
    ,
    Hung-yi Lee
    ,
    Karen Livescu
    , Shinji Watanabe
  39. The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition
    InterSpeech 2025 ·
    Ming Gao
    ,
    Shilong Wu
    ,
    Hang Chen
    ,
    Jun Du
    ,
    Chin-Hui Lee
    , Shinji Watanabe,
    Jingdong Chen
    ,
    Sabato Marco Siniscalchi
    ,
    Odette Scharenborg
  40. The Text-to-speech in the Wild (TITW) Database
    InterSpeech 2025 ·
    Jee-weon Jung
    ,
    Wangyou Zhang
    ,
    Soumi Maiti
    ,
    Yihan Wu
    ,
    Xin Wang
    ,
    Ji-Hoon Kim
    ,
    Yuta Matsunaga
    ,
    Seyun Um
    ,
    Jinchuan Tian
    ,
    Hye-jin Shim
    ,
    Nicholas W. D. Evans
    ,
    Joon Son Chung
    ,
    Shinnosuke Takamichi
    , Shinji Watanabe
  41. Uni-VERSA: Versatile Speech Assessment with a Unified Network
    InterSpeech 2025 ·
    Jiatong Shi
    ,
    Hye-jin Shim
    , Shinji Watanabe
  42. VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music
    NAACL 2025 ·
    Jiatong Shi
    ,
    Hye-jin Shim
    ,
    Jinchuan Tian
    ,
    Siddhant Arora
    ,
    Haibin Wu
    ,
    Darius Petermann
    ,
    Jia Qi Yip
    ,
    You Zhang
    ,
    Yuxun Tang
    ,
    Wangyou Zhang
    ,
    Dareen Alharthi
    ,
    Yichen Huang
    ,
    Koichi Saito
    ,
    Jionghao Han
    ,
    Yiwen Zhao
    ,
    Chris Donahue
    , Shinji Watanabe
  43. VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning
    NAACL 2025 ·
    Yifan Peng
    ,
    Krishna C. Puvvada
    ,
    Zhehuai Chen
    ,
    Piotr Zelasko
    ,
    He Huang
    ,
    Kunal Dhawan
    ,
    Ke Hu
    , Shinji Watanabe,
    Jagadeesh Balam
    ,
    Boris Ginsburg
  44. AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
    AAAI 2024 ·
    Rongjie Huang
    ,
    Mingze Li
    ,
    Dongchao Yang
    ,
    Jiatong Shi
    ,
    Xuankai Chang
    ,
    Zhenhui Ye
    ,
    Yuning Wu
    ,
    Zhiqing Hong
    ,
    Jiawei Huang
    ,
    Jinglin Liu
    ,
    Yi Ren
    ,
    Yuexian Zou
    ,
    Zhou Zhao
    , Shinji Watanabe
  45. Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement
    InterSpeech 2024 ·
    Wangyou Zhang
    ,
    Kohei Saijo
    ,
    Jee-weon Jung
    ,
    Chenda Li
    , Shinji Watanabe,
    Yanmin Qian
  46. Can you Remove the Downstream Model for Speaker Recognition with Self-Supervised Speech Features?
    InterSpeech 2024 ·
    Zakaria Aldeneh
    ,
    Takuya Higuchi
    ,
    Jee-weon Jung
    ,
    Skyler Seto
    ,
    Tatiana Likhomanenko
    ,
    Stephen Shum
    ,
    Ahmed Hussen Abdelaziz
    , Shinji Watanabe,
    Barry-John Theobald
  47. Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss
    InterSpeech 2024 ·
    Muhammad Shakeel
    ,
    Yui Sudo
    ,
    Yifan Peng
    , Shinji Watanabe
  48. Convolution-Augmented Parameter-Efficient Fine-Tuning for Speech Recognition
    InterSpeech 2024 ·
    Kwangyoun Kim
    ,
    Suwon Shon
    ,
    Yi-Te Hsu
    ,
    Prashant Sridhar
    ,
    Karen Livescu
    , Shinji Watanabe
  49. Cross-Talk Reduction
    IJCAI 2024 ·
    Zhong-Qiu Wang
    ,
    Anurag Kumar
    , Shinji Watanabe
  50. Decoder-only Architecture for Streaming End-to-end Speech Recognition
    InterSpeech 2024 ·
    Emiru Tsunoo
    ,
    Hayato Futami
    ,
    Yosuke Kashiwagi
    ,
    Siddhant Arora
    , Shinji Watanabe
  51. DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding
    InterSpeech 2024 ·
    Suwon Shon
    ,
    Kwangyoun Kim
    ,
    Yi-Te Hsu
    ,
    Prashant Sridhar
    , Shinji Watanabe,
    Karen Livescu
  52. EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation
    InterSpeech 2024 ·
    Julius Richter
    ,
    Yi-Chiao Wu
    ,
    Steven Krenn
    ,
    Simon Welker
    ,
    Bunlong Lay
    , Shinji Watanabe,
    Alexander Richard
    ,
    Timo Gerkmann
  53. EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Low Resource and Multilingual Scenarios
    InterSpeech 2024 ·
    Tejes Srivastava
    ,
    Jiatong Shi
    ,
    William Chen
    , Shinji Watanabe
  54. ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models
    InterSpeech 2024 ·
    Jee-weon Jung
    ,
    Wangyou Zhang
    ,
    Jiatong Shi
    ,
    Zakaria Aldeneh
    ,
    Takuya Higuchi
    ,
    Alex Gichamba
    ,
    Barry-John Theobald
    ,
    Ahmed Hussen Abdelaziz
    , Shinji Watanabe
  55. FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model
    EMNLP 2024 ·
    Yichen Lu
    ,
    Jiaqi Song
    ,
    Chao-Han Huck Yang
    , Shinji Watanabe
  56. Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model
    InterSpeech 2024 ·
    Hayato Futami
    ,
    Siddhant Arora
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    , Shinji Watanabe
  57. ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets
    InterSpeech 2024 ·
    Jiatong Shi
    ,
    Shih-Heng Wang
    ,
    William Chen
    ,
    Martijn Bartelds
    ,
    Vanya Bannihatti Kumar
    ,
    Jinchuan Tian
    ,
    Xuankai Chang
    ,
    Dan Jurafsky
    ,
    Karen Livescu
    ,
    Hung-yi Lee
    , Shinji Watanabe
  58. MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model
    InterSpeech 2024 ·
    Jiatong Shi
    ,
    Xutai Ma
    ,
    Hirofumi Inaguma
    ,
    Anna Sun
    , Shinji Watanabe
  59. MULTI-CONVFORMER: Extending Conformer with Multiple Convolution Kernels
    InterSpeech 2024 ·
    Darshan Prabhu
    ,
    Yifan Peng
    ,
    Preethi Jyothi
    , Shinji Watanabe
  60. Muskits-ESPnet: A Comprehensive Toolkit for Singing Voice Synthesis in New Paradigm
    ACM MM 2024 ·
    Yuning Wu
    ,
    Jiatong Shi
    ,
    Yifeng Yu
    ,
    Yuxun Tang
    ,
    Tao Qian
    ,
    Yueqian Lin
    ,
    Jionghao Han
    ,
    Xinyi Bai
    , Shinji Watanabe,
    Qin Jin
  61. Neural Blind Source Separation and Diarization for Distant Speech Recognition
    InterSpeech 2024 ·
    Yoshiaki Bando
    ,
    Tomohiko Nakamura
    , Shinji Watanabe
  62. OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer
    InterSpeech 2024 ·
    Yifan Peng
    ,
    Jinchuan Tian
    ,
    William Chen
    ,
    Siddhant Arora
    ,
    Brian Yan
    ,
    Yui Sudo
    ,
    Muhammad Shakeel
    ,
    Kwanghee Choi
    ,
    Jiatong Shi
    ,
    Xuankai Chang
    ,
    Jee-weon Jung
    , Shinji Watanabe
  63. OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification
    ACL 2024 ·
    Yifan Peng
    ,
    Yui Sudo
    ,
    Muhammad Shakeel
    , Shinji Watanabe
  64. On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models
    InterSpeech 2024 ·
    Jinchuan Tian
    ,
    Yifan Peng
    ,
    William Chen
    ,
    Kwanghee Choi
    ,
    Karen Livescu
    , Shinji Watanabe
  65. On the Evaluation of Speech Foundation Models for Spoken Language Understanding
    ACL 2024 ·
    Siddhant Arora
    ,
    Ankita Pasad
    ,
    Chung-Ming Chien
    ,
    Jionghao Han
    ,
    Roshan S. Sharma
    ,
    Jee-weon Jung
    ,
    Hira Dhamyal
    ,
    William Chen
    ,
    Suwon Shon
    ,
    Hung-yi Lee
    ,
    Karen Livescu
    , Shinji Watanabe
  66. Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting
    InterSpeech 2024 ·
    Yosuke Kashiwagi
    ,
    Hayato Futami
    ,
    Emiru Tsunoo
    ,
    Siddhant Arora
    , Shinji Watanabe
  67. Self-Supervised Speech Representations are More Phonetic than Semantic
    InterSpeech 2024 ·
    Kwanghee Choi
    ,
    Ankita Pasad
    ,
    Tomohiko Nakamura
    ,
    Satoru Fukayama
    ,
    Karen Livescu
    , Shinji Watanabe
  68. Self-training ASR Guided by Unsupervised ASR Teacher
    InterSpeech 2024 ·
    Hyung Yong Kim
    ,
    Byeong-Yeol Kim
    ,
    Yunkyu Lim
    ,
    Jihwan Park
    ,
    Shukjae Choi
    ,
    Yooncheol Ju
    ,
    Jinseok Park
    ,
    Youshin Lim
    ,
    Seung Woo Yu
    ,
    Hanbin Lee
    , Shinji Watanabe
  69. Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and ACE-KiSing
    InterSpeech 2024 ·
    Jiatong Shi
    ,
    Yueqian Lin
    ,
    Xinyi Bai
    ,
    Keyi Zhang
    ,
    Yuning Wu
    ,
    Yuxun Tang
    ,
    Yifeng Yu
    ,
    Qin Jin
    , Shinji Watanabe
  70. SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics
    InterSpeech 2024 ·
    Takaaki Saeki
    ,
    Soumi Maiti
    ,
    Shinnosuke Takamichi
    , Shinji Watanabe,
    Hiroshi Saruwatari
  71. The Interspeech 2024 Challenge on Speech Processing Using Discrete Units
    InterSpeech 2024 ·
    Xuankai Chang
    ,
    Jiatong Shi
    ,
    Jinchuan Tian
    ,
    Yuning Wu
    ,
    Yuxun Tang
    ,
    Yihan Wu
    , Shinji Watanabe,
    Yossi Adi
    ,
    Xie Chen
    ,
    Qin Jin
  72. To what extent can ASV systems naturally defend against spoofing attacks?
    InterSpeech 2024 ·
    Jee-weon Jung
    ,
    Xin Wang
    ,
    Nicholas W. D. Evans
    , Shinji Watanabe,
    Hye-jin Shim
    ,
    Hemlata Tak
    ,
    Siddhant Arora
    ,
    Junichi Yamagishi
    ,
    Joon Son Chung
  73. Towards Robust Speech Representation Learning for Thousands of Languages
    EMNLP 2024 ·
    William Chen
    ,
    Wangyou Zhang
    ,
    Yifan Peng
    ,
    Xinjian Li
    ,
    Jinchuan Tian
    ,
    Jiatong Shi
    ,
    Xuankai Chang
    ,
    Soumi Maiti
    ,
    Karen Livescu
    , Shinji Watanabe
  74. URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement
    InterSpeech 2024 ·
    Wangyou Zhang
    ,
    Robin Scheibler
    ,
    Kohei Saijo
    ,
    Samuele Cornell
    ,
    Chenda Li
    ,
    Zhaoheng Ni
    ,
    Jan Pirklbauer
    ,
    Marvin Sach
    , Shinji Watanabe,
    Tim Fingscheidt
    ,
    Yanmin Qian
  75. UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions
    NAACL 2024 ·
    Siddhant Arora
    ,
    Hayato Futami
    ,
    Jee-weon Jung
    ,
    Yifan Peng
    ,
    Roshan S. Sharma
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    ,
    Karen Livescu
    , Shinji Watanabe
  76. Wav2Gloss: Generating Interlinear Glossed Text from Speech
    ACL 2024 ·
    Taiqi He
    ,
    Kwanghee Choi
    ,
    Lindia Tjuatja
    ,
    Nathaniel R. Robinson
    ,
    Jiatong Shi
    , Shinji Watanabe,
    Graham Neubig
    ,
    David R. Mortensen
    ,
    Lori S. Levin