PPaperPicks

Shinji Watanabe

Carnegie Mellon University, Pittsburgh, PA, USA

76 papers at tracked venues · 18 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0002-5970-8631 ↗Google Scholar ↗Homepage ↗

Venues

InterSpeech ×46ACL ×10NAACL ×6EMNLP ×3AAAI ×2EACL ×2ICLR ×2NeurIPS ×2ACM MM ×1ICML ×1IJCAI ×1

Frequent coauthors

Siddhant Arora
DBLP profile ↗ORCID search ↗
×6
Jiatong Shi
DBLP profile ↗ORCID search ↗
×6
Yifan Peng
DBLP profile ↗ORCID search ↗
×4
Masao Someki
DBLP profile ↗ORCID search ↗
×3
Jinchuan Tian
DBLP profile ↗ORCID search ↗
×3
Wangyou Zhang
DBLP profile ↗ORCID search ↗
×3
Kwanghee Choi
DBLP profile ↗ORCID search ↗
×3
William Chen
DBLP profile ↗ORCID search ↗
×3
Jee-weon Jung
DBLP profile ↗ORCID search ↗
×3
Zhen Wan
DBLP profile ↗ORCID search ↗
×2
Yihan Wu
DBLP profile ↗ORCID search ↗
×2
Hayato Futami
DBLP profile ↗ORCID search ↗
×2

Papers

  1. BSCodec: A Band-Split Neural Codec for High-Quality Universal Audio Reconstruction
    EACL 2026 ·
    Haoran Wang
    DBLP profile ↗ORCID search ↗
  2. CSPB: Conversational Speech Processing Benchmark for Self-supervised Speech Models
    EACL 2026 ·
    Zili Huang
    DBLP profile ↗ORCID search ↗
  3. Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examiner
    ACL 2026 ·
    Guan-Ting Lin
    DBLP profile ↗ORCID search ↗
  4. Optimizing Conversational Quality in Spoken Dialogue Systems with Reinforcement Learning from AI Feedback
    ACL 2026 ·
    Siddhant Arora
    DBLP profile ↗ORCID search ↗
  5. POWSM: A Phonetic Open Whisper-Style Speech Foundation Model
    ACL 2026 ·
    Chin-Jou Li
    DBLP profile ↗ORCID search ↗
  6. PRiSM: Benchmarking Phone Realization in Speech Models
    ACL 2026 ·
    Shikhar Bharadwaj
    DBLP profile ↗ORCID search ↗
  7. PlanRAG-Audio: Planning and Retrieval Augmented Generation for Long-form Audio Understanding
    ACL 2026 ·
    Masao Someki
    DBLP profile ↗ORCID search ↗
  8. Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception
    ACL 2026 ·
    Zhen Wan
    DBLP profile ↗ORCID search ↗
  9. AHa-Bench: Benchmarking Audio Hallucinations in Large Audio-Language Models
    NeurIPS 2025 ·
    Xize Cheng
    DBLP profile ↗ORCID search ↗
  10. ARECHO: Autoregressive Evaluation via Chain-Based Hypothesis Optimization for Speech Multi-Metric Estimation
    NeurIPS 2025 ·
    Jiatong Shi
    DBLP profile ↗ORCID search ↗
  11. CS-FLEURS: A Massively Multilingual and Code-Switched Speech Dataset
    InterSpeech 2025 ·
    Brian Yan
    DBLP profile ↗ORCID search ↗
  12. Chain-of-Thought Training for Open E2E Spoken Dialogue Systems
    InterSpeech 2025 ·
    Siddhant Arora
    DBLP profile ↗ORCID search ↗
  13. Context-Driven Dynamic Pruning for Large Speech Foundation Models
    InterSpeech 2025 ·
    Masao Someki
    DBLP profile ↗ORCID search ↗
  14. Context-aware Dynamic Pruning for Speech Foundation Models
    ICLR 2025 ·
    Masao Someki
    DBLP profile ↗ORCID search ↗
  15. DYNAC: Dynamic Vocabulary-based Non-Autoregressive Contextualization for Speech Recognition
    InterSpeech 2025 ·
    Yui Sudo
    DBLP profile ↗ORCID search ↗
  16. DiceHuBERT: Distilling HuBERT with a Self-Supervised Learning Objective
    InterSpeech 2025 ·
    Hyung-Gun Chi
    DBLP profile ↗ORCID search ↗
  17. Differentiable K-means for Fully-optimized Discrete Token-based ASR
    InterSpeech 2025 ·
    Kentaro Onda
    DBLP profile ↗ORCID search ↗
  18. ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems
    NAACL 2025 ·
    Siddhant Arora
    DBLP profile ↗ORCID search ↗
  19. ESPnet-SpeechLM: An Open Speech Language Model Toolkit
    NAACL 2025 ·
    Jinchuan Tian
    DBLP profile ↗ORCID search ↗
  20. Enhancing Audiovisual Speech Recognition Through Bifocal Preference Optimization
    AAAI 2025 ·
    Yihan Wu
    DBLP profile ↗ORCID search ↗
  21. Explainable Depression Detection using Masked Hard Instance Mining
    InterSpeech 2025 ·
    Patawee Prakrankamanant
    DBLP profile ↗ORCID search ↗
  22. Exploring Linear Variant Transformers and k-NN Memory Inference for Long-Form ASR
    InterSpeech 2025 ·
    Carlos Carvalho
    DBLP profile ↗ORCID search ↗
  23. GALAXY: A Large-Scale Open-Domain Dataset for Multimodal Learning
    InterSpeech 2025 ·
    Yihan Wu
    DBLP profile ↗ORCID search ↗
  24. Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC
    InterSpeech 2025 ·
    Qingzheng Wang
    DBLP profile ↗ORCID search ↗
  25. Interspeech 2025 URGENT Speech Enhancement Challenge
    InterSpeech 2025 ·
    Kohei Saijo
    DBLP profile ↗ORCID search ↗
  26. Lessons Learned from the URGENT 2024 Speech Enhancement Challenge
    InterSpeech 2025 ·
    Wangyou Zhang
    DBLP profile ↗ORCID search ↗
  27. Leveraging Allophony in Self-Supervised Speech Models for Atypical Pronunciation Assessment
    NAACL 2025 ·
    Kwanghee Choi
    DBLP profile ↗ORCID search ↗
  28. OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models
    ICML 2025 ·
    William Chen
    DBLP profile ↗ORCID search ↗
  29. OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning
    InterSpeech 2025 ·
    Yifan Peng
    DBLP profile ↗ORCID search ↗
  30. On-device Streaming Discrete Speech Units
    InterSpeech 2025 ·
    Kwanghee Choi
    DBLP profile ↗ORCID search ↗
  31. OpusLM: A Family of Open Unified Speech Language Models
    InterSpeech 2025 ·
    Jinchuan Tian
    DBLP profile ↗ORCID search ↗
  32. Pick and Summarize: Integrating Extractive and Abstractive Speech Summarization
    InterSpeech 2025 ·
    Takatomo Kano
    DBLP profile ↗ORCID search ↗
  33. Scalable Spontaneous Speech Dataset (SSSD): Crowdsourcing Data Collection to Promote Dialogue Research
    InterSpeech 2025 ·
    Zaid Sheikh
    DBLP profile ↗ORCID search ↗
  34. Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs
    InterSpeech 2025 ·
    Hayato Futami
    DBLP profile ↗ORCID search ↗
  35. SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models
    ACL 2025 ·
    Zhen Wan
    DBLP profile ↗ORCID search ↗
  36. Summarizing Speech: A Comprehensive Survey
    EMNLP 2025 ·
    Fabian Retkowski
    DBLP profile ↗ORCID search ↗
  37. Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
    ICLR 2025 ·
    Siddhant Arora
    DBLP profile ↗ORCID search ↗
  38. The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties
    InterSpeech 2025 ·
    William Chen
    DBLP profile ↗ORCID search ↗
  39. The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition
    InterSpeech 2025 ·
    Ming Gao
    DBLP profile ↗ORCID search ↗
  40. The Text-to-speech in the Wild (TITW) Database
    InterSpeech 2025 ·
    Jee-weon Jung
    DBLP profile ↗ORCID search ↗
  41. Uni-VERSA: Versatile Speech Assessment with a Unified Network
    InterSpeech 2025 ·
    Jiatong Shi
    DBLP profile ↗ORCID search ↗
  42. VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music
    NAACL 2025 ·
    Jiatong Shi
    DBLP profile ↗ORCID search ↗
  43. VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning
    NAACL 2025 ·
    Yifan Peng
    DBLP profile ↗ORCID search ↗
  44. AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
    AAAI 2024 ·
    Rongjie Huang
    DBLP profile ↗ORCID search ↗
  45. Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement
    InterSpeech 2024 ·
    Wangyou Zhang
    DBLP profile ↗ORCID search ↗
  46. Can you Remove the Downstream Model for Speaker Recognition with Self-Supervised Speech Features?
    InterSpeech 2024 ·
    Zakaria Aldeneh
    DBLP profile ↗ORCID search ↗
  47. Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss
    InterSpeech 2024 ·
    Muhammad Shakeel
    DBLP profile ↗ORCID search ↗
  48. Convolution-Augmented Parameter-Efficient Fine-Tuning for Speech Recognition
    InterSpeech 2024 ·
    Kwangyoun Kim
    DBLP profile ↗ORCID search ↗
  49. Cross-Talk Reduction
    IJCAI 2024 ·
    Zhong-Qiu Wang
    DBLP profile ↗ORCID search ↗
  50. Decoder-only Architecture for Streaming End-to-end Speech Recognition
    InterSpeech 2024 ·
    Emiru Tsunoo
    DBLP profile ↗ORCID search ↗
  51. DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding
    InterSpeech 2024 ·
    Suwon Shon
    DBLP profile ↗ORCID search ↗
  52. EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation
    InterSpeech 2024 ·
    Julius Richter
    DBLP profile ↗ORCID search ↗
  53. EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Low Resource and Multilingual Scenarios
    InterSpeech 2024 ·
    Tejes Srivastava
    DBLP profile ↗ORCID search ↗
  54. ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models
    InterSpeech 2024 ·
    Jee-weon Jung
    DBLP profile ↗ORCID search ↗
  55. FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model
    EMNLP 2024 ·
    Yichen Lu
    DBLP profile ↗ORCID search ↗
  56. Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model
    InterSpeech 2024 ·
    Hayato Futami
    DBLP profile ↗ORCID search ↗
  57. ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets
    InterSpeech 2024 ·
    Jiatong Shi
    DBLP profile ↗ORCID search ↗
  58. MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model
    InterSpeech 2024 ·
    Jiatong Shi
    DBLP profile ↗ORCID search ↗
  59. MULTI-CONVFORMER: Extending Conformer with Multiple Convolution Kernels
    InterSpeech 2024 ·
    Darshan Prabhu
    DBLP profile ↗ORCID search ↗
  60. Muskits-ESPnet: A Comprehensive Toolkit for Singing Voice Synthesis in New Paradigm
    ACM MM 2024 ·
    Yuning Wu
    DBLP profile ↗ORCID search ↗
  61. Neural Blind Source Separation and Diarization for Distant Speech Recognition
    InterSpeech 2024 ·
    Yoshiaki Bando
    DBLP profile ↗ORCID search ↗
  62. OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer
    InterSpeech 2024 ·
    Yifan Peng
    DBLP profile ↗ORCID search ↗
  63. OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification
    ACL 2024 ·
    Yifan Peng
    DBLP profile ↗ORCID search ↗
  64. On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models
    InterSpeech 2024 ·
    Jinchuan Tian
    DBLP profile ↗ORCID search ↗
  65. On the Evaluation of Speech Foundation Models for Spoken Language Understanding
    ACL 2024 ·
    Siddhant Arora
    DBLP profile ↗ORCID search ↗
  66. Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting
    InterSpeech 2024 ·
    Yosuke Kashiwagi
    DBLP profile ↗ORCID search ↗
  67. Self-Supervised Speech Representations are More Phonetic than Semantic
    InterSpeech 2024 ·
    Kwanghee Choi
    DBLP profile ↗ORCID search ↗
  68. Self-training ASR Guided by Unsupervised ASR Teacher
    InterSpeech 2024 ·
    Hyung Yong Kim
    DBLP profile ↗ORCID search ↗
  69. Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and ACE-KiSing
    InterSpeech 2024 ·
    Jiatong Shi
    DBLP profile ↗ORCID search ↗
  70. SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics
    InterSpeech 2024 ·
    Takaaki Saeki
    DBLP profile ↗ORCID search ↗
  71. The Interspeech 2024 Challenge on Speech Processing Using Discrete Units
    InterSpeech 2024 ·
    Xuankai Chang
    DBLP profile ↗ORCID search ↗
  72. To what extent can ASV systems naturally defend against spoofing attacks?
    InterSpeech 2024 ·
    Jee-weon Jung
    DBLP profile ↗ORCID search ↗
  73. Towards Robust Speech Representation Learning for Thousands of Languages
    EMNLP 2024 ·
    William Chen
    DBLP profile ↗ORCID search ↗
  74. URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement
    InterSpeech 2024 ·
    Wangyou Zhang
    DBLP profile ↗ORCID search ↗
  75. UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions
    NAACL 2024 ·
    Siddhant Arora
    DBLP profile ↗ORCID search ↗
  76. Wav2Gloss: Generating Interlinear Glossed Text from Speech
    ACL 2024 ·
    Taiqi He
    DBLP profile ↗ORCID search ↗