PPaperPicks

Yifan Peng

NVIDIA Corporation, Santa Clara, CA, USA

19 papers at tracked venues · 4 at CORE A* · active 2024–2025

DBLP profile ↗ORCID 0000-0002-8581-8674 ↗Google Scholar ↗Homepage ↗

Venues

InterSpeech ×10NAACL ×4AAAI ×1ACL ×1EMNLP ×1ICLR ×1ICML ×1

Frequent coauthors

Shinji Watanabe
×18
Jinchuan Tian
×9
William Chen
×9
Siddhant Arora
×6
Yui Sudo
×5
Muhammad Shakeel
×5
Jiatong Shi
×5
Shikhar Bharadwaj
×3
Huck Yang
×3
Karen Livescu
×3
Chyi-Jiunn Lin
×2
Hayato Futami
×2

Papers

  1. Context-aware Dynamic Pruning for Speech Foundation Models
    ICLR 2025 ·
    Masao Someki
    , Yifan Peng,
    Siddhant Arora
    ,
    Markus Müller
    ,
    Athanasios Mouchtaris
    ,
    Grant P. Strimel
    ,
    Jing Liu
    ,
    Shinji Watanabe
  2. DYNAC: Dynamic Vocabulary-based Non-Autoregressive Contextualization for Speech Recognition
    InterSpeech 2025 ·
    Yui Sudo
    ,
    Yosuke Fukumoto
    ,
    Muhammad Shakeel
    , Yifan Peng,
    Chyi-Jiunn Lin
    ,
    Shinji Watanabe
  3. ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems
    NAACL 2025 ·
    Siddhant Arora
    , Yifan Peng,
    Jiatong Shi
    ,
    Jinchuan Tian
    ,
    William Chen
    ,
    Shikhar Bharadwaj
    ,
    Hayato Futami
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    ,
    Shuichiro Shimizu
    ,
    Vaibhav Srivastav
    ,
    Shinji Watanabe
  4. ESPnet-SpeechLM: An Open Speech Language Model Toolkit
    NAACL 2025 ·
    Jinchuan Tian
    ,
    Jiatong Shi
    ,
    William Chen
    ,
    Siddhant Arora
    ,
    Yoshiki Masuyama
    ,
    Takashi Maekaku
    ,
    Yihan Wu
    ,
    Junyi Peng
    ,
    Shikhar Bharadwaj
    ,
    Yiwen Zhao
    ,
    Samuele Cornell
    , Yifan Peng,
    Xiang Yue
    ,
    Chao-Han Huck Yang
    ,
    Graham Neubig
    ,
    Shinji Watanabe
  5. Enhancing Audiovisual Speech Recognition Through Bifocal Preference Optimization
    AAAI 2025 ·
    Yihan Wu
    ,
    Yichen Lu
    , Yifan Peng,
    Xihua Wang
    ,
    Ruihua Song
    ,
    Shinji Watanabe
  6. Exploring Linear Variant Transformers and k-NN Memory Inference for Long-Form ASR
    InterSpeech 2025 ·
    Carlos Carvalho
    ,
    Jinchuan Tian
    ,
    William Chen
    , Yifan Peng,
    Alberto Abad
    ,
    Shinji Watanabe
  7. Granary: Speech Recognition and Translation Dataset in 25 European Languages
    InterSpeech 2025 ·
    Nithin Rao Koluguri
    ,
    Monica Sekoyan
    ,
    George Zelenfroynd
    ,
    Sasha Meister
    ,
    Shuoyang Ding
    ,
    Sofia Kostandian
    ,
    He Huang
    ,
    Nikolay Karpov
    ,
    Jagadeesh Balam
    ,
    Vitaly Lavrukhin
    , Yifan Peng,
    Sara Papi
    ,
    Marco Gaido
    ,
    Alessio Brutti
    ,
    Boris Ginsburg
  8. Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC
    InterSpeech 2025 ·
    Qingzheng Wang
    ,
    Jiancheng Sun
    , Yifan Peng,
    Shinji Watanabe
  9. OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models
    ICML 2025 ·
    William Chen
    ,
    Jinchuan Tian
    , Yifan Peng,
    Brian Yan
    ,
    Chao-Han Huck Yang
    ,
    Shinji Watanabe
  10. OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning
    InterSpeech 2025 · Yifan Peng,
    Muhammad Shakeel
    ,
    Yui Sudo
    ,
    William Chen
    ,
    Jinchuan Tian
    ,
    Chyi-Jiunn Lin
    ,
    Shinji Watanabe
  11. OpusLM: A Family of Open Unified Speech Language Models
    InterSpeech 2025 ·
    Jinchuan Tian
    ,
    William Chen
    , Yifan Peng,
    Jiatong Shi
    ,
    Siddhant Arora
    ,
    Shikhar Bharadwaj
    ,
    Takashi Maekaku
    ,
    Yusuke Shinohara
    ,
    Keita Goto
    ,
    Xiang Yue
    ,
    Huck Yang
    ,
    Shinji Watanabe
  12. VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning
    NAACL 2025 · Yifan Peng,
    Krishna C. Puvvada
    ,
    Zhehuai Chen
    ,
    Piotr Zelasko
    ,
    He Huang
    ,
    Kunal Dhawan
    ,
    Ke Hu
    ,
    Shinji Watanabe
    ,
    Jagadeesh Balam
    ,
    Boris Ginsburg
  13. Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss
    InterSpeech 2024 ·
    Muhammad Shakeel
    ,
    Yui Sudo
    , Yifan Peng,
    Shinji Watanabe
  14. MULTI-CONVFORMER: Extending Conformer with Multiple Convolution Kernels
    InterSpeech 2024 ·
    Darshan Prabhu
    , Yifan Peng,
    Preethi Jyothi
    ,
    Shinji Watanabe
  15. OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer
    InterSpeech 2024 · Yifan Peng,
    Jinchuan Tian
    ,
    William Chen
    ,
    Siddhant Arora
    ,
    Brian Yan
    ,
    Yui Sudo
    ,
    Muhammad Shakeel
    ,
    Kwanghee Choi
    ,
    Jiatong Shi
    ,
    Xuankai Chang
    ,
    Jee-weon Jung
    ,
    Shinji Watanabe
  16. OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identification
    ACL 2024 · Yifan Peng,
    Yui Sudo
    ,
    Muhammad Shakeel
    ,
    Shinji Watanabe
  17. On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models
    InterSpeech 2024 ·
    Jinchuan Tian
    , Yifan Peng,
    William Chen
    ,
    Kwanghee Choi
    ,
    Karen Livescu
    ,
    Shinji Watanabe
  18. Towards Robust Speech Representation Learning for Thousands of Languages
    EMNLP 2024 ·
    William Chen
    ,
    Wangyou Zhang
    , Yifan Peng,
    Xinjian Li
    ,
    Jinchuan Tian
    ,
    Jiatong Shi
    ,
    Xuankai Chang
    ,
    Soumi Maiti
    ,
    Karen Livescu
    ,
    Shinji Watanabe
  19. UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions
    NAACL 2024 ·
    Siddhant Arora
    ,
    Hayato Futami
    ,
    Jee-weon Jung
    , Yifan Peng,
    Roshan S. Sharma
    ,
    Yosuke Kashiwagi
    ,
    Emiru Tsunoo
    ,
    Karen Livescu
    ,
    Shinji Watanabe