PPaperPicks

Tao Jin

Zhejiang University, Hangzhou, China

51 papers at tracked venues · 44 at CORE A* · active 2024–2026

DBLP profile ↗ORCID 0000-0003-3564-1628 ↗Homepage ↗

Venues

ACL ×12ACM MM ×7CVPR ×5ICLR ×5NeurIPS ×5AAAI ×4NAACL ×4ICML ×3EMNLP ×2SIGKDD ×2ICCV ×1InterSpeech ×1

Frequent coauthors

Zhou Zhao
×35
Xize Cheng
×17
Zehan Wang
×14
Wang Lin
×14
Zirun Guo
×12
Shengpeng Ji
×12
Xiaoda Yang
×9
Dongjie Fu
×8
Minghui Fang
×8
Sihang Cai
×7
Ziang Zhang
×7
Shulei Wang
×7

Papers

  1. Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search
    ACL 2026 ·
    Zequn Xie
    ,
    Guijin Luo
    ,
    Chuxin Wang
    ,
    Sihang Cai
    , Tao Jin,
    Zhou Zhao
    ,
    Yixuan Tang
  2. DPDV: Dual-Pathway and Dual-View Representation Learning for Bridging Information Asymmetry in Text-Video Retrieval
    ACL 2026 ·
    Zequn Xie
    ,
    Xin Liu
    ,
    Fangming Feng
    ,
    Boyun Zhang
    , Tao Jin
  3. Generative-to-Discriminative Test-Time Adaptation via Manifold-Aware Diffusion and Bayesian Distillation
    ACL 2026 ·
    Boyun Zhang
    ,
    Zequn Xie
    ,
    Fangming Feng
    ,
    Zihan Zhang
    ,
    Yongbo He
    ,
    Chuxin Wang
    ,
    Sihang Cai
    , Tao Jin,
    Qifei Zhang
  4. Rectifying the Emotional Flow: Aligning Priors and Dynamic Guidance for High-Arousal Text-to-Speech
    ACL 2026 ·
    Fangming Feng
    ,
    Dongjie Fu
    ,
    Zequn Xie
    ,
    Yu Zhang
    ,
    Yangyang Wu
    ,
    Zhou Zhao
    , Tao Jin
  5. SAME: Signer-Aware Mixture-of-Experts for Test-Time Adaptation in Sign Language Translation
    ACL 2026 ·
    Lujia Yang
    ,
    Weicai Yan
    ,
    Yongbo He
    ,
    Qifei Zhang
    , Tao Jin,
    Jinshan Zhang
    ,
    Meng Xi
    ,
    Jianwei Yin
  6. Scene-Aware Spatiotemporal Generalization: Towards Robust Temporal Action Detection Across Domains
    AAAI 2026 ·
    Fangming Feng
    ,
    Sihang Cai
    ,
    Zequn Xie
    ,
    Yangyang Wu
    , Tao Jin
  7. View-R1: Asymmetric Policy Optimization for Difficulty-Aware Multimodal Reinforcement Learning
    ACL 2026 ·
    Minjie Hong
    ,
    Zirun Guo
    ,
    Jiabao Zhang
    ,
    Zehan Wang
    ,
    Ziang Zhang
    , Tao Jin,
    Zhou Zhao
  8. A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter
    AAAI 2025 ·
    Zirun Guo
    ,
    Xize Cheng
    ,
    Yangyang Wu
    , Tao Jin
  9. AHa-Bench: Benchmarking Audio Hallucinations in Large Audio-Language Models
    NeurIPS 2025 ·
    Xize Cheng
    ,
    Dongjie Fu
    ,
    Chenyuhao Wen
    ,
    Shannon Yu
    ,
    Zehan Wang
    ,
    Shengpeng Ji
    ,
    Siddhant Arora
    , Tao Jin,
    Shinji Watanabe
    ,
    Zhou Zhao
  10. Bridging the Gap for Test-Time Multimodal Sentiment Analysis
    AAAI 2025 ·
    Zirun Guo
    , Tao Jin,
    Wenlong Xu
    ,
    Wang Lin
    ,
    Yangyang Wu
  11. ConceptGuard: Continual Personalized Text-to-Image Generation with Forgetting and Confusion Mitigation
    CVPR 2025 ·
    Zirun Guo
    , Tao Jin
  12. Data-Efficiently Learn Large Language Model for Universal 3D Scene Perception
    NAACL 2025 ·
    Zehan Wang
    ,
    Haifeng Huang
    ,
    Yang Zhao
    ,
    Ziang Zhang
    , Tao Jin,
    Zhou Zhao
  13. Diff-Prompt: Diffusion-Driven Prompt Generator with Mask Supervision
    ICLR 2025 ·
    Weicai Yan
    ,
    Wang Lin
    ,
    Zirun Guo
    ,
    Ye Wang
    ,
    Fangming Feng
    ,
    Xiaoda Yang
    ,
    Zehan Wang
    , Tao Jin
  14. Efficient Prompting for Continual Adaptation to Missing Modalities
    NAACL 2025 ·
    Zirun Guo
    ,
    Shulei Wang
    ,
    Wang Lin
    ,
    Weicai Yan
    ,
    Yangyang Wu
    , Tao Jin
  15. IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models
    ICML 2025 ·
    Hanting Wang
    , Tao Jin,
    Wang Lin
    ,
    Shulei Wang
    ,
    Hai Huang
    ,
    Shengpeng Ji
    ,
    Zhou Zhao
  16. ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting
    ACM MM 2025 ·
    Yu Zhang
    ,
    Wenxiang Guo
    ,
    Changhao Pan
    ,
    Zhiyuan Zhu
    , Tao Jin,
    Zhou Zhao
  17. Multimodal Conditional Retrieval with High Controllability
    SIGKDD 2025 ·
    Xiaoda Yang
    ,
    Xize Cheng
    ,
    Minghui Fang
    ,
    Hongshun Qiu
    ,
    Yuhang Ma
    ,
    Junyu Lu
    ,
    Jiaqi Duan
    ,
    Sihang Cai
    ,
    Zehan Wang
    ,
    Ruofan Hu
    ,
    Dongjie Fu
    ,
    Zhou Zhao
    , Tao Jin
  18. Non-Natural Image Understanding with Advancing Frequency-based Vision Encoders
    CVPR 2025 ·
    Wang Lin
    ,
    Qingsong Wang
    ,
    Yueying Feng
    ,
    Shulei Wang
    , Tao Jin,
    Zhou Zhao
    ,
    Fei Wu
    ,
    Chang Yao
    ,
    Jingyuan Chen
  19. Omni-Chart-600K: A Comprehensive Dataset of Chart Types for Chart Understanding
    NAACL 2025 ·
    Shulei Wang
    ,
    Shuai Yang
    ,
    Wang Lin
    ,
    Zirun Guo
    ,
    Sihang Cai
    ,
    Hai Huang
    ,
    Ye Wang
    ,
    Jingyuan Chen
    , Tao Jin
  20. OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces
    ICLR 2025 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Minjie Hong
    ,
    Hang Zhang
    ,
    Luping Liu
    ,
    Rongjie Huang
    ,
    Xize Cheng
    ,
    Shengpeng Ji
    , Tao Jin,
    Hengshuang Zhao
    ,
    Zhou Zhao
  21. OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup
    ICLR 2025 ·
    Xize Cheng
    ,
    Siqi Zheng
    ,
    Zehan Wang
    ,
    Minghui Fang
    ,
    Ziang Zhang
    ,
    Rongjie Huang
    ,
    Shengpeng Ji
    ,
    Jialong Zuo
    , Tao Jin,
    Zhou Zhao
  22. Open-Set Cross Modal Generalization via Multimodal Unified Representation
    ICCV 2025 ·
    Hai Huang
    ,
    Yan Xia
    ,
    Shulei Wang
    ,
    Hanting Wang
    ,
    Minghui Fang
    ,
    Shengpeng Ji
    ,
    Sashuai Zhou
    , Tao Jin,
    Zhou Zhao
  23. PACHAT: Persona-Aware Speech Assistant for Multi-party Dialogue
    EMNLP 2025 ·
    Dongjie Fu
    ,
    Xize Cheng
    ,
    Linjun Li
    ,
    Xiaoda Yang
    ,
    Lujia Yang
    , Tao Jin
  24. Smoothing the Shift: Towards Stable Test-Time Adaptation under Complex Multimodal Noises
    ICLR 2025 ·
    Zirun Guo
    , Tao Jin
  25. SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language
    CVPR 2025 ·
    Zehan Wang
    ,
    Sashuai Zhou
    ,
    Shaoxuan He
    ,
    Haifeng Huang
    ,
    Lihe Yang
    ,
    Ziang Zhang
    ,
    Xize Cheng
    ,
    Shengpeng Ji
    , Tao Jin,
    Hengshuang Zhao
    ,
    Zhou Zhao
  26. Speech Token Prediction via Compressed-to-fine Language Modeling for Speech Generation
    ACM MM 2025 ·
    Wenrui Liu
    ,
    Qian Chen
    ,
    Wen Wang
    ,
    Guanrou Yang
    ,
    Weiqin Li
    ,
    Minghui Fang
    ,
    Jialong Zuo
    ,
    Xiaoda Yang
    , Tao Jin,
    Jin Xu
    ,
    Zemin Liu
    ,
    Yafeng Chen
    ,
    Jionghao Bai
    ,
    Zhifang Guo
  27. Speech Watermarking with Discrete Intermediate Representations
    AAAI 2025 ·
    Shengpeng Ji
    ,
    Ziyue Jiang
    ,
    Jialong Zuo
    ,
    Minghui Fang
    ,
    Yifu Chen
    , Tao Jin,
    Zhou Zhao
  28. T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback
    ACL 2025 ·
    Zehan Wang
    ,
    Ke Lei
    ,
    Chen Zhu
    ,
    Jiawei Huang
    ,
    Sashuai Zhou
    ,
    Luping Liu
    ,
    Xize Cheng
    ,
    Shengpeng Ji
    ,
    Zhenhui Ye
    , Tao Jin,
    Zhou Zhao
  29. TAP: Parameter-efficient Task-Aware Prompting for Adverse Weather Removal
    ACM MM 2025 ·
    Hanting Wang
    ,
    Shengpeng Ji
    ,
    Shulei Wang
    ,
    Hai Huang
    ,
    Xiao Jin
    ,
    Qifei Zhang
    , Tao Jin
  30. TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis
    ACL 2025 ·
    Yu Zhang
    ,
    Wenxiang Guo
    ,
    Changhao Pan
    ,
    Dongyu Yao
    ,
    Zhiyuan Zhu
    ,
    Ziyue Jiang
    ,
    Yuhan Wang
    , Tao Jin,
    Zhou Zhao
  31. Towards Transformer-Based Aligned Generation with Self-Coherence Guidance
    CVPR 2025 ·
    Shulei Wang
    ,
    Wang Lin
    ,
    Hai Huang
    ,
    Hanting Wang
    ,
    Sihang Cai
    ,
    WenKang Han
    , Tao Jin,
    Jingyuan Chen
    ,
    Jiacheng Sun
    ,
    Jieming Zhu
    ,
    Zhou Zhao
  32. Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval
    InterSpeech 2025 ·
    Ruofan Hu
    ,
    Yan Xia
    ,
    Minjie Hong
    ,
    Jieming Zhu
    ,
    Bo Chen
    ,
    Xiaoda Yang
    ,
    Minghui Fang
    , Tao Jin
  33. VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?
    ICLR 2025 ·
    Xize Cheng
    ,
    Ruofan Hu
    ,
    Xiaoda Yang
    ,
    Jingyu Lu
    ,
    Dongjie Fu
    ,
    Zehan Wang
    ,
    Shengpeng Ji
    ,
    Rongjie Huang
    ,
    Boyang Zhang
    , Tao Jin,
    Zhou Zhao
  34. Action Imitation in Common Action Space for Customized Action Image Synthesis
    NeurIPS 2024 ·
    Wang Lin
    ,
    Jingyuan Chen
    ,
    Jiaxin Shi
    ,
    Zirun Guo
    ,
    Yichen Zhu
    ,
    Zehan Wang
    , Tao Jin,
    Zhou Zhao
    ,
    Fei Wu
    ,
    Shuicheng Yan
    ,
    Hanwang Zhang
  35. AudioVSR: Enhancing Video Speech Recognition with Audio Data
    EMNLP 2024 ·
    Xiaoda Yang
    ,
    Xize Cheng
    ,
    Jiaqi Duan
    ,
    Hongshun Qiu
    ,
    Minjie Hong
    ,
    Minghui Fang
    ,
    Shengpeng Ji
    ,
    Jialong Zuo
    ,
    Zhiqing Hong
    ,
    Zhimeng Zhang
    , Tao Jin
  36. Boosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts
    ACM MM 2024 ·
    Dongjie Fu
    ,
    Xize Cheng
    ,
    Xiaoda Yang
    ,
    Hanting Wang
    ,
    Zhou Zhao
    , Tao Jin
  37. Calibrating Prompt from History for Continual Vision-Language Retrieval and Grounding
    ACM MM 2024 · Tao Jin,
    Weicai Yan
    ,
    Ye Wang
    ,
    Sihang Cai
    ,
    Qifan Shuai
    ,
    Zhou Zhao
  38. Classifier-guided Gradient Modulation for Enhanced Multimodal Learning
    NeurIPS 2024 ·
    Zirun Guo
    , Tao Jin,
    Jingyuan Chen
    ,
    Zhou Zhao
  39. E3: Exploring Embodied Emotion Through A Large-Scale Egocentric Video Dataset
    NeurIPS 2024 ·
    Wang Lin
    ,
    Yueying Feng
    ,
    WenKang Han
    , Tao Jin,
    Zhou Zhao
    ,
    Fei Wu
    ,
    Chang Yao
    ,
    Jingyuan Chen
  40. EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration
    SIGKDD 2024 ·
    Ye Wang
    ,
    Jiahao Xun
    ,
    Minjie Hong
    ,
    Jieming Zhu
    , Tao Jin,
    Wang Lin
    ,
    Haoyuan Li
    ,
    Linjun Li
    ,
    Yan Xia
    ,
    Zhou Zhao
    ,
    Zhenhua Dong
  41. Extending Multi-modal Contrastive Representations
    NeurIPS 2024 ·
    Ziang Zhang
    ,
    Zehan Wang
    ,
    Luping Liu
    ,
    Rongjie Huang
    ,
    Xize Cheng
    ,
    Zhenhui Ye
    ,
    Wang Lin
    ,
    Huadai Liu
    ,
    Haifeng Huang
    ,
    Yang Zhao
    , Tao Jin,
    Siqi Zheng
    ,
    Zhou Zhao
  42. FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion
    ICML 2024 ·
    Zehan Wang
    ,
    Ziang Zhang
    ,
    Xize Cheng
    ,
    Rongjie Huang
    ,
    Luping Liu
    ,
    Zhenhui Ye
    ,
    Haifeng Huang
    ,
    Yang Zhao
    , Tao Jin,
    Peng Gao
    ,
    Zhou Zhao
  43. Low-rank Prompt Interaction for Continual Vision-Language Retrieval
    ACM MM 2024 ·
    Weicai Yan
    ,
    Ye Wang
    ,
    Wang Lin
    ,
    Zirun Guo
    ,
    Zhou Zhao
    , Tao Jin
  44. MPOD123: One Image to 3D Content Generation Using Mask-Enhanced Progressive Outline-to-Detail Optimization
    CVPR 2024 ·
    Jimin Xu
    ,
    Tianbao Wang
    , Tao Jin,
    Shengyu Zhang
    ,
    Dongjie Fu
    ,
    Zhe Wang
    ,
    Jiangjing Lyu
    ,
    Chengfei Lv
    ,
    Chaoyue Niu
    ,
    Zhou Yu
    ,
    Zhou Zhao
    ,
    Fei Wu
  45. Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition
    ACL 2024 ·
    Zirun Guo
    , Tao Jin,
    Zhou Zhao
  46. Non-confusing Generation of Customized Concepts in Diffusion Models
    ICML 2024 ·
    Wang Lin
    ,
    Jingyuan Chen
    ,
    Jiaxin Shi
    ,
    Yichen Zhu
    ,
    Chen Liang
    ,
    Junzhong Miao
    , Tao Jin,
    Zhou Zhao
    ,
    Fei Wu
    ,
    Shuicheng Yan
    ,
    Hanwang Zhang
  47. Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt
    NAACL 2024 ·
    Yongqi Wang
    ,
    Ruofan Hu
    ,
    Rongjie Huang
    ,
    Zhiqing Hong
    ,
    Ruiqi Li
    ,
    Wenrui Liu
    ,
    Fuming You
    , Tao Jin,
    Zhou Zhao
  48. Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment
    ACL 2024 · Tao Jin,
    Wang Lin
    ,
    Ye Wang
    ,
    Linjun Li
    ,
    Xize Cheng
    ,
    Zhou Zhao
  49. SyncTalklip: Highly Synchronized Lip-Readable Speaker Generation with Multi-Task Learning
    ACM MM 2024 ·
    Xiaoda Yang
    ,
    Xize Cheng
    ,
    Dongjie Fu
    ,
    Minghui Fang
    ,
    Jialong Zuo
    ,
    Shengpeng Ji
    ,
    Zhou Zhao
    , Tao Jin
  50. TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation
    ACL 2024 ·
    Xize Cheng
    ,
    Rongjie Huang
    ,
    Linjun Li
    ,
    Zehan Wang
    , Tao Jin,
    Aoxiong Yin
    ,
    Feiyang Chen
    ,
    Xinyu Duan
    ,
    Baoxing Huai
    ,
    Zhou Zhao
  51. Uni-Dubbing: Zero-Shot Speech Synthesis from Visual Articulation
    ACL 2024 ·
    Songju Lei
    ,
    Xize Cheng
    ,
    Mengjiao Lyu
    ,
    Jianqiao Hu
    ,
    Jintao Tan
    ,
    Runlin Liu
    ,
    Lingyu Xiong
    , Tao Jin,
    Xiandong Li
    ,
    Zhou Zhao