Home

Jinchao Li (李锦超)
Ph.D. Candidate [Resume]
The Chinese University of Hong Kong
Hong Kong, China
Email: jinchaolovefy [at] gmail.com

Short Bio

I am a final-year Ph.D. student at the Human-Computer Communications Laboratory (HCCL) in The Chinese University of Hong Kong, advised by Prof. Helen Meng.
Before that, I obtained my B.S. with honors from Nanjing University in 2019.
My research interests encompass human-centred AI in speech, language and healthcare, such as:

  • Neurocognitive Disorder Recognition
  • Multimodal Emotion Recognition
  • Multimodal Large Language Models

News

  • 2024.12: One paper submitted to journal (under review).
  • 2023.01: Two papers (1, 2) accepted by ICASSP 2023
  • Fall 2022: Co-teach “Conversational AI systems” (ASR part) with Prof. Meng and other nice colleagues in CUHK
  • 2022.09: Winner of two tasks in the “ACII Affective Vocal Bursts (A-VB)” competition organized by Hume AI

Publications

🤗Thanks to all the collaborators for their great work! Check out my Google Scholar for more information.

* indicates equal contributions.

  1. Detecting Neurocognitive Disorders through Analyses of Topic Evolution and Cross-modal Consistency in Visual-Stimulated Narratives
    Jinchao Li*, Yuejiao Wang*, Junan Li*, Jiawen Kang*, Bo Zheng, Simon Wong, 10 more authors, Helen Meng
    In JSTSP (under review), 2025
  2. emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
    Ziyang Ma, Zhisheng Zheng, Jiaxin Ye, Jinchao Li, Zhifu Gao, Shiliang Zhang, Xie Chen
    In ACL, 2024
  3. Leveraging Pretrained Representations With Task-Related Keywords for Alzheimer’s Disease Detection
    Jinchao Li, Kaitao Song, Junan Li, Bo Zheng, Dongsheng Li, Xixin Wu, Xunying Liu, Helen Meng
    In ICASSP, 2023
  4. A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition
    Jinchao Li, Xixin Wu, Kaitao Song, Dongsheng Li, Xunying Liu, Helen Meng
    In ICASSP, 2023
  5. Context-Aware Multimodal Fusion for Emotion Recognition
    Jinchao Li, Shuai Wang, Yang Chao, Xunying Liu, Helen Meng
    In INTERSPEECH, 2022
  6. A Comparative Study of Acoustic and Linguistic Features Classification for Alzheimer’s Disease Detection
    Jinchao Li, Jianwei Yu, Zi Ye, Simon Wong, Manwai Mak, Brian Mak, Xunying Liu, Helen Meng
    In ICASSP, 2021
  7. Development of the CUHK Elderly Speech Recognition System for Neurocognitive Disorder Detection Using the DementiaBank Corpus
    Zi Ye, Shoukang Hu, Jinchao Li, Xurong Xie, Mengzhe Geng, Jianwei Yu, 4 more authors, Helen Meng
    In ICASSP, 2021

Experiences

PhD Project: Neurocognitive Disorder (NCD) Detection

  Advised by Prof. Helen Meng @HCCL, CUHK, Jul. 2020 - Now

  • Speech and language based NCD detection: feature engineering, multimodal and multilevel fusion
  • Comparatively analyzed NCD-related acoustic and linguistic features
  • Combined narratives with visual stimuli to model macro-level topic evolution and cross-modal consistency

Speech-Empowered Large Language Model (LLM)

  Advised by Dr. Ming Yan and Guohai Xu @Alibaba DAMO Academy, Aug. 2023 - Nov. 2023

  • Processed large-scale audio and textual corpora
  • Empowered LLM with modularized speech ability for adaptive dialogue policy

Multimodal NCD Detection and Affective Computing

  Advised by Dr. Dongsheng Li and Kaitao Song @MSRA Shanghai AI lab, Jun. 2022 - Oct. 2022

  • Task-related text-visual NCD detection
  • Hierarchical multi-output regression for affective vocal burst recognition

Emotion Recognition (ER), Speech Enhancement (SE)

  Advised by Dr. Shuai Wang @Tencent Lightspeed & Quantum Studios, Oct. 2021 - May 2022

  • Multimodal ER: context-aware multimodal fusion for the ER task
  • Real-time monaural SE: FullSubNet-based denoiser for ASR with fbank information

Source Counting (SC)

  Advised by Prof. Jing Lu @NJU and Mr. Changbao Zhu @Horizon Robotics, Dec. 2018 - Apr. 2019

  • Binaural speech SC with similarity and correlation features in various acoustic scenarios
  • Honored the “Excellent Undergraduate Thesis” at NJU in 2019, and published a patent in 2021

Honors & Awards


Academic Activities

  • Reviewer of TASLP, ICASSP, INTERSPEECH, COLING, etc.
  • Co-teach “Conversational AI systems” (ASR part) with Prof. Meng and other nice colleagues in CUHK in Fall 2022
  • Every term 2 during 2019-2023 in CUHK: teaching assistant in ENGG1120 (Linear Algebra for Engineers)