Home
Jinchao Li

Jinchao Li (李锦超)
Ph.D. Candidate [Resume]
The Chinese University of Hong Kong
Hong Kong, China
Email: jinchaolovefy [at] gmail.com

Short Bio

I am a final-year Ph.D. student at the Human-Computer Communications Laboratory (HCCL) in The Chinese University of Hong Kong, advised by Prof. Helen Meng. Before that, I obtained my B.S. with honors from Nanjing University in 2019. My research interests encompass human-centred AI in speech, language and healthcare, such as:

  • Neurocognitive Disorder Recognition
  • Multimodal Emotion Recognition
  • Multimodal Large Language Models

News

  • 2023.01: Two papers (1, 2) accepted by ICASSP 2023
  • Fall 2022: Co-teach “Conversational AI systems” (ASR part) with Prof. Meng and other nice colleagues in CUHK
  • 2022.09: Winner of two tasks in the “ACII Affective Vocal Bursts (A-VB)” competition organized by Hume AI

Publications

🤗Thanks to all the collaborators for their great work! Check out my Google Scholar for more information.

  1. papers/23/emotion2vec.png
    emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
    Ziyang Ma, Zhisheng Zheng, Jiaxin Ye, Jinchao Li, Zhifu Gao, Shiliang Zhang, and Xie Chen
    In ACL, 2024
  2. papers/23/MultiAD_ICASSP23.png
    Leveraging Pretrained Representations With Task-Related Keywords for Alzheimer’s Disease Detection
    Jinchao Li, Kaitao Song, Junan Li, Bo Zheng, Dongsheng Li, Xixin Wu, Xunying Liu, and Helen Meng
    In ICASSP, 2023
  3. papers/23/AVB_ICASSP23.png
    A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition
    Jinchao Li, Xixin Wu, Kaitao Song, Dongsheng Li, Xunying Liu, and Helen Meng
    In ICASSP, 2023
  4. papers/22/MER.png
    Context-Aware Multimodal Fusion for Emotion Recognition
    Jinchao Li, Shuai Wang, Yang Chao, Xunying Liu, and Helen Meng
    In INTERSPEECH, 2022
  5. papers/21/Comp_AD.png
    A Comparative Study of Acoustic and Linguistic Features Classification for Alzheimer’s Disease Detection
    Jinchao Li, Jianwei Yu, Zi Ye, Simon Wong, Manwai Mak, Brian Mak, Xunying Liu, and Helen Meng
    In ICASSP, 2021
  6. papers/21/ASR_AD.png
    Development of the CUHK Elderly Speech Recognition System for Neurocognitive Disorder Detection Using the DementiaBank Corpus
    Zi Ye, Shoukang Hu, Jinchao Li, Xurong Xie, Mengzhe Geng, Jianwei Yu, Junhao Xu, and 4 more authors
    In ICASSP, 2021

Experiences

PhD Project: Neurocognitive Disorder (NCD) Detection

  Advised by Prof. Helen Meng and Prof. Xunying Liu @HCCL, CUHK, Jul. 2020 - Now

  • Speech and language based NCD detection: feature engineering, multimodality, and adaptation
  • Feature engineering: comparatively studied the NCD-related acoustic and linguistic features
  • Multimodality: efficient fusion of acoustic, linguistic and demographic modalities

Speech-Empowered Large Language Model (LLM)

  Advised by Dr. Ming Yan and Guohai Xu @Alibaba DAMO Academy, Aug. 2023 - Nov. 2023

  • Process large-scale audio and textual corpora
  • Empower LLM with modularized speech ability for adaptive dialogue policy

Multimodal NCD Detection

  Advised by Dr. Dongsheng Li and Kaitao Song @MSRA Shanghai AI lab, Jun. 2022 - Oct. 2022

  • Investigate the text-visual NCD detection

Emotion Recognition (ER), Speech Enhancement (SE)

  Advised by Dr. Shuai Wang @Tencent Lightspeed & Quantum Studios, Oct. 2021 - May 2022

  • Multimodal ER: context-aware multimodal fusion for the ER task
  • Real-time monaural SE: FullSubNet-based denoiser for ASR with fbank information

Source Counting (SC)

  Advised by Prof. Jing Lu @NJU and Mr. Changbao Zhu @Horizon Robotics, Dec. 2018 - Apr. 2019

  • Binaural speech SC with similarity and correlation features in various acoustic scenarios
  • Honored the “Excellent Undergraduate Thesis” at NJU in 2019, and published a patent in 2021

Honors & Awards

Miscellaneous

Academic Activities

  • Reviewer of ICASSP, INTERSPEECH, COLING, etc.
  • Co-teach “Conversational AI systems” (ASR part) with Prof. Meng and other nice colleagues in CUHK in Fall 2022
  • Every term 2 during 2019-2023 in CUHK: teaching assistant in ENGG1120 (Linear Algebra for Engineers)

Volunteer and Leadership