Mu Yang

Mu Yang

About Me

Hi, there! My name is Mu Yang. I’m a 2nd year Ph.D. student in Electrical and Computer Engineering (ECE) at University of Texas at Dallas. My supervisor is Dr. John H. L. Hansen. I’m a member of UTD Center for Robust Speech Systems (UTD CRSS). My research interests include Speech Recognition and Speech Synthesis. In the past, I also had experience in Natural Language Processing, especially in Information Extraction (Event and Event Temporal Relation Extraction).

During my Master’s study at USC, I worked with Dr. Panayiotis Georgiou on Spoken Language Understanding and Speech Synthesis problems. I also worked with Dr. Nanyun (Violet) Peng on Natural Langauge Processing and Information Extraction at USC Information Scienceses Institute (USC ISI). During 2020-2021, I was a Computer Science Ph.D. student at Texas A&M Univeristy, working on Speech Mis-pronunciation Recognition and Voice/Accent Conversion.

Interests
  • Speech Recognition, Speech Synthesis
  • Natural/Spoken Language Processing
  • Information Extraction (Event and Event Relation)
Education

  • Ph.D. in Electrical and Computer Engineering, 2021-

    University of Texas at Dallas, U.S.

  • Ph.D. in Computer Science, 2020-2021 (quitted)

    Texas A&M University, U.S.

  • M.S. in Electrical Engineering, 2017-2019

    University of Southern California, U.S.

  • B.Eng. in Communication Engineering, 2013-2017

    Chongqing University, China

  • Exchange Student, 2016

    National Sun Yat-sen University, Taiwan

Publications

Mu Yang, Andros Tjandra, Chunxi Liu, David Zhang, Duc Le, Ozlem Kalinli (2022). Learning ASR pathways: A sparse multilingual ASR model. submitted to ICASSP 2023.

Preprint

Mu Yang, Kevin Hirschi, Stephen D. Looney, Okim Kang, John H. L. Hansen (2022). Improving Mispronunciation Detection with Wav2vec2-based Momentum Pseudo-Labeling for Accentedness and Intelligibility Assessment. Interspeech 2022 (Oral).

PDF Audio Samples

Mu Yang, Shaojin Ding, Tianlong Chen, Tong Wang, Zhangyang Wang (2022). Towards Lifelong Learning of Multilingual Text-To-Speech Synthesis. ICASSP 2022.

PDF Code Audio Samples

Mu Yang, Darpit Dave, Madhav Erraguntla, Gerard L. Cote, Ricardo Gutierrez-Osuna (2022). Joint hypoglycemia prediction and glucose forecasting via deep multi-task learning. ICASSP 2022.

PDF

Mingyu Derek Ma, Jiao Sun, Mu Yang, Kung-Hsiang Huang, Nuan Wen, Shikhar Singh, Rujun Han, Nanyun Peng (2021). EventPlus: A Temporal Event Understanding Pipeline. NAACL 2021 (Demonstrations).

PDF Code Demo

Mu Yang, Karolina Nurzynska, Ann E. Walts, Arkadiusz Gertych (2020). A CNN-based active learning framework to identify mycobacteria in digitized Ziehl-Neelsen stained human tissues. Computerized Medical Imaging and Graphics 2020.

PDF

Kung-Hsiang Huang, Mu Yang, Nanyun Peng (2020). Biomedical Event Extraction with Hierarchical Knowledge Graphs. EMNLP 2020 (Findings).

PDF Code

Rujun Han, I-Hung Hsu, Mu Yang, Aram Galstyan, Ralph Weischedel, Nanyun Peng (2019). Deep Structured Neural Network for Event Temporal Relation Extraction. CoNLL 2019.

PDF Code

Prashanth G. Shivakumar, Mu Yang, Panayiotis Georgiou (2019). Spoken Language Intent Detection using Confusion2Vec. InterSpeech 2019.

PDF Dataset

Experience

 
 
 
 
 
Meta AI
Research Intern
Meta AI
May 2022 – Aug 2022 New York City, NY, USA

Mentors: Andros Tjandra, Chunxi Liu, David Zhang.

Develop multilingual ASR technologies for on-device scenario.

 
 
 
 
 
USC ISI
Research Assistant
USC ISI
Jul 2019 – Jul 2020 Los Angeles, CA, USA

Supervisor: Nanyun Peng.

NLP projects (Information Extraction).

Selected Projects

Mu Yang
July, 2021 Project
Mis-pronunciation Detection based on Phoneme Recognition
Mis-pronunciation Detection based on Phoneme Recognition

A Mis-pronunciation Detection system, with word-level aligned phonemes predictions.
Audio Samples
Mu Yang, James Bunning, Shiyu Mou, Sharada Murali, Yixin Yang
December, 2018 USC course EE599: Deep Learning Lab for Speech Processing
Synthing: A WaveNet-based Singing Voice Synthisizer
Synthing: A WaveNet-based Singing Voice Synthisizer

Final project for USC course EE599: Deep Learning Lab for Speech Processing - a WaveNet-based singing voice synthesizer. This is a partial implementation of the paper A Neural Parametric Singing Synthesizer Modeling Timbre and Expression from Natural Songs.

PDF Code Dataset Audio Samples
Mu Yang, Tao Chen, Chang Su, Zhe Yang
November, 2018 USC course CSCI544: Applied Natural Language Processing
Collection and Classification of Lyrics
Collection and Classification of Lyrics

Web crawler of lyrics and corresponding music genre. Multiple baseline classifiers, such as Naive Bayes, SVM and Neural Approach(LSTM) are applied to identify the genre of a song by analyzing its lyrics.
PDF Code
Mu Yang
April, 2018 USC course EE522: Immersive Audio Processing
Digital Room Correction using Parallel Second-order Filter-based Equalizer
Digital Room Correction using Parallel Second-order Filter-based Equalizer

A Parallel second-order-based equalizer for Room Impulse Response Calibration.
PDF Code Audio Samples
Mu Yang
June, 2017 Graduation Project for Undergraduates at Chongqing University
Faster-RCNN for Pedestrian Detection in Videos
Faster-RCNN for Pedestrian Detection in Videos

Train and deploy a Faster-RCNN framework to perform pedestrain detection in videos.

Misc.

I love music! I play guitar (a lot), bass (a little), drum (a little) and violin (>10 years back). I play and sing in a few (unprofessional) bands. We covered songs from our favorite artists. Check out some of our videos!