Model-Based Multiple Pitch Tracking Using Factorial HMMs: Model Adaptation and Inference

Michael Wohlmayr, Franz Pernkopf

Research output: Contribution to journalArticlepeer-review


Robustness against noise and interfering audio signals is one of the challenges in speech recognition and audio analysis technology. One avenue to approach this challenge is single-channel multiple-source modeling. Factorial hidden Markov models (FHMMs) are capable of modeling acoustic scenes with multiple sources interacting over time. While these models reach good performance on specific tasks, there are still serious limitations restricting the applicability in many domains. In this paper, we generalize these models and enhance their applicability. In particular, we develop an EM-like iterative adaptation framework which is capable to adapt the model parameters to the specific situation (e.g. actual speakers, gain, acoustic channel, etc.) using only speech mixture data. Currently, source-specific data is required to learn the model. Inference in FHMMs is an essential ingredient for adaptation. We develop efficient approaches based on observation likelihood pruning. Both adaptation and efficient inference are empirically evaluated for the task of multipitch tracking using the GRID corpus
Original languageEnglish
Pages (from-to)1742-1754
JournalIEEE Transactions on Audio Speech and Language Processing
Issue number8
Publication statusPublished - 2013

Fields of Expertise

  • Information, Communication & Computing


Dive into the research topics of 'Model-Based Multiple Pitch Tracking Using Factorial HMMs: Model Adaptation and Inference'. Together they form a unique fingerprint.

Cite this