Advanced SearchSearch Tips
Design of Music Learning Assistant Based on Audio Music and Music Score Recognition
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Design of Music Learning Assistant Based on Audio Music and Music Score Recognition
Mulyadi, Ahmad Wisnu; Machbub, Carmadi; Prihatmanto, Ary S.; Sin, Bong-Kee;
  PDF(new window)
Mastering a musical instrument for an unskilled beginning learner is not an easy task. It requires playing every note correctly and maintaining the tempo accurately. Any music comes in two forms, a music score and it rendition into an audio music. The proposed method of assisting beginning music players in both aspects employs two popular pattern recognition methods for audio-visual analysis; they are support vector machine (SVM) for music score recognition and hidden Markov model (HMM) for audio music performance tracking. With proper synchronization of the two results, the proposed music learning assistant system can give useful feedback to self-training beginners.
Hidden Markov Model;Support Vector Machine;Chroma Feature;Histogram of Oriented Gradients;
 Cited by
P. Cano, A. Loscos, and J. Bonada, "Score-Performance Matching Using HMMs," Proceeding of the International Computer Music Association, pp. 441-444, 1995.

N. Orio, "An Automatic Accompanist Based on Hidden Markov Models," Proceeding of Advances in Artificial Intelligence, pp. 64-69, 2001.

A. Cont, D. Schwarz, and N. Schnell, "Training IRCAM's Score Follower," Proceeding of International Conference on Acoustics, Speech, and Signal Processing, pp. 253-256, 2005.

B. Pardo and W. Birmingham, "Modeling Form for On-line Following of Musical Performances," Proceedings of the 20th National Conference on Artificial Intelligence Vol. 2, pp. 1018-1023, 2005.

A. Sheh and D. Ellis, "Chord Segmentation and Recognition using EM-Trained Hidden Markov Models," Proceeding of 4th International Symposium on Music Information Retrieval, pp. 185-191, 2003.

T. Cho and J.P. Bello, "Real-Time Implementation of HMM-Based Chord Estimation in Musical Audio," Proceeding of the International Computer Music Conference, pp. 16-21, 2009.

A. Rabelo, I. Fujinaga, F. Paskiewicz, A.R.S. Marcal, C. Guedes, and J.S. Cardoso, “Optical Music Recognition : State-of-the-art and Open Issues,” International Journal of Multimedia Information Retrieval, Vol. 1, No. 3, pp. 173-190, 2012. crossref(new window)

N. Dalal and B. Triggs. “Histograms of Oriented Gradients for Human Detection,” IEEE Computer Vision and Pattern Recognition, Vol. 1, pp. 886-893, 2005.

R. Ebrahumzadeh and M. Jampour, “Efficient Handwritten Digit Recognition Based on Histogram,” International Journal of Computer Applications, Vol. 104, No. 9, pp. 10-14, 2014. crossref(new window)

R. Ebrahumzadeh and M. Jampour, "Digit Classification Using HOG Features," in MathWorksTM Documentation. (accessed on June 2, 2016)

J.P. Bello, "Chroma and Tonality," New York University's Music Information Retrieval Course. (accessed June 2, 2016).

C. Tralie, "Musical Pitches and Chroma Features" in Duke University's Digital Signal Processing Course, (accessed on June 2, 2016).

D, Boswell. "Introduction to Support Vector Machines", 2002. (accessed on June 2, 2016).

L.R. Rabiner, “A Tutorial on Hidden Markov Modles and Selected Applications in Speech Recognition,” Proceeding of the IEEE, Vol. 77, pp. 257-286, 1989. crossref(new window)

M, Nilsson, First Order Hidden Markov Model : Theory and Implementation Issues, Blekinge Institute of Technology Research Report, pp. 9-54, 2005.

K. Schutte, "MATLAB and MIDI". (accessed on June 2, 2016).

A.W. Mulyadi and B.-K. Sin. "Chroma Based Music Score-Following Using Hidden Markov Model," Proceeding of the Fall Conference Paper on Korean Multimedia Society, 2015.

T. Hur, H. Cho, G. Nam, J. Lee, S. Lee, S. Park, et al., "A Study on the Implementation of the System of Content-based Retrieval of Music Data," Journal of Korea Multimedia Society, vol. 12, iss. 11, pp. 1581-1592, 2009.