DOI QR코드

DOI QR Code

Guitar Tab Digit Recognition and Play using Prototype based Classification

  • Received : 2016.02.06
  • Accepted : 2016.06.07
  • Published : 2016.09.30

Abstract

This paper is to recognize and play tab chords from guitar musical sheets. The musical chord area of an input image is segmented by changing the image in saturation and applying the Grabcut algorithm. Based on a template matching, our approach detects tab starting sections on a segmented musical area. The virtual block method is introduced to search blanks over chord lines and extract tab fret segments, which doesn't cause the computation loss to remove tab lines. In the experimental tests, the prototype based classification outperforms Bayesian method and the nearest neighbor rule with the whole set of training data and its performance is similar to that of the support vector machine. The experimental result shows that the prediction rate is about 99.0% and the number of selected prototypes is below 3.0%.

Keywords

References

  1. B. K. Hwang, "An Implementation of Smartphone-based Multiple Musical Instruments Application supporting Social Playing," Journal of Digital Contents, Vol. 12, No. 4, pp. 575-583, Dec. 2011. https://doi.org/10.9728/dcs.2011.12.4.575
  2. Guitar Pro, http://www.guitar-pro.com.
  3. S. H. Jung, Y. W. Kwon, C. B. Sim, "An Efficient Car Management System based an Object-Oriented Modeling using Car Number Recognition and Smart Phone," Journal of Korea Institute of Electronic Communication Science, Vol. 7, No.5, pp. 1153-1164, Oct. 2012. https://doi.org/10.13067/JKIECS.2012.7.5.1153
  4. G. H. Park, S. Y. Oh, H. J. Son, J. M. Yoo, S. H. Kim, G. S. Lee, "Decision-Tree Algorithm for Recognition of Music Score Images Obtained by Mobile Phone Camera," Journal of The Korea Contents Association, Vol. 8, No. 6, pp. 16-25, May. 2008. https://doi.org/10.5392/JKCA.2008.8.6.016
  5. K. B. Kim, W. J. Lee, Y. W. Woo, "Automatic Recognition and Performance of Printed Musical Sheets Using Fuzzy ART," Journal of Korea Institute of Electronic Communication Science, Vol. 6, No. 1, pp. 84-89, Feb. 2011.
  6. J. M. Yoo, G. H. Kim, G. S. Lee, "Music Recognition by Partial Template Matching," Journal of The Korea Contents Association, Vol. 8, No. 11, pp. 85-93, Nov. 2008. https://doi.org/10.5392/JKCA.2008.8.11.085
  7. Raspberry Pi document, https://www.raspberrypi.org/documentation/.
  8. OpenCV Document, http://docs.opencv.org.
  9. Pygame, http://www.pygame.org.
  10. S. Y. Shim, D. H. Hwang, "Prototype based Classification by Generating Multidimensional Spheres per Class Area," Journal of The Korea Society of Computer and Information, Vol. 20, No. 2, Feb. 2015.
  11. Carsten Rother, Vladimir Kolmogorov, Andrew Blake, "GrabCut : Interactive Foreground Extraction using Iterated Graph Cuts," in Proc. SIGGRAPH '04 ACM SIGGRAPH 2004 Vol. 23, Issue 3, Aug. 2004, pp. 309-314, 2004.
  12. N. Otsu, "A threshold selection method from gray-level histogram", IEEE Tran. Systems Man Cybernet, vol. SMC-9, pp.82-88 , 1979
  13. J. R. Parker, "Algorithms for Image Processing and computer vision 2nd Edition", Wiley publishing, 2011.
  14. Puneet, Naresh Kumar Garg, "Binarization Techniques used for Grey Scale Images," International Journal of Computer Applications, Vol.71, No.1, pp. 8-11, June 2013. https://doi.org/10.5120/12320-8533
  15. L.J.P. van der Maaten and G.E. Hinton. "Visualizing High-Dimensional Data Using t-SNE", Journal of Machine Learning Research, Vol.9, pp.2579-2605, Nov. 2008.