Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Finger Detection Algorithm For Computer Mouse Control

  • Rodrigue, Gendusa Tulonge (Department of Information and Communication Engineering, TongMyong University) ;
  • Lee, Eung-Joo (Department of Information and Communication Engineering, TongMyong University)
  • Received : 2016.12.12
  • Accepted : 2017.03.24
  • Published : 2017.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

We propose a finger detection algorithm for computer mouse control to control the most commonly actions of a computer mouse(left, right and double click, scroll up and down then we add open and close, minimize and maximize a window, control the mouse.) We use a built-in web camera to control the mouse tasks. We detected, segment, then recognize the hand in our previous papers [1, 2]. The user will be able to interact with the computer with the number of fingers detected.

Keywords

References

  1. G. T. Rodrigue and E. J. Lee, "Simple and Robust Finger Detection Algorithm for Controlling the Mouse," Proceeding of Conference of Korea Multimedia Society, pp. 210-213, 2016.
  2. G. T. Rodrigue and E. J. Lee, "An Improved Fingertip Tracking Algorithm for Hand Mouse," Proceeding of International Conference on Multimedia Information Technology and Application, pp. 214-217, 2016.
  3. M. K. Bhuyan, D. R. Neog, M. K. Kar. "Fingertip Detection for Hand Pose Recognition," Proceeding of International Journal on Computer Science and Engineering, pp. 501-511, 2012.
  4. V. I. Pavlovic, R. Sharma and T. S. Huang, "Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review." IEEE Transactions on Pattern Analysis and Machine Intelligence. pp. 677-695. 1997.
  5. N. Sakhare and P. Rai, "A Method for Controlling Mouse Movement using a Real Time Camera." International Journal of Research. pp. 840-846. 2015.
  6. V. J. Vivek and P. L. Swaminathan, "Robust Hand Gesture Recognition Algorithm for Simple Mouse Control," International Journal of Computer and Communication Engineering, pp. 219-221. Vol. 2, No. 2, 2013.
  7. T. Heap and D, Hogg, "Wormholes in Shape Space: Tracking through Discontinuous Changes in Shape," Proceeding of Sixth International Conference on Computer Vision, pp. 344-349, 1998.
  8. A. Albiol, L. Torres, and E. J. Delp, "Optimum Color Spaces for Skin Detection," Proceeding of Image Processing International Conference, Vol. 1, pp. 122-124, 2001.
  9. K. S. C. Kumar. "A Vision based Application for Virtual Mouse Interface Using Finger-Tip," Proceeding of International Junrnal of Computer Science and Information Technologies. Vol. 3(3). pp. 4460-4464. 2012.
  10. K. Sekeroglu, Virtual Mouse Using a Webcam, EE7700-Semester Project Report, 2012.
  11. V. J. Veeriah and P. L. Swaminathan, "Robust Hand Gesture Recognition Algorithm for Simple Mouse Control," International Journal of Computer and Communication Engineering, Vol. 2, No. 2, pp. 219-221, 2013.
  12. J. L. Raheja, K. Das and A. Chaudhary, "An Efficient Real Time Method of Fingertip Detection." Proceeding of International Conference on Trends in Industrial Measurements and Automation, pp. 447-450. 2011.
  13. D. Varsha and A. Anupam, "Real Time Hand Gesture Recognition & Tracking for Dynamic Gesture Recognition." International Systems and Application . pp. 39-44. 2012.
  14. J. M. Kim and W .K. Lee, "Hand Space Recognition Using Fingertips," Proceeding of 5th International Conference Fuzzy System Knowledge Discovery, pp. 44-48, 2008.
  15. D. Lee and Y. Park, "Vision-Based Remote Control System by Motion Detection and Open Finger Counting," IEEE Transactions on Consumer Electron, Vol. 55, No. 4, pp. 2308-2313, 2009. https://doi.org/10.1109/TCE.2009.5373803
  16. K. Oka, Y. Sato, and H. Koike, "Real-Time Fingertip Tracking and Gesture Recognition," IEEE Computer Graphics Applications, Vol. 22, No. 6, pp. 64-71, 2002. https://doi.org/10.1109/MCG.2002.1046630
  17. S.C. Crampton and M. Betke, "Counting Fingers in Real Time: A Webcam-Based Human-Computer Interface with Game Applications," Proceeding of Conference Universal Access Human-Computer Interaction, pp.1357-1361, 2003.
  18. J. MacLean, R. Herpers, C. Pantofaru and L. Wood, "Fast Hand Gesture Recognition for Real-Time Teleconferencing Applications," Proceeding of International Workshop Recognition, Analysis Tracking of Faces Gestures Real Time System, pp. 133-140, 2001.
  19. R. Belaroussi and M. Milgram, "A Real Time Fingers Detection by Symmetry Transform Using a Two Cameras System," Lecture Notes in Computer Science, Vol. 5359, pp. 703-712, 2008.
  20. O. Gallo, S. M. Arteaga, and J.E. Davis, "A Camera-Based Pointing Interface for Mobile Devices," Proceeding of IEEE International Conference of Image Processing, pp. 1420-1423, 2008.
  21. B. Stenger, A. Thayananthan, P. Torr and R. Cipolla, "Model-Based Hand Tracking Using a Hierarchical Bayersian Filter," IEEE Transactions on Pattern Analysis and Machine Intellgence, Vol. 28, pp. 1372-1384, 2006. https://doi.org/10.1109/TPAMI.2006.189
  22. J. Alon, V. Athitsos, Q. Yuan and S. Sclaroff, "A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, No. 9, pp. 1685-1699, 2009. https://doi.org/10.1109/TPAMI.2008.203
  23. H. Ying, J. Song, X. Ren and W. Wang, "Fingertip Detection and Tracking Using 2D and 3D Information," Proceeding of 7th World Congress Intelligent Control, pp. 1149-1152, 2008.
  24. C. Nolker and H. Ritter, "Detection of Fingertips in Human Hand Movement Sequences," Gesture Sign Language Human-Computer Interaction, Vol. 1371, pp. 209-218, 1997.
  25. A.M. Bums and B. Mazzarino, "Finger Tracking Methods Using EyesWeb," Lecture Notes in Computer Science, Vol. 3881, pp. 156-167, 2006.
  26. J. Hannuksela, S. Huttunen, P. Sangi and H. Heikkila, "Motion-Based Finger Tracking for User Interface with Mobile Devices," Proceeding of IET 4th European Conference Visual Media Production, 2007.
  27. A. A. Argyros and M. I. A. Lourakis, "Vision-Based Interpretation of Hand Gestures for Remote Control of a Computer Mouse," Lecture Notes in Computer Science, Vol. 3979, pp. 40-51, 2006.
  28. J. Hannuksela, M. Barnard, P. Sangi and J. Heikkila, "Adaptive Motion-Based Gesture Recognition Interface for Mobile Phones," Lecture Notes in Computer Science, Vol. 5008, pp. 271-280, 2008.
  29. Wikipedia, Binary Image, https://en.wikipedia.org/wiki/Binary_image, (accessed Nov., 2016).
  30. Wikipedia, Mathematical Morphology, https://en.wikipedia.org/wiki/Mathematical_morphology, (accessed Nov., 2016).
  31. Steloflute, (Java) Robot Class, http://steloflute.tistory.com/entry/Java-Robot-Class, (accessed Nov., 2016).
  32. Software Functional Test Automation, Maximize Browser Window using Java Robot in Selenium, http://functionaltestautomation.-blogspot.kr/2009/10/maximize-browser-window-using-java.html (accessed Nov., 2016).