Advanced SearchSearch Tips
Design of Contactless Gesture-based Rhythm Action Game Interface for Smart Mobile Devices
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Design of Contactless Gesture-based Rhythm Action Game Interface for Smart Mobile Devices
Ju, Da-Young;
  PDF(new window)
Objective: The aim of this study is to propose the contactless gesture-based interface on smart mobile devices for especially rhythm action games. Background: Most existing approaches about interactions of smart mobile games are tab on the touch screen. However that way is such undesirable for someone or for sometimes, because of the disabled person, or the inconvenience that users need to touch/tab specific devices. Moreover more importantly, new interaction can derive new possibilities from stranded game genre. Method: In this paper, I present a smart mobile game with contactless gesture-based interaction and the interfaces using computer vision technology. Discovering the gestures which are easy to recognize and research of interaction system that fits to game on smart mobile device are conducted as previous studies. A combination between augmented reality technique and contactless gesture interaction is also tried. Results: The rhythm game allows a user to interact with smart mobile devices using hand gestures, without touching or tabbing the screen. Moreover users can feel fun in the game as other games. Conclusion: Evaluation results show that users make low failure numbers, and the game is able to recognize gestures with quite high precision in real time. Therefore the contactless gesture-based interaction has potentials to smart mobile game. Application: The results are applied to the commercial game application.
Game;Gesture recognition;Contactless interaction;Smart mobile device;User interfaces;
 Cited by
Billon, R., Nedelec, A. and Tisseau, J., "Gesture Recognition in Flow based on PCA Analysis using Multiagent System", In Proceedings of ACE. 2008.

Blain, T., "The convergence of alternate controllers and musical interfaces in interactive entertainment", In Proc. of the 2005 international conf. on new interfaces for musical expression (NIME05), p.27-33, 2005.

Elmezain, M., Al-Hamadi, A., Appenrodt, J. and Michaelis, B., A Hidden Markov Model-Based Continuous Gesture Recognition System for Hand Motion Trajectory. In Proceedings of 19th International Conference on Pattern Recognition, p.1-4, 2008.

He, G. F., Park, J. W., Kang, S. K. and S. K. ung, S. K., "Development of Gesture Recognition-Based 3D Serious Games", Journal of Korea game society, p.103-114, 2011.

Hoysniemi, J., "Design and evaluation of physically interactive games", PhD thesis, University of Tampere, 2006.

Ju, D. Y., "Contactless gesture-based interaction for smart mobile games.", In Proc. of ESK Spring conf. & 14th Korea-Japan joint symposium, 2012.

Lee, Y. C., Oh, C. M. and Lee, C. W., "Mobile Game Control Using Gesture Recognition", Journal of the Korea contents association, p.629-638, 2011.

Liu, J., Zhong, L., Wickramasuriya, J. and Vasudevan, V., "uWave: Accelerometer-based personalized gesture recognition and its applications", Pervasive Mob. Comput., 5(6), 657-675, 2009. crossref(new window)

Mistry, K. and Zhang, L., "Gesture Recognition Exploration using Haartraining and KNN in a 3D Racing Game", In proceedings of MIAA. p.37-40, 2011.

Mitra, S. and Acharya, T., "Gesture recognition: A survey. IEEE Trans. Syst.", Man and Cybern., 37(3), 311-324, 2007. crossref(new window)

Park, J. Y., Kim, G. C., Park, J. W. and Lee, J. H., "Interactive Boxing Game Based on Computer Vision", Sungkyunkwan University, p.35-51, 2005.

Park, Y. and Kihl, T., "A study for the user interface of rhythm action games on smart device", In Proc. of Korea game society p.191-197, 2011.

Pavlovic, V. I., Sharma, R. and Huang, T. S., "Visual interpretation of hand gestures for human-computer interaction: A review". PAMI, 19(7), 677-695, 1997. crossref(new window)

Westerman, W. C. and Elias, J. G., "System and method for packing multitouch gestures onto a hand", April 2006.

Wilson, A. and Shafer, S., "XWand: UI for intelligent spaces". In Proc. SIGCHI conf. Human factors in computer system, pages 545-552, 2003.

Wobbrock, J. O., Wilson, A. D. and Li, Y., "Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes", In Proc. ACM UIST, pages 159-168, 2007.

Yang, M. H., Ahuja, N. and Tabb, M., "Extraction of 2D motion trajectories and its application to hand gesture recognition", IEEE Trans. Pattern Anal. Mach. Intell., 24(8), 1061-1074, 2002. crossref(new window)

Yuk, H., "A study on the types of interactive motions in mobile touch interface", PhD thesis, Hongik University, 2009.