Advanced SearchSearch Tips
Implementation of Muscular Sense into both Color and Sound Conversion System based on Wearable Device
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Implementation of Muscular Sense into both Color and Sound Conversion System based on Wearable Device
Bae, Myungjin; Kim, Sungill;
  PDF(new window)
This paper presents a method for conversion of muscular sense into both visual and auditory senses based on synesthetic perception. Muscular sense can be defined by rotation angles, direction changes and motion degrees of human body. Synesthetic interconversion can be made by learning, so that it can be possible to create intentional synesthetic phenomena. In this paper, the muscular sense was converted into both color and sound signals which comprise the great majority of synesthetic phenomena. The measurement of muscular sense was performed by using the AHRS(attitude heading reference system). Roll, yaw and pitch signals of the AHRS were converted into three basic elements of color as well as sound, respectively. The proposed method was finally applied to a wearable device, Samsung gear S, successfully.
Wearable Device;Muscular Sense;Synesthetic Conversion;Color Model;MIDI;
 Cited by
G.T. Kim, K.S. Lee, and K.J Lee, “IoT Technology Trends Based on Wearable Devices,” Journal of Korea Contents Association, Vol. 13, No. 1, pp. 25-30, 2015.

M.G. Kim, Development of Wearable Device Input Interface by Electromyographic Signal Measurement, Master's Thesis of Inje University, 2015.

S. Patel, H. Park, P. Bonato, L. Chan, and M. Rodgers, “A Review of Wearable Sensors and Systems with Application in Rehabilitation,” Journal of Neuroengineering and Rehabilitation, Vol. 9, No. 12, pp. 1-17, 2012. crossref(new window)

T.H. Yoon, S.W. Yoon, J.H. Ko and H.K Kim, “Research and Design of Smart Phone Sensor-based Context-aware System,” Journal of Korea Multimedia Society, Vol. 18, No. 3, pp. 408-418, 2015. crossref(new window)

H.Y. Yoo, A Study on Color Recognition by Color Synesthesia, Master's Thesis of Ewha University, 2010.

K.Y. Jun, A Synesthetic Expression of Sound and Colors, Master's Thesis of Ewha University, 2004.

Y.C. Kim. A Study on the Factors That Create Synesthesia-Focusing on Relationship between the Senses of Touch, Sound, and Color, Doctoral Thesis of Hong-Ik University, 2005.

M.J. Bae and S.I. Kim, “The System of Converting Muscular Sense Into both Color and Sound Based on the Synesthetic Perception,” Journal of Korean Institute of Intelligent Systems, Vol. 24, No. 5, pp. 462-469, 2014. crossref(new window)

M. Edward and S. Ramachandran. "Neurocognitive Mechanisms of Synesthesia," Journal of Neuron, Vol. 48, No. 3, pp. 509-520, 2005. crossref(new window)

M.E. Hubbard, A.C. Arman, V.S. Ramachandran and G.M. Boynton, "Individual Differences among Grapheme-color Synesthetes: Brain-Behavior Correlations," Journal of Neuron, Vol. 45, No. 6, pp. 975-985, 2005. crossref(new window)

R. Rouw and H.S. Scholte, "Neural Basis of Individual Differences in Synesthetic Experiences," Journal of Neuroscience, Vol. 30, No. 18, pp. 6205-6213, 2010. crossref(new window)

J.Y. Kim, “A Study on Applied Synesthesia Visualization of Brand Design,” Journal of Academia-industrial Technology, Vol. 2, No. 97, pp. 874-877, 2011.

H.Y. Jeon, A Study on Musical Appreciative Guidance Utilizing Synesthesia In The Middle School-Mainly Focused on Scheherazade by Rimsky Korsakov, Master's Thesis of Yonsei University, 2014.

S.K. Suslick, "Synesthesia in Science and Technology: More Than Making the Unseen Visible," Journal of Current Opinion in Chemical Biology, Vol. 16. No. 5, pp. 557-563, 2012. crossref(new window)

B. Daniel, R. Nicolas, J. David, and C. Stephanie, Adults Can Be Trained To Acquire Synesthetic Experiences, Scientific Reports 4, 2014.

N. Witthoft and J. Winawer, "Learning, Memory, and Synesthesia," Journal of Psychological Science, Vol. 24, No. 3, pp. 258-265, 2013. crossref(new window)

Y.J. Seo, Tizen to Develop a Wearable App, Hanbitmedia Publishers, Seoul, 2015.

J.H. Kim, The Upper Limb Position Sense of the Athletes in Different Sport Events, Master's Thesis of Korea National University of Education, 2004.

O.C. Heo, Attitude Estimation of the Moving Bodies Using the MEMS Sensor, Master's Thesis of Sungkyunkwan University, 2010.

Praat, (accessed Feb., 24, 2016)