DOI QR코드

DOI QR Code

Implementation of ARM based Embedded System for Muscular Sense into both Color and Sound Conversion

근감각-색·음 변환을 위한 ARM 기반 임베디드시스템의 구현

  • 김성일 (경남대학교 전자공학과)
  • Received : 2016.04.05
  • Accepted : 2016.05.12
  • Published : 2016.08.28

Abstract

This paper focuses on a real-time hardware processing by implementing the ARM Cortex-M4 based embedded system, using a conversion algorithm from a muscular sense to both visual and auditory elements, which recognizes rotations of a human body, directional changes and motion amounts out of human senses. As an input method of muscular sense, AHRS(Attitude Heading Reference System) was used to acquire roll, pitch and yaw values in real time. These three input values were converted into three elements of HSI color model such as intensity, hue and saturation, respectively. Final color signals were acquired by converting HSI into RGB color model. In addition, Three input values of muscular sense were converted into three elements of sound such as octave, scale and velocity, which were synthesized to give an output sound using MIDI(Musical Instrument Digital Interface). The analysis results of both output color and sound signals revealed that input signals of muscular sense were correctly converted into both color and sound in real time by the proposed conversion method.

Keywords

Synesthesia;Muscular Sense;Embedded System;Color Model;MIDI

Acknowledgement

Supported by : 경남대학교

References

  1. 김용철, 공감각의 형성요인에 관한 연구, 홍익대학교 대학원, 박사학위논문, 2005.
  2. https://en.wikipedia.org/wiki/Synesthesia
  3. K. S. Suslick, "Synesthesia in science and technology: more than making the unseen visible," Current opinion in chemical biology Vol.16. No.5, pp.557-563, 2012. https://doi.org/10.1016/j.cbpa.2012.10.030
  4. 김조한, 운동 종목에 따른 상지 위치감각, 한국교원대학교 교육대학원, 석사학위논문, 2004.
  5. 전가영, 음과 색의 공감각적 표현, 이화여자대학교 대학원, 석사학위논문, 2003.
  6. 임윤정, 소리와 색채의 연관성에 관한 연구, 건국대학교 대학원, 석사학위논문, 2013.
  7. J. Harrison and S. Baron-Cohen, "Synaesthesia: An Account of Coloured Hearing," Leonardo, Vol.27, No.4, pp.343-346, 1994. https://doi.org/10.2307/1576010
  8. 배명진, 김성일, "공감각인지 기반 근감각신호에서 색.음으로의 변환 시스템," 한국지능시스템학회, 제24권, 제5호, pp.462-469, 2014.
  9. P. B. L. Meijer, "An experimental system for auditory image representations," IEEE trans. on bio-medical engineering, Vol.39, No.2, pp.112-121, 1992. https://doi.org/10.1109/10.121642
  10. http://www.seeingwithsound.com/
  11. 김길호, "영상을 음향으로 변환하는 방법과 장치," 출원번호 10-2007-0023986, 2007.
  12. 김길호, "화성법을 이용한 음색변환표," 출원번호 10-2001-0087651, 2001.
  13. 김길호, 백정기, 사운드컬러하모니즘: 음악이 흐르는 컬러 배색 사전, 임프레스, 2003.
  14. 김성일, "HSI 히스토그램에 기초한 이미지-사운드 변환," 한국음향학회지, 제30권, 제3호, pp.142-148, 2011.
  15. S. I. Kim, "A Basic Study on the Conversion of Sound into Color Image using both Pitch and Energy," International Journal of Fuzzy Logic and Intelligent Systems, Vol.12, No.2, pp.101-107, 2012. https://doi.org/10.5391/IJFIS.2012.12.2.101
  16. http://www.withrobot.com
  17. http://www.st.com/
  18. https://en.wikipedia.org/wiki/Color_model
  19. 타카하시 노부유키, 컴플리트 MIDI 북, SRMUSIC, 2008.
  20. 타카하시 노부유키, 컴플리트 MIDI 프로그래밍북, SRMUSIC, 2008.
  21. https://www.sparkfun.com/tutorials/302
  22. http://www.fon.hum.uva.nl/praat/