시청각 자극의 시간적 인지 판단

Temporal-perceptual Judgement of Visuo-Auditory Stimulation

  • 유미 (전북대학교 의용생체공학과) ;
  • 이상민 (인하대학교 전자전기공학부) ;
  • 박용군 (전북대학교 의용생체공학과) ;
  • 권대규 (전북대학교 생체공학부) ;
  • 김남균 (전북대학교 생체정보공학부)
  • 발행 : 2007.01.01

초록

In situations of spatio-temporal perception about visuo-auditory stimulus, researches propose optimal integration hypothesis that perceptual process is optimized to the interaction of the senses for the precision of perception. So, when the visual information considered generally dominant over any other sense is ambiguous, the information of the other sense like auditory stimulus influences the perceptual process in interaction with visual information. Thus, we performed two different experiments to certain the conditions of the interacting senses and influence of the condition. We consider the interaction of the visuo-auditory stimulation in the free space, the color of visual stimulus and sex difference of testee with normal people. In first experiment, 12 participants were asked to judge the change in the frequency of audio-visual stimulation using a visual flicker and auditory flutter stimulation in the free space. When auditory temporal cues were presented, the change in the frequency of the visual stimulation was associated with a perceived change in the frequency of the auditory stimulation as the results of the previous studies using headphone. In second experiment, 30 male and 30 female were asked to judge the change in the frequency of audio-visual stimulation using a color of visual flicker and auditory flutter stimulation. In the color condition using red and green. Both male and female testees showed same perceptual tendency. male and female testees showed same perceptual tendency however, in case of female, the standard deviation is larger than that of male. This results implies that audio-visual asymmetry effects are influenced by the cues of visual and auditory information, such as the orientation between auditory and visual stimulus, the color of visual stimulus.

키워드

참고문헌

  1. Shimojo, S. and Shams, L., 'Sensory modalities are not separate modalities: plasticity and interactions,' Curr. Opin. Neurobiol., Vol. 11, pp. 505-509, 2001 https://doi.org/10.1016/S0959-4388(00)00241-5
  2. Bertelson, P. and Radeau, M., 'Cross-modal bias and perceptual fusion with auditory visual spatial discordance,' Percept. Psychophys, Vol. 29, pp. 578-584, 1981 https://doi.org/10.3758/BF03207374
  3. Kitagawa, N. and Ichihara, S., 'Hearing visual motion in depth,' Nature, Vol. 416, pp. 172-174, 2002 https://doi.org/10.1038/416172a
  4. Welch, R. B., DuttonHurt, L. D. and Warren, D. H., 'Contributions of audition and vision to temporal rate perception,' Percept. Psychophys, Vol. 39, pp. 294-300, 1986 https://doi.org/10.3758/BF03204939
  5. Shams, L., Kamitani, Y. and Shimojo, S., 'What you see is what you hear,' Nature, Vol. 408, pp. 788, 2000 https://doi.org/10.1038/35048669
  6. Welch, R. B. and Warren, D. H., 'Intersensory interactions. Inlntersensory interactions,' Handbook of Perception and Human Performance, Wiley, New York, Vol. 1, pp. 25.1-25.36, 1986
  7. Van Beers, R. J., Wolpert, D. M. and Haggard, P., 'When feeling is more important than seeing in sensorimotor adaptation,' Curr. Biol., Vol. 12, pp. 834-837, 2002 https://doi.org/10.1016/S0960-9822(02)00836-9
  8. Jacobs, R. A., 'Optimal integration of texture and motion cue in depth,' Vision Res., Vol. 39, pp. 3621-3629, 1999 https://doi.org/10.1016/S0042-6989(99)00088-7
  9. Meyer, G. F. and Wuerger, S. M., 'Cross-modal integration of auditory and visual motion signals,' Neuro Rep., Vol. 12, pp. 2557-2560, 2001
  10. Wada, Y., Kitagawa, N. and Noguchi, K., 'Audio-visual integration in temporal perception,' Journal of psychophysiology, Vol. 50, pp. 117-124, 2003 https://doi.org/10.1016/S0167-8760(03)00128-4
  11. Taylor, R. M., 'Color coding in information displays: Heuristics, experinece and evidence from cartography,' Farnborough, England: Royal Aircraft Establishment; pp. 28, 35.1-35.46, 1984
  12. Luria, A. R., 'The working brain,' Basic Books, 1973
  13. Lahtela, K., Niemi, P. and Kuusela, V., 'Adult visual choice-reaction time, age, sex, and preparedness,' Scandinavian Journal of Psychology, Vol. 26, pp. 357-362, 1985 https://doi.org/10.1111/j.1467-9450.1985.tb01175.x
  14. Voyer, D., Voyer, S. and Bryden, M. P., 'Magnitute of sex differences in spatial abilities: A meta-analysis and consideration of critical variables,' Psychological Bulletin, Vol. 117, pp. 250-270, 1995 https://doi.org/10.1037/0033-2909.117.2.250
  15. Shams, L., Kamitani, Y. and Shimojo, S., 'Visual illusion induced by sound,' Cognitive Brain Research, Vol. 14, pp. 147-152, 2002 https://doi.org/10.1016/S0926-6410(02)00069-1
  16. Freancesca, F., Nadia, B. and Elisabetta, L., 'Enhancement of visual perception by cross modal visuo-auditory integration,' Exp Brain Res., Vol. 147, pp. 332-343, 2002 https://doi.org/10.1007/s00221-002-1262-y
  17. Chung, S. C., Sohn, J. H., Oh, C. H., Taeck, G. R., Yi, J. H. and Lee, S. Y., 'Correlation between cognitive performance ability, neural activation area and neural activation intensity in fMRI,' Journal of the Korean Society of Precision Engineering, Vol. 22, No.7, pp. 200-207, 2005