말소리와 음성과학 (Phonetics and Speech Sciences)

  • 제4권3호
  • /
  • Pages.25-30
  • /
  • 2012
  • /
  • 2005-8063(pISSN)
  • /
  • 2586-5854(eISSN)
한국음성학회 (Korean Society of Speech Sciences)
권호 표지
DOI QR코드

DOI QR Code

한국어 화자의 영어 양순음 /b/와 순치음 /v/ 식별에서 시각 단서의 효과

The Effect of Visual Cues in the Identification of the English Consonants /b/ and /v/ by Native Korean Speakers

  • 투고 : 2012.07.25
  • 심사 : 2012.09.04
  • 발행 : 2012.09.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

This study investigated whether native Korean listeners could use visual cues for the identification of the English consonants /b/ and /v/. Both auditory and audiovisual tokens of word minimal pairs in which the target phonemes were located in word-initial or word-medial position were used. Participants were instructed to decide which consonant they heard in $2{\times}2$ conditions: cue (audio-only, audiovisual) and location (word-initial, word-medial). Mean identification scores were significantly higher for audiovisual than audio-only condition and for word-initial than word-medial condition. Also, according to signal detection theory, sensitivity, d', and response bias, c were calculated based on both hit rates and false alarm rates. The measures showed that the higher identification rate in the audiovisual condition was related with an increase in sensitivity. There were no significant differences in response bias measures across conditions. This result suggests that native Korean speakers can use visual cues while identifying confusing non-native phonemic contrasts. Visual cues can enhance non-native speech perception.

키워드

참고문헌

  1. Choi, Yang-Gyu (2004). The influences of visual information in place of articulation on speech perception: The McGurk effect in Korean subjects. Journal of Speech & Hearing Disorders, 13, 117-128. (최양규 (2004). 조음위치에 관한 시각정보가 말소리 지각에 미치는 영향: 한국인의 McGurk 효과. 言語治療硏究, 13, 117-128.)
  2. Dennis, S., Lee, M. D. & Kinnell, A. (2008). Bayesian analysis of recognition memory: The case of the list-length effect. Journal of Memory and Language, 59, 361-376. https://doi.org/10.1016/j.jml.2008.06.007
  3. Forster, K. I. & Forster, J. C. (2003). DMDX: A Windows display program with millisecond accuracy. Behavior Research Methods, 35, 116-124. https://doi.org/10.3758/BF03195503
  4. Grant, K. W. & Seitz, P. F. (1998). Measures of auditory-visual integration in nonsense syllables and sentences. The Journal of the Acoustical Society of America, 104, 2438-2450. https://doi.org/10.1121/1.423751
  5. Hardison, D. M. (2003). Acquisition of second-language speech: Effects of visual cues, context, and talker variability. Applied Psycholinguistics, 24, 495-522.
  6. Hazan, V., Sennema, A., Iba, M. & Faulkner, A. (2005). Effect of audiovisual perceptual training on the perception and production of consonants by Japanese learners of English. Speech Communication, 47, 360-378. https://doi.org/10.1016/j.specom.2005.04.007
  7. Hazan, V., Sennema, A., Faulkner, A., Ortega-Llebaria, M., Iba, M. & Chung, H. (2006). The use of visual cues in the perception of non-native consonant contrasts. The Journal of the Acoustical Society of America, 119, 1740-1751. https://doi.org/10.1121/1.2166611
  8. Iverson, P., Kuhl, P. K., Akahane-Yamada, R., Diesch, E., Tohkura, Y., Kettermann, A. & Siebert, C. (2003). A perceptual interference account of acquisition difficulties for non-native phonemes. Cognition, 87, 47-57. https://doi.org/10.1016/S0010-0277(02)00198-1
  9. Kuhl, P. K. & Meltzoff, A. N. (1982). The bimodal perception of speech in infancy. Science, 218, 1138-1141. https://doi.org/10.1126/science.7146899
  10. Lee, M. D. (2008). BayesSDT: Software for Bayesian inference with signal detection theory. Behavior Research Methods, 40, 450-456. https://doi.org/10.3758/BRM.40.2.450
  11. Logan, J., Lively, S. & Pisoni, D. B. (1991). Training Japanese listeners to identify English /r/ and /l/: A first report. The Journal of the Acoustical Society of America, 89, 874-886. https://doi.org/10.1121/1.1894649
  12. Macmillan, N. & Creelman, C. (2005). Detection theory: A user's guide. Mahwah, NJ: Lawrence Erlbaum Assoc. Inc.
  13. McGurk, H. & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748. https://doi.org/10.1038/264746a0
  14. Schmidt, A. M. (1996). Cross-language identification of consonants. Part 1. Korean perception of English. The Journal of the Acoustical Society of America, 99, 3201-3211. https://doi.org/10.1121/1.414804
  15. Sekiyama, K. (1997). Cultural and linguistic factors in audiovisual speech processing: the McGurk effect in Chinese subjects. Perception & Psychophysics, 59, 73-80. https://doi.org/10.3758/BF03206849
  16. Sekiyama, K. & Burnham, D. (2008). Impact of language on development of auditory‐visual speech perception. Developmental Science, 11, 306-320. https://doi.org/10.1111/j.1467-7687.2008.00677.x
  17. Sekiyama, K. & Tohkura, Y. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. The Journal of the Acoustical Society of America, 90, 1797-1805. https://doi.org/10.1121/1.401660
  18. Sumby, W. H. & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. The Journal of the Acoustical Society of America, 26, 212-215. https://doi.org/10.1121/1.1907309