DOI QR코드

DOI QR Code

E-book to sign-language translation program based on morpheme analysis

형태소 분석 기반 전자책 수화 번역 프로그램

  • Han, Sol-Ee (Department of Computer Engineering, Hanbat National University) ;
  • Kim, Se-A (Department of Computer Engineering, Hanbat National University) ;
  • Hwang, Gyung-Ho (Department of Computer Engineering, Hanbat National University)
  • Received : 2016.11.17
  • Accepted : 2016.11.28
  • Published : 2017.02.28

Abstract

As the number of smart devices increases, e-book contents and services are proliferating. However, the text based e-book is difficult for a hearing-impairment person to understand. In this paper, we developed an android based application in which we can choose an e-book text file and each sentence is translated to sign-language elements which are shown in videos that are retrieved from the sign-language contents server. We used the korean sentence to sign-language translation algorithm based on the morpheme analysis. The proposed translation algorithm consists of 3 stages. Firstly, some elements in a sentence are removed for typical sign-language usages. Secondly, the tense of the sentence and the expression alteration are applied. Finally, the honorific forms are considered and word positions in the sentence are revised. We also proposed a new method to evaluate the performance of the translation algorithm and demonstrated the superiority of the algorithm through the translation results of 100 reference sentences.

인터넷의 발전과 스마트 디바이스의 확산으로 e-book에 대한 수요가 늘고 있다. 그러나 청각 손실로 정확한 언어를 배우기 어려운 청각장애인은 텍스트로만 이루어진 e-book 서비스를 사용하기 어렵다. 본 논문에서는 e-book의 문장을 읽어 수화 동영상으로 제공하는 안드로이드 기반 애플리케이션 프로그램을 설계하고 구현하였다. e-book의 한국어 문장을 수화 언어로 번역하기 위해 형태소 분석에 기반한 알고리즘을 사용하였다. 제안한 알고리즘은 3단계로 구성된다. 1단계는 수화 표현을 위한 문장 요소 제거, 2단계는 수화 표현의 변환 및 시제 표현, 3단계는 수화 높임말 용어 변경 및 위치 이동이다. 또한 수화 번역 품질에 대한 평가 방안을 제시하고 100개의 기준 문장에 대해 제안한 알고리즘을 통한 번역 결과의 우수성을 확인하였다.

Keywords

References

  1. H. S. Paeng. J. H. Lee and J. Y. Cho, "Research for Sign Language Translation Application Development Base on Smartphone Environment," in Proceedings of HCI Korea, pp. 62-65, Jan. 2012.
  2. S. H. Kim. E. Y. Chang and J. C. Park, "Translating a Complex Sentence in Korean into a Sign Language Script for an Automatic Sign Language Generation," in Proceeding of the 19th Annual Conference on Human and Cognitive Language Technology, pp. 15-22, Oct. 2007.
  3. J. W. Choi and J. Chul Park, "Analysis and Computational Processing of Sentences in Korean for Automatic Sign Language Generation," in Proceeding of the 15th Annual Conference on Human and Cognitive Language Technology, pp. 219-226, Oct. 2003.
  4. H. Y. Jung. E. J. Min. S. J. Ahn. Y. J. Oh and J. H. Lee, "Sense-Tagged Dictionary based Machine Translation from Korean to Korean Sign Language," in Proceeding of Korea Computer Congress, pp. 583-585, June 2014.
  5. J. Y. Kim, J. W. Chung and J. C. Park, "Analyzing and Mapping Expressions of Tense for Korean-Korean Sing Language Translation," in Proceeding of the 39th KIISE Fall Conference, pp. 121-123, Nov. 2012.
  6. Shineware. Komoran 2.0 software [Internet]. Available: http://www.shineware.co.kr.
  7. Korean standard sing-language specification committee, Korean sign language, 2nd ed. National Institute of Korean Language, 2010.
  8. National Institute of Korean Language. Korean Sign Language Dictionary [Internet]. Available: http://sldict.korean.go.kr.