• The Journal of the Acoustical Society of Korea
• /
• v.15 no.6
• /
• pp.90-98
• /
• 1996

In this paper we have proposed the sign language transformation system for deaf based on a morpheme analysis. The proposed system extracts phoneme components and connection informations of the input character sequence by using a morpheme analysis. And then the sign image obtained by component analysis is correctly and automatically generated through the sign image database. For the effective sign language transformation, the language description dictionary which consists of a morpheme analysis part for analysis of input character sequence and sign language description part for reference of sign language pattern is costructed. To avoid the duplicating sign language pattern, the pattern is classified a basic, a compound and a similar sign word. The computer simulation shows the usefulness of the proposed system.

• Journal of the Ergonomics Society of Korea
• /
• v.34 no.5
• /
• pp.411-426
• /
• 2015

Objective: The goal of this thesis is to design the interaction structure and framework of system to recognize sign language. Background: The sign language of meaningful individual gestures is combined to construct a sentence, so it is difficult to interpret and recognize the meaning of hand gesture for system, because of the sequence of continuous gestures. This being so, in order to interpret the meaning of individual gesture correctly, the interaction structure and framework are needed so that they can segment the indication of individual gesture. Method: We analyze 700 sign language words to structuralize the sign language gesture interaction. First of all, we analyze the transformational patterns of the hand gesture. Second, we analyze the movement of the transformational patterns of the hand gesture. Third, we analyze the type of other gestures except hands. Based on this, we design a framework for sign language interaction. Results: We elicited 8 patterns of hand gesture on the basis of the fact on whether the gesture has a change from starting point to ending point. And then, we analyzed the hand movement based on 3 elements: patterns of movement, direction, and whether hand movement is repeating or not. Moreover, we defined 11 movements of other gestures except hands and classified 8 types of interaction. The framework for sign language interaction, which was designed based on this mentioned above, applies to more than 700 individual gestures of the sign language, and can be classified as an individual gesture in spite of situation which has continuous gestures. Conclusion: This study has structuralized in 3 aspects defined to analyze the transformational patterns of the starting point and the ending point of hand shape, hand movement, and other gestures except hands for sign language interaction. Based on this, we designed the framework that can recognize the individual gestures and interpret the meaning more accurately, when meaningful individual gesture is input sequence of continuous gestures. Application: When we develop the system of sign language recognition, we can apply interaction framework to it. Structuralized gesture can be used for using database of sign language, inventing an automatic recognition system, and studying on the action gestures in other areas.

• Journal of rehabilitation welfare engineering & assistive technology
• /
• v.10 no.4
• /
• pp.329-336
• /
• 2016

Deaf people using sign language are experiencing social inequalities and financial losses due to communication restrictions. In this paper, real-time pattern recognition algorithm was applied to distinguish American Sign Language using an armband sensor(8-channel EMG sensors and one IMU) to enable communication between the deaf and the hearing people. The validation test was carried out with 11 people. Learning pattern classifier was established by gradually increasing the number of training database. Results showed that the recognition accuracy was over 97% with 20 training samples and over 99% with 30 training samples. The present study shows that sign language recognition using armband sensor is more convenient and well-performed.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.22 no.3
• /
• pp.319-327
• /
• 2012

In this paper, we present a sign language recognition model which does not use any wearable devices for object tracking. The system design issues and implementation issues such as data representation, feature extraction and pattern classification methods are discussed. The proposed data representation method for sign language patterns is robust for spatio-temporal variances of feature points. We present a feature extraction technique which can improve the computation speed by reducing the amount of feature data. A neural network model which is capable of incremental learning is described and the behaviors and learning algorithm of the model are introduced. We have defined a measure which reflects the relevance between the feature values and the pattern classes. The measure makes it possible to select more effective features without any degradation of performance. Through the experiments using six types of sign language patterns, the proposed model is evaluated empirically.

• Journal of the Korean Institute of Telematics and Electronics C
• /
• v.34C no.2
• /
• pp.61-70
• /
• 1997

Human-hand gestures have been used a means of communication among people for a long time, being interpreted as streams of tokens for a language. The signed language is a method of communication for hearing impaired person. Articulated gestures and postures of hands and fingers are commonly used for the signed language. This paper presents a system which recognizes the korean sign language (KSL) and translates the recognition results into a normal korean text and sound. A pair of data-gloves are used a sthe sensing device for detecting motions of hands and fingers. In this paper, we propose a dynamic gesture recognition mehtod by employing a fuzzy feature analysis method for efficient classification of hand motions, and applying a fuzzy min-max neural network to on-line pattern recognition.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1995.10b
• /
• pp.85-91
• /
• 1995

This paper presents a system which recognizes the Korean Sign Language(KSL) and translates into normal Korean speech. A sign language is a method of communication for the deaf-mute who uses gestures, especially both hands and fingers. Since the human hands and fingers are not the same in physical dimension, the same form of a gesture produced by two signers with their hands may not produce the same numerical values when obtained through electronic sensors. In this paper, we propose a dynamic gesture recognition method based on feature analysis for efficient classification of hand motions, and on a fuzzy min-max neural network for on-line pattern recognition.

• Proceedings of the Korean Institute of Interior Design Conference
• /
• 2007.05a
• /
• pp.176-180
• /
• 2007

The stage space in theatre for the performance of a play requires two aspects of the physical space for a play and the image as the background or the theme of a play. This research focuses on the scene design that creates the background or the theme of a play and communicates it to the audience. The scene design is composed of various design elements of space and objects as the properties of a play. Design elements and the objects are the design languages in various form; plane, three-dimensional, multi-dimensional form. These design language have the significant meaning as a sign like human language. The scene design is completed with rhetorical expression for communication in theatre. This research defines the category of meaning that design elements of scene design can create and the rhetorical expression of the scene design language. King Lear directed by Robert G. Anderson was analyzed with the category of design elements as a sign and the pattern of the rhetorical expression. The scene design for a play is completed effectively by the rhetorical expression of design elements as the design language for communication with the audience in theatre.

• Journal of English Language & Literature
• /
• v.57 no.4
• /
• pp.675-693
• /
• 2011

In its restricted sense, 'sound poetry' refers to the poetic performance that rejects words and verbal meaning and instead foregrounds the aural materiality of poetry. Behind this seeking for materiality lies a quest for a 'language of presence,' which operates through a denial of signification toward an ideal of the Adamic tongue, a purely emotional and universal language. In the same light, it is argued that sound poetry is a unique and unrepeatable event devoid of meaning due to its directness to the body allowing no intervention of intellectual and semiotic process. But language may involve perceptual meaning as well as verbal or conceptual meaning ascribed to words. This implies that even though devoid of conceptual meaning by means of using grammatically non-articulated sounds, sound poetry cannot but have meaning whose articulation is differently, i.e., iconically made about the aural features of the sounds. Perceptual meaning is unavoidable because everything we are conscious of is a reduced form, a repeatable pattern that works as a sign. 'Language of presence' is then actually impossible, and therefore sound poetry should be seen rather as a fest of diverse perceptual meanings.

• The Research Journal of the Costume Culture
• /
• v.4 no.3
• /
• pp.395-406
• /
• 1996

This article aims, by analyzing structurally the codification of dress sign in Korean society, the signifying system of the codes and their message communicated, to make clear a signifying structure that would be codified through the relationship between abstract concepts and real condition of dress. I used the semiotic theory of Ferdinand de Saussure′s conception on structuralismly the codification, cultural semiology of Roland Barthes and Myung-Sook Han′s formula of dress structure as tools analyse may objective of wedding dress of folks in Choson Dynasty, which has been successive our traditional Korean wedding dress. My results of the study are : The procedure of wedding ceremony in Choson Dynasty was presented in texts like Juga-garye, Sarye-peonram and Kukjo-orye, its dress system has been more emphasized on language, and aspect of social system, than parole, one of individual realization. In addition, the meanings of marrage such as "Oneness of bride and bridegroom", "Mixture of two sexes", "Blessing of good luck", were included in the signified like the style, pattern and color of the wedding dress, and specially, pattern and color, the articulated morphemes, was emphasized, When we combinated terms of dress in Choson Dynasty with syntagmatic, regarding their list as paradigmatic, it will signify a wedding dress, and according to combinating ways, it amy be divided as sign of dresses of bride and bridgeroom by sex or king, gentry and common people by class. Wedding Dress in Choson Dynasty = [{ODx(U/Dxu/d)}+AC·H·FW].

• Korean Institute of Interior Design Journal
• /
• v.16 no.3 s.62
• /
• pp.21-29
• /
• 2007

The communication in a play has a dual structure, which is composed of the communications within a play and in a theatre space. This research focuses on the scene design that creates the background or the theme of a play and communicates theme of a play to the audience. A scene design of a theatre has meta-linguistic aspects, which is the image or mood as the theme of a play. The scene design is composed of various design elements of space and objects as the properties of a play. Design elements and the objects are the design languages in various form; plane, three-dimensional, multi-dimensional form. These design languages have the significant meanings as signs like human language. The play works chooses the rhetorical expression to arouse the audience's sympathy. The scene design is completed with rhetorical expression for communication in theatre too. This research defines the category of meanings that design elements of scene design can create and the rhetorical expression of the scene design language. King Lear directed by Robert G. Anderson was analyzed with the category of design elements as a sign and the pattern of the rhetorical expression. The scene design for a play is completed effectively by the rhetorical expression of design elements as the design language for the communication with the audience in theatre.