• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2003.05a
• /
• pp.94-100
• /
• 2003

Patients with schizophrenia have thinking disorders such as delusion or hallucination, because they have a deficit in the ability which to systematize and integrate information. Therefore, they cannot integrate or systemize visual, auditory and tactile stimuli. In this study we suggest a virtual reality system for the assessment of cognitive ability of schizophrenia patients, based on the brain multimodal integration model. The virtual reality system provides multimodal stimuli, such as visual and auditory stimuli, to the patient, and can evaluate the patient's multimodal integration and working memory integration abilities by making the patient interpret and react to multimodal stimuli, which must be remembered for a given period of time. The clinical study showed that the virtual reality program developed is comparable to those of the WCST and the SPM.

• Science of Emotion and Sensibility
• /
• v.6 no.3
• /
• pp.55-62
• /
• 2003

Patients with schizophrenia have thinking disorders such as delusion or hallucination, because they have a deficit in the ability which to systematize and integrate information. therefore, they cannot integrate or systematize visual, auditory and tactile stimuli. In this study, we suggest a virtual reality system for the assessment of cognitive ability of schizophrenia patients, based on the brain multimodal integration model. The virtual reality system provides multimodal stimuli, such as visual and auditory stimuli, to the patient, and can evaluate the patient's multimodal integration and working memory integration abilities by making the patient interpret and react to multimodal stimuli, which must be remembered for a given period of time. the clinical study showed that the virtual reality program developed is comparable to those of the WCST and the SPM.

• Science of Emotion and Sensibility
• /
• v.4 no.1
• /
• pp.43-51
• /
• 2001

When consumer evaluates a product, every aspec of the product affects the evaluation. Human uses at least five sensory organs for the evaluation. Multi-sensory or multi-modal design tries to add auditory and olfactory factors to the traditional visual-centered design. For the multi-modal design, it is essential to understand relationships between combined sensory stimuli and human sensibility. Information between simple sensory stimulus and human sensibility is pre-requisite to combine multi-modal stimuli. This study investigated human sensibility against 8 colors and 30 sounds, presented independently. The combined stimuli of color and sound were made based on the sensibility generated by each stimulus. Human sensibility generated by the combined stimuli of color and sound were made based on the sensibility generated by each stimulus. Human sensibility generated by the combined stimuli was investigated with 20 female subjects. For combined stimuli that generated the same kind of sensibility respectively, generated sensibility was same but strength was diminished. For combined stimuli that generated the different sensibilities respectively, subjects showed neutral sensibility or no special sensibilities. Sensibilities to the same stimuli also showed difference depending on personal background of the subjects.

• Science of Emotion and Sensibility
• /
• v.24 no.3
• /
• pp.41-60
• /
• 2021

The purpose of this research was to determine whether multimodal cues in an online shopping environment could enhance tactile consumer mental imagery, purchase intentions, and attitudes towards an apparel product. One limitation of online retail is that consumers are unable to physically touch the items. However, as tactile information plays an important role in consumer decisions especially for apparel products, this study investigated the effects of multimodal cues on overcoming the lack of tactile stimuli. In experiment 1, to explore the product, the participants were randomly assigned to four conditions; picture only, video without sound, video with corresponding sound, and video with discordant sound; after which tactile mental imagery vividness, ease of imagination, attitude, and purchase intentions were measured. It was found that the video with discordant sound had the lowest average scores of all dependent variables. A within-participants design was used in experiment 2, in which all participants explored the same product in the four conditions in a random order. They were told that they were visiting four different brands on a price comparison web site. After the same variables as in experiment 1, including the need for touch, were measured, the repeated measures ANCOVA results revealed that compared to the other conditions, the video with the corresponding sound significantly enhanced tactile mental imagery vividness, attitude, and purchase intentions. However, the discordant condition had significantly lower attitudes and purchase intentions. The dual mediation analysis also revealed that the multimodal cue conditions significantly predicted attitudes and purchase intentions by sequentially mediating the imagery vividness and ease of imagination. In sum, vivid tactile mental imagery triggered using audio-visual stimuli could have a positive effect on consumer decision making by making it easier to imagine a situation where consumers could touch and use the product.

• Journal of Adhesion and Interface
• /
• v.21 no.4
• /
• pp.162-167
• /
• 2020

The skin-inspired multimodal soft sensors have been developed through multidisciplinary approaches to mimic the sensing ability with high sensitivity and mechanical durability of human skin. For practical application, although the stimulus discriminability against a complex stimulus composed of various mechanical and thermal stimuli experienced in daily life is essential, it still shows a low level actually. In this paper, we first introduce the operating mechanisms and representative studies of the unimodal soft sensor, and then discuss the recent research trend in the multimodal soft sensors and the stimulus discriminability.

• Journal of the Korean Institute of Electrical and Electronic Material Engineers
• /
• v.34 no.6
• /
• pp.401-415
• /
• 2021

Soft robots are promising devices for applications in drug delivery, sensing, and manufacturing. Traditional hard robotics are manufactured with rigid materials and their degrees of motion are constrained by the orientation of the joints. In contrast to rigid counterpart, soft robotics, employing soft and stretchable materials that easily deforms in shape, can realize complex motions (i.e., locomotion, swimming, and grappling) with a simple structure, and easily adapt to dynamic environment. Among them, the magnetic actuators exhibit unique characteristics such as rapid and accurate motion control, biocompatibility, and facile remote controllability, which make them promising candidates for the next-generation soft robots. Especially, the magnetic actuators instantly response to the stimuli, and show no-hysteresis during the recovery process, essential for continuous motion control. Here, we present the state-of-the-art fabrication process of magnetically controllable nano-/micro-composites, magnetically aligning process of the composites, and 1-dimensional/multi-dimensional multimodal motion control for the nextgeneration soft actuators.

• Journal of Powder Materials
• /
• v.28 no.6
• /
• pp.509-517
• /
• 2021

Smart materials capable of changing their characteristics in response to stimuli such as light, heat, pH, and electric and magnetic fields are promising for application to flexible electronics, soft robotics, and biomedicine. Compared with conventional rigid materials, these materials are typically composed of soft materials that improve the biocompatibility and allow for large and dynamic deformations in response to external environmental stimuli. Among them, smart magnetic materials are attracting immense attention owing to their fast response, remote actuation, and wide penetration range under various conditions. In this review, we report the material design and fabrication of smart magnetic materials. Furthermore, we focus on recent advances in their typical applications, namely, soft magnetic actuators, sensors for self-assembly, object manipulation, shape transformation, multimodal robot actuation, and tactile sensing.

• Science of Emotion and Sensibility
• /
• v.13 no.3
• /
• pp.475-484
• /
• 2010

This study examined the influence of the SOA(stimulus onset asynchrony) between visual and auditory stimuli on the integration phenomenon of audio-visual senses. Within the stimulus integration phenomenon, the redundant target effect (the faster and more accurate response to the target stimulus when the target stimulus is presented with more than two modalities) and the visual dominance effect (the faster and more accurate response to a visual stimulus compared to an auditory stimulus) were examined as we composed a visual and auditory unimodal target condition and a multimodal target condition and then observed the response time and accuracy. Consequently, despite the change between visual and auditory stimuli SOA, there was no redundant target effect present. The auditory dominance effect appeared when the SOA between the two stimuli was over 100ms. Theses results imply that the redundant target effect is continuously maintained even when the SOA between two modal stimuli is altered, and also suggests that the behavioral results of superior information processing can only be deducted when the time difference between the onset of the auditory stimuli and the visual stimuli is approximately over 100ms.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.3
• /
• pp.316-322
• /
• 2014

A movie recommendation system is proposed to learn a preference model of a viewer by using multimodal features of a video content and their evoked implicit responses of the viewer in synchronized manner. In this system, facial expression, body posture, and physiological signals are measured to estimate the affective states of the viewer, in accordance with the stimuli consisting of low-level and affective features from video, audio, and text streams. Experimental results show that it is possible to predict arousal response, which is measured by electrodermal activity, of a viewer from auditory and text features in a video stimuli, for estimating interestingness on the video.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.6
• /
• pp.715-723
• /
• 2012

Objective: The aim of this study is to investigate haptic perception related researches into three perspectives: cutaneous & proprioceptive sensations, active & passive touch, and cognition & emotion, then to identify issues for implementing haptic interactions. Background: Although haptic technologies had improved and become practical, more research on the method of application is still needed to actualize the multimodal interaction technology. Systematical approached to explore haptic perception is required to understand emotional experience and social message, as well as tactile feedback. Method: Content analysis were conducted to analyze trend in haptic related research. Changes in issues and topics were investigated using sensational dimensions and the different contents delivered via tactile perception. Result: The found research opportunities were haptic perception in various body segments and emotion related proprioceptive sensation. Conclusion: Once the mechanism of how users perceives haptic stimuli would help to develop effective haptic interactrion and this study provide insights of what to focus for the future of haptic interaction. Application: This research is expected to provide presence, and emotional response applied by haptic perception to fields such as human-robot, human-device, and telecommunication interaction.