• Journal of Korea Game Society
• /
• v.20 no.5
• /
• pp.13-20
• /
• 2020

Biometric technology with the advance of deep learning enabled the new types of content. Especially, face recognition can provide immersion in terms of convenience and non-compulsiveness, but most commercial content has limitations that are limited to application areas. In this paper, we attempted to overcome these limitations, implement content that can utilize face recognition technology based on realtime video feed. We used Unity engine for high quality graphics, but performance degradation and frame drop occurred. To solve them, we augmented Dlib toolkit and adjusted the resolution image.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.11 no.4
• /
• pp.414-420
• /
• 2018

The digital convergence looking for new ways to engage visitors by superimposing virtual content on projection over the real world captured media contents. This paper propose the Light ID based interactive 3D immersive exhibition things view using HMD AR technology. This approach does not required to add any additional infrastructure to be built-in to enable service and uses the installed Lighting or displays devices in the exhibit area. In this approach, the Light ID can be used as a Location Identifier and communication medium to access the content unlike the QR Tag which supports provide the download information through web interface. This utilize the advantages of camera based optical wireless communication (OWC) to receive the media content on smart device to deliver immersive 3D content visualization using AR. The proposed exhibition method is emulated on GALAXY S8 smart phone and the visual performance is evaluated for Jeonju Hanok Village. The experimental results shows that the proposed method can give immersive 3D view for exhibit things in real-time.

• International Journal of Contents
• /
• v.12 no.2
• /
• pp.31-36
• /
• 2016

The purpose of this research is to realize interactive art based on user's motions information using real time internet search terms. For this purpose, real-time search terms and related news information were extracted from three domestic and foreign portal sites, and the extracted information was used to generate content for interaction with the user. For interaction between the generated content and the user, a motion-based interactive technology that optimizes the intentions and experiences of the user was developed. A motion-based interactive system can be used to develop an immersive interface that induces user interest.

• Journal of information and communication convergence engineering
• /
• v.18 no.2
• /
• pp.69-74
• /
• 2020

Myanmar, also known as Burma, has a rich cultural heritage, and its historical tourist attractions well known around the world. Therefore, we designed and developed an interactive spatial augmented reality (iSAR) book on the cultural heritage of Myanmar. This iSAR book has total of 18 pages with rich media content including videos, animations, audio, and images featuring the cultural heritage of Myanmar in a digital format. In addition to virtual content, navigational features such as virtual buttons and touch-based hand gestures were implemented using Leap Motion and VVVV. Therefore, the developed iSAR book allows virtual content and navigational features to merge seamlessly into a physical book. Five participants were recruited to evaluate the prototype iSAR book, and interviews were conducted to gather their feedback based on its immersive qualities. Thus, the developed iSAR book on Myanmar effectively shares the cultural heritage of Myanmar, and ultimately allows users to explore and gain more insight into the country.

• The Journal of the Korea Contents Association
• /
• v.11 no.5
• /
• pp.194-204
• /
• 2011

Tabletop display can take the benefits of the interactive device due to its possible user friendly input and display facilities simultaneously. Using this device, immersive edutainment content is effectively implemented with the convenient interactive interface. So considering this usefulness, tabletop display can be a very efficient device for constructing the edutainment system. In this paper, we describe a digitalized cooking edutainment contents based on the tabletop display interface. Enjoying our contents, we use the intuitive touch gestures for handling a variety of cooking actions. In the education effects such as the immersive strengthening and co-operation, the proposed system is more efficient interface than any other existing system. We implement the contents with the tabletop display and make sure about the efficiency of our proposed system. In the future, we will add more gestures to enhance the applicability of the intuitive interactive interface.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.1209-1216
• /
• 2022

The majority of construction site incidents occur due to a lack of hazard awareness among workers on job sites. This lack of awareness is despite mandatory construction safety training, typically in the form of written content (safety manuals) or of images depicting hazards. To reduce job-site injuries and fatalities, general contractors have started adopting Virtual Reality (VR) to impart safety training to job site personnel. VR safety training can take the form of an immersive simulation comprising potential safety hazards intentionally embedded into a virtual job site; users are required to identify these hazards within a specified time frame with the expectation that they will be more adept at recognizing hazards on an actual job-site, resulting in fewer accidents. This research study seeks to identify the actual impacts of VR on construction safety awareness among participants. The research addresses the following question: Does VR improve hazard recognition awareness? The primary objective is to evaluate participants' performance of past construction safety awareness against present construction safety awareness after receiving VR training. Participants were asked to complete a multiple-choice Qualtrics™ questionnaire. The results of the study showed a statistically significant knowledge gain advantage with respect to hazard recognition and construction safety awareness with the use of interactive, immersive VR over a more conventional and passive safety training method.

• Journal of Broadcast Engineering
• /
• v.27 no.5
• /
• pp.654-664
• /
• 2022

Immersive content overcomes spatial limitations through convergence with extended reality, artificial intelligence, and photogrammetry technology along with interest due to the COVID-19 pandemic, presenting a new paradigm in the content market such as entertainment, media, performances, and exhibitions. However, it can be seen that in order for realistic content to have sustained public interest, it is necessary to study storytelling method that can increase immersion in content rather than technological freshness. Therefore, in this study, we propose a immersive content storytelling method using artificial intelligence and photogrammetry technology. The proposed storytelling method is to create a content story through interaction between interactive virtual beings and participants. In this way, participation can increase content immersion. This study is expected to help content creators in the accelerating immersive content market with a storytelling methodology through virtual existence that utilizes artificial intelligence technology proposed to content creators to help in efficient content creation. In addition, I think that it will contribute to the establishment of a immersive content production pipeline using artificial intelligence and photogrammetry technology in content production.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2017.04a
• /
• pp.1079-1080
• /
• 2017

Today multimedia technologies are playing an increasingly important role in games, movies, and live performances. In this paper, we design a flexible interactive system integrated with gesture recognition, skeleton tracking, internet communication, and content edition using multi-sensors to direct and control the performance on stage. In this system, the performer can control the elements showed on stage through corresponding gestures and body movements during the performance. The system provides an easier way for users to change the content of the performance if they intent to do.

• ETRI Journal
• /
• v.38 no.6
• /
• pp.1085-1094
• /
• 2016

In this work, we present interactive automultiscopic content with mobile surface haptics for multimodal interaction. Our system consists of a 40-view automultiscopic display and a tablet supporting surface haptics in an immersive room. Animated graphics are projected onto the walls of the room. The 40-view automultiscopic display is placed at the center of the front wall. The haptic tablet is installed at the mobile station to enable the user to interact with the tablet. The 40-view real-time rendering and multiplexing technology is applied by establishing virtual cameras in the convergence layout. Surface haptics rendering is synchronized with three-dimensional (3D) objects on the display for real-time haptic interaction. We conduct an experiment to evaluate user experiences of the proposed system. The results demonstrate that the system's multimodal interaction provides positive user experiences of immersion, control, user interface intuitiveness, and 3D effects.

• Journal of Korea Game Society
• /
• v.13 no.5
• /
• pp.63-72
• /
• 2013

To enhance the effect of science educational contents, we developed a motion based training content: 3D space exploration. In this content, we used the 3D depth camera for user's motion recognition. Learners have to conduct the space station maintenance mission using the motion based natural and intuitive interface. The result this study is expected to propose the immersive training simulation for young science learners.