• International Journal of Advanced Culture Technology
• /
• v.7 no.2
• /
• pp.195-200
• /
• 2019

Media art, which is a combination of media technology and art, is making a lot of progress in combination with AI, IoT and VR. This paper aims to meet people's needs by creating a video that simulates the dance moves of an object that users admire by using media art that features interactive interactions between users and works. The project proposed a universal image synthesis system that minimizes equipment constraints by utilizing a deep running-based Skeleton estimation system and one of the deep-running neural network structures, rather than a Kinect-based Skeleton image. The results of the experiment showed that the images implemented through the deep learning system were successful in generating the same results as the user did when they actually danced through inference and synthesis of motion that they did not actually behave.

• The Journal of Korea Robotics Society
• /
• v.14 no.2
• /
• pp.150-156
• /
• 2019

Haptic systems have been widely used for both virtual reality and augmented reality application including game, entertainment, education and medical sectors. Clothing designers and retailers initiated using AR and VR technologies to help the consumers find style with the perfect fit. Most of the developed augmented reality shopping is implemented by overlapping the image of the clothes on the customer so that he/she can find the fit. However, those are only visual information and the customer cannot experience the real size and the stiffness of the clothes. In this paper, we present the haptic upper garment which provides the haptic feedback to the user using cables. By controlling the length of the cable, the size of the clothes is set and by stiffness control, the compliance of the fabric is implemented. The haptic garment is modeled for precise control and the distributed controller architecture is described. With the haptic upper garment, the user's experience of the virtual clothes is greatly enhanced.

• Journal of the Semiconductor & Display Technology
• /
• v.18 no.1
• /
• pp.123-128
• /
• 2019

Currently mobile services are on the verge of full commercialization ahead of 5G mobile communication (5G). The first goal could be to preempt the 5G market through realistic media services utilizing VR (Virtual Reality) and AR (Augmented Reality) technologies that users can most easily experience. Basically this movement is based on the advanced development of smart devices and high quality graphics processing computing power of mobile application processors. Accordingly, the importance of mobile GPUs is emerging and the most concern issue becomes a model for predicting the power and performance for smooth operation of high quality mobile contents. In many cases, the performance of mobile GPUs has been introduced in terms of power consumption of mobile GPUs using dynamic voltage and frequency scaling and throttling functions for power consumption and heat management. This paper introduces several studies of mobile GPU performance prediction model with user-friendly methods not like conventional power centric performance prediction models.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.5
• /
• pp.11-17
• /
• 2019

In this study, we propose an ensemble engine, which is a framework for game engine optimized for visual novels genre, focusing on storytelling among various game genres. The game of Visual Nobel genre is based on multi-ending story and features branching of various scenarios according to user's choice. The proposed engine supports various multi-scenarios and multi-endings based on nodes according to the characteristics of these genres. In addition, it provides a convenient and intuitive user interface that not only enhances user immersion but also provides VR function to maximize the sense of presence. We will demonstrate the usefulness of the proposed game engine by designing the framework of a game engine suitable for this feature and actually creating variety stories automatically.

• Electronics and Telecommunications Trends
• /
• v.34 no.3
• /
• pp.23-33
• /
• 2019

Broadcast is evolving into media service aimed at user customization, personalization, and participation with high-quality broadcasting contents (4K/8K/AR/VR). A broadcast infrastructure is needed to engage with the competition for providing large-scaled media traffic process, platform performance for adaptive transcoding to diverse receivers, and intelligent service. Cloud service and virtualization in broadcast are becoming more valuable as the broadcasting environment changes and new high-level broadcasting services emerge. This document describes the examples of cloud and virtualization in the broadcast industry, and prospects the network virtualization of broadcast transmission infrastructure, especially terrestrial and cable networks.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.11a
• /
• pp.141-142
• /
• 2018

360 비디오는 VR 미디어의 확산과 함께 몰입형 미디어로 주목 받고 있으며, JVET(Joint Video Experts Team)에서는 post-HEVC 로 진행중인 VVC(Versatile Video Coding) 표준화에 360 비디오 부호화도 함께 포함하고 있다. 현재 JVET 에서는 360 비디오를 부호화 하기 위한 다양한 구(sphere) 영상의 2D 투영기법이 고려되고 있다. 이러한 2D 투영에서는 구 영상의 화소 샘플이 2D 영상에 비 균일하게 매핑되는 변환 왜곡이 발생하며, 이는 360 비디오의 부호화 효율을 저하시키는 원인이 된다. 본 논문에서는 CMP 의 개선된 투영기법인 기존의 EAC(Equi-Angular Cubemap)와 HEC(Hybrid Equiangular Cubemap)를 소개하고, 이를 바탕으로 HEC 의 확장 변환 기법을 제시하여 객관적/주관적 부호화 성능을 확인한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.11a
• /
• pp.143-144
• /
• 2018

360 비디오는 VR 응용의 확산과 함께 몰입형 미디어로 주목 받고 있으며, JVET(Joint Video Experts Team)에서 post-HEVC 로 진행중인 VVC(Versatile Video Coding)에 360 비디오 부호화도 함께 고려하고 있다. 360 비디오 부호화를 위하여 변환된 2D 영상은 투영 면(face) 간의 불연속성과 비활성 영역이 존재할 수 있으며 이는 부호화 효율을 저하시키는 원인이 된다. 본 논문에서는 SSP(Segmented Projection)에서의 이러한 불연속성과 비활성 영역을 줄이는 효율적인 기하학적 패딩(padding) 기법을 제시한다. 실험결과 제안 기법은 복사에 의한 패딩을 사용하는 기존 SSP 대비 주관적 화질이 향상된 것을 확인 할 수 있었다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.06a
• /
• pp.15-17
• /
• 2018

본 논문에서는 시장규모가 점진적으로 커지고 있는 VR의 콘텐츠 제작에 있어서 전방위 영상 생성을 위해 촬영한 영상들을 스티칭하는 데 소요되는 연산량을 감소시키는 방법을 제안한다. 제안하는 방법은 널리 사용되는 SIFT의 알고리즘에서 가장 많은 연산을 차지하는 가우시안 피라미드 생성 부분을 파라미터를 조절하여 감소시키고, 이를 통해 얻은 점들을 스티칭하는데 사용하여 영상을 합성하는 방법이다. 영상에 대한 평가는 변환에 의한 점들의 평균오차를 계산하여 유효성을 판단한다.

• Journal of Korea Multimedia Society
• /
• v.24 no.4
• /
• pp.538-549
• /
• 2021

In this paper, we introduce a technique for 360-degree panoramic video streaming with multiple virtual cameras in real-time. The proposed technique consists of generating 360-degree panoramic video data by ORB feature point detection, texture transformation, panoramic video data compression, and RTSP-based video streaming transmission. Especially, the generating process of 360-degree panoramic video data and texture transformation are accelerated by CUDA for complex processing such as camera calibration, stitching, blending, encoding. Our experiment evaluated the frames per second (fps) of the transmitted 360-degree panoramic video. Experimental results verified that our technique takes at least 30fps at 4K output resolution, which indicates that it can both generates and transmits 360-degree panoramic video data in real time.

• International Journal of Advanced Culture Technology
• /
• v.8 no.4
• /
• pp.1-7
• /
• 2020

Recently, new media such as YouTube and AR/VR have emerged, and media content has become more complex and diversified. To respond to the new media environment, the Korean government wanted to increase people's access to media and to enhance their ability to utilize it through the establishment of viewer-media center. In this paper, based on the score of media literacy, education programs of the viewer-media center were verified to provide their effectiveness. This paper also suggests and comments on the programs that the viewer-media center should focus on by comparing and analyzing the efficacy among educational programs.