• Journal of the Institute of Convergence Signal Processing
• /
• v.5 no.2
• /
• pp.96-105
• /
• 2004

The recovering 3D image from 2D requires the depth information for each picture element. The manual creation of those 3D models is time consuming and expensive. The goal in this paper is to estimate the relative depth information of every region from single view image with camera translation. The paper is based on the fact that the motion of every point within image which taken from camera translation depends on the depth. Motion vector using full-search motion estimation is compensated for camera rotation and zooming. We have developed a framework that estimates the average frame depth by analyzing motion vector and then calculates relative depth of region to average frame depth. Simulation results show that the depth of region belongs to a near or far object is consistent accord with relative depth that man recognizes.

• Journal of Broadcast Engineering
• /
• v.22 no.4
• /
• pp.429-437
• /
• 2017

2D-to-3D conversion technology has been studied over past decades and integrated to commercial 3D displays and 3DTVs. Generally, depth cues extracted from a static image is used for generating a depth map followed by DIBR (Depth Image Based Rendering) for producing a stereoscopic image. Further, motion is also an important cue for depth estimation and is estimated by block-based motion estimation, optical flow and so forth. This papers proposes a new method for motion depth generation using Motion History Image (MHI) and evaluates the feasiblity of the MHI utilization. In the experiments, the proposed method was performed on eight video clips with a variety of motion classes. From a qualitative test on motion depth maps as well as the comparison of the processing time, we validated the feasibility of the proposed method.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.1
• /
• pp.242-259
• /
• 2015

Three-dimensional video coding is one of the main challenges restricting the widespread applications of 3D video and free viewpoint video. In this paper, a novel fractal coding algorithm with motion-vector-field-based motion estimation for depth map sequence is proposed. We firstly add pre-search restriction to rule the improper domain blocks out of the matching search process so that the number of blocks involved in the search process can be restricted to a smaller size. Some improvements for motion estimation including initial search point prediction, threshold transition condition and early termination condition are made based on the feature of fractal coding. The motion-vector-field-based adaptive hexagon search algorithm on the basis of center-biased distribution characteristics of depth motion vector is proposed to accelerate the search. Experimental results show that the proposed algorithm can reach optimum levels of quality and save the coding time. The PSNR of synthesized view is increased by 0.56 dB with 36.97% bit rate decrease on average compared with H.264 Full Search. And the depth encoding time is saved by up to 66.47%. Moreover, the proposed fractal depth map sequence codec outperforms the recent alternative codecs by improving the H.264/AVC, especially in much bitrate saving and encoding time reduction.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.383-388
• /
• 2005

Depth recovery in robot vision is an essential problem to infer the three dimensional geometry of scenes from a sequence of the two dimensional images. In the past, many studies have been proposed for the depth estimation such as stereopsis, motion parallax and blurring phenomena. Among cues for depth estimation, depth from lens translation is based on shape from motion by using feature points. This approach is derived from the correspondence of feature points detected in images and performs the depth estimation that uses information on the motion of feature points. The approaches using motion vectors suffer from the occlusion or missing part problem, and the image blur is ignored in the feature point detection. This paper presents a novel approach to the defocus technique based depth from lens translation using sequential SVD factorization. Solving such the problems requires modeling of mutual relationship between the light and optics until reaching the image plane. For this mutuality, we first discuss the optical properties of a camera system, because the image blur varies according to camera parameter settings. The camera system accounts for the camera model integrating a thin lens based camera model to explain the light and optical properties and a perspective projection camera model to explain the depth from lens translation. Then, depth from lens translation is proposed to use the feature points detected in edges of the image blur. The feature points contain the depth information derived from an amount of blur of width. The shape and motion can be estimated from the motion of feature points. This method uses the sequential SVD factorization to represent the orthogonal matrices that are singular value decomposition. Some experiments have been performed with a sequence of real and synthetic images comparing the presented method with the depth from lens translation. Experimental results have demonstrated the validity and shown the applicability of the proposed method to the depth estimation.

• Journal of the Optical Society of Korea
• /
• v.4 no.1
• /
• pp.25-29
• /
• 2000

Two different binocular cues are known for detecting motion in depth. One is disparity change in time and the other is inter-ocular velocity difference. Shioiri, Saisho and Yaguchi (1999) demon-strated that motion in depth can be seen based solely on inter-ocular velocity differences as well as on the disparity change in time. They used conditions in which either cue was minimized and measured performance based on motion in depth, finding better performance than chance level when either velocity cue or the disparity cue was almost isolated. However, there may have been influences from the cue minimized in each condition, since it was practically impossible to isolate perfectly either cue. I re-analyzed their data to examine whether the performance in the condition with disparity change and that in the condition with inter-ocular velocity difference were correlated. The result showed the correlation is very low and therefore, we can conclude that the visual system has two different mechanisms for motion in depth.

• Journal of Korea Multimedia Society
• /
• v.19 no.4
• /
• pp.774-779
• /
• 2016

The conventional methods using color signal for tracking the movement of the object require a lot of calculation and the performance is not accurate. In this paper, we propose a method to effectively track the moving objects using the depth information from a depth camera. First, it separates the background and the objects based on the depth difference in the depth of the screen. When an object is moved, the depth value of the object becomes blurred because of the phenomenon of Motion Blur. In order to solve the Motion Blur, we observe the changes in the characteristics of the object (the area of the object, the border length, the roundness, the actual size) by its velocity. The proposed algorithm was implemented in the simulation that was applied directly to the tracking of a golf ball. We can see that the estimated value of the proposed method is accurate enough to be very close to the actual measurement.

• 한국정보디스플레이학회:학술대회논문집
• /
• 2007.08a
• /
• pp.1029-1030
• /
• 2007

I introduce two experiments that investigate temporal factors of stereopsis: one is for depth perception and the other is for perception of motion in depth. Both studies show that there are multiple mechanisms to process depth information with different temporal characteristics.

• ETRI Journal
• /
• v.39 no.2
• /
• pp.181-190
• /
• 2017

The movements of the human body are difficult to capture owing to the complexity of the three-dimensional skeleton model and occlusion problems. In this paper, we propose a motion capture system that tracks dynamic human motions in real time. Without using external markers, the proposed system adopts multiple depth sensors (Microsoft Kinect) to overcome the occlusion and body rotation problems. To combine the joint data retrieved from the multiple sensors, our calibration process samples a point cloud from depth images and unifies the coordinate systems in point clouds into a single coordinate system via the iterative closest point method. Using noisy skeletal data from sensors, a posture reconstruction method is introduced to estimate the optimal joint positions for consistent motion generation. Based on the high tracking accuracy of the proposed system, we demonstrate that our system is applicable to various motion-based training programs in dance and Taekwondo.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.4 no.2
• /
• pp.15-19
• /
• 2008

In this paper, we propose a new algorithm of image depth detection using motion estimation and object tracking. In industry, robots are used for automobile, conveyer system, etc. But, these have much necessary time. Thus, in this paper, we develop the efficient method of image depth detection based on motion estimation and object tracking.

• The KIPS Transactions:PartB
• /
• v.8B no.5
• /
• pp.549-556
• /
• 2001

The general problems of recovering 3D for 2D imagery require the depth information for each picture element form focus. The manual creation of those 3D models is consuming time and cost expensive. The goal in this paper is to simplify the depth estimation algorithm that extracts the depth information of every region from monocular image sequence with camera translation to implement 3D video in realtime. The paper is based on the property that the motion of every point within image which taken from camera translation depends on the depth information. Full-search motion estimation based on block matching algorithm is exploited at first step and ten, motion vectors are compensated for the effect by camera rotation and zooming. We have introduced the algorithm that estimates motion of object by analysis of monocular motion picture and also calculates the averages of frame depth and relative depth of region to the average depth. Simulation results show that the depth of region belongs to a near object or a distant object is in accord with relative depth that human visual system recognizes.