• Current Optics and Photonics
• /
• v.2 no.5
• /
• pp.422-430
• /
• 2018

Rolling shutter operation of CMOS cameras can be utilized in optical camera communications in order to transmit data from an LED to mobile devices such as smart-phones. From temporally modulated light, a spatial flicker pattern is obtained in the captured image, and this is used for signal recovery. Due to the degradation of rolling shutter images caused by light smear, motion blur, and focus blur, the conventional decoding schemes for rolling shutter cameras based on the pattern width for 'OFF' and 'ON' cannot guarantee robust communications performance for practical uses. Aside from conventional techniques, such as polynomial fitting, histogram equalization can be used for blurry light mitigation, but it requires additional computation abilities resulting in burdens on mobile devices. This paper proposes a transition-based decoding scheme for rolling shutter cameras in order to offer simple and robust data decoding in the presence of image degradation. Based on the designed synchronization pulse and modulated data symbols according to the LED dimming level, the decoding process is conducted by observing the transition patterns of two sequential symbol pulses. For this, the extended symbol pulse caused by consecutive symbol pulses with the same level determines whether the second pulse should be included for the next bit decoding or not. The proposed method simply identifies the transition patterns of sequential symbol pulses other than the pattern width of 'OFF' and 'ON' for data decoding, and thus, it is simpler and more accurate. Experimental results ensured that the transition-based decoding scheme is robust even in the presence of blurry lights in the captured image at various dimming levels

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.41 no.4
• /
• pp.454-460
• /
• 2016

Unlike conventional visible light communications (VLC) adopting photo detectors (PD), optical camera communications (OCC) employs cameras in detecting the transmitted data. Especially, the data rate of OCC can be enhanced by using the principle of rolling-shutter, which is the operating scheme of a CMOS image sensor. In this study, we consider a novel OCC system for high-speed real time video processing to transmit high speed data from LED and to acquire image utilizing rolling-shutter effect of CMOS image sensor. Also, we demonstrate the improved performance of proposed system using a test-bed.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.41 no.8
• /
• pp.843-850
• /
• 2016

This paper introduces a novel modulation scheme for vehicular communication in taking advantage of existing LED lights available on a car. Our proposed 2-Phase Shift Keying (2-PSK) is a spatial modulation approach in which a pair of LED light sources in a car (either rear LEDs or front LEDs) is used as a transmitter. A typical camera (i.e. low frame rate at no greater than 30fps) that either a global shutter camera or a rolling shutter camera can be used as a receiver. The modulation scheme is a part of our Image Sensor Communication proposal submitted to IEEE 802.15.7r1 (TG7r1) recently. Also, a neural network approach is applied to improve the performance of LEDs detection and decoding under the noisy situation. Later, some analysis and experiment results are presented to indicate the performance of our system

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.42 no.1
• /
• pp.8-13
• /
• 2017

Compare with other communication system based RF technology, Optical Camera Communication (OCC) has limitation on data rate due to the low frame rate of camera. The limitation on data rate can be solved with multiple-input and multiple-output (MIMO) technology; and it is the final target of all researches on OCC. The MIMO topology can be implemented easily without breaking out the architecture of image sensor. For image sensor classification, there are two architectures have been developed: rolling shutter and global shutter. The operation of two techniques is different so the performance is also different. In this paper we analyze and evaluate the performance of the MIMO architecture for OCC.

• IEIE Transactions on Smart Processing and Computing
• /
• v.1 no.2
• /
• pp.78-87
• /
• 2012

In this paper, we address the tracking problem caused by camera motion and rolling shutter effects associated with CMOS sensors in consumer handheld cameras, such as mobile cameras, digital cameras, and digital camcorders. A modified particle filtering method is proposed for simultaneously tracking objects and compensating for the effects of camera motion. The proposed method uses an elastic registration algorithm (ER) that considers the global affine motion as well as the brightness and contrast between images, assuming that camera motion results in an affine transform of the image between two successive frames. By assuming that the camera motion is modeled globally by an affine transform, only the global affine model instead of the local model was considered. Only the brightness parameter was used in intensity variation. The contrast parameters used in the original ER algorithm were ignored because the change in illumination is small enough between temporally adjacent frames. The proposed particle filtering consists of the following four steps: (i) prediction step, (ii) compensating prediction state error based on camera motion estimation, (iii) update step and (iv) re-sampling step. A larger number of particles are needed when camera motion generates a prediction state error of an object at the prediction step. The proposed method robustly tracks the object of interest by compensating for the prediction state error using the affine motion model estimated from ER. Experimental results show that the proposed method outperforms the conventional particle filter, and can track moving objects robustly in consumer handheld imaging devices.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.34 no.10
• /
• pp.1385-1391
• /
• 2010

In this study, we present small-size, low-power, and high-speed electromagnetic flapping shutters for phone cameras. These shutters are composed of trapezoidal twin blades suspended by H-type torsional springs. The existing electrostatic rolling and flapping shutters need high input voltage, while the existing electromagnetic rotating shutters are too big to be used for phone cameras. To achieve low-power and high-speed angle motion for small-size electromagnetic flapping shutters for camera phones, low-inertia trapezoidal twin blades, each suspended by the low-stiffness H-type torsional springs, are employed. The electromagnetic flapping shutters used in this experimental study have steady-state rotational angles of $48.8{\pm}1.4^{\circ}$ and $64.4{\pm}1.0^{\circ}$ in the magentic fields of 0.15 T and 0.30 T, respectively, for an input current of 60 mA; the maximum overshoot angles are $80.2{\pm}3.5^{\circ}$ and $90.0{\pm}1.0^{\circ}$ in the magentic fields of 0.15 T and 0.30 T, respectively. The rising/settling times of the shutter while opening are 1.0 ms/20.0 ms, while those while closing are 1.7 ms/10.3 ms. Thus, we experimentally demonstrated that the smallsize (${\sim}8{\times}8{\times}2\;mm^3$), low-power (${\leq}60\;mA$), and high-speed (~1/370 s) electromagnetic flapping shutters are suitable for phone cameras.

• International journal of advanced smart convergence
• /
• v.4 no.2
• /
• pp.94-102
• /
• 2015

Optical camera communication (OCC) is an extension of Visible Light Communication. Different from traditional visible light communication, optical camera communications is an almost no additional cost technology by taking the advantage of build-in camera in devices. It was became a candidate for communication protocol for IoT. Camera module can be easy attached to IoT device, because it is small and flexible. Furthermore almost smartphone equip one or two camera for both back and font side with high quality and resolution. It can be utilized for receiving the data from LED or positioning. Actually, OCC combines illumination and communication. It can supply communication for special areas or environment where do not allow Radio frequency such as hospital, airplane etc. There are many concept and experiment be proposed. In this paper we proposed utilizing Android smart-phone camera for receiver and introduce new approach in modulation scheme for LED at transmitter. It also show how Manchester coding can be used encode bits while at the same time being successfully decoded by Android smart-phone camera. We introduce new data frame format for easy decoded and can be achieve high bit rate. This format can be easy to adapt to performance limit of Android operator or embedded system.