• Journal of Institute of Control, Robotics and Systems
• /
• v.13 no.8
• /
• pp.743-748
• /
• 2007

Recently, various types of camera mouse are developed using the image processing. The camera mouse showed limited performance compared to the traditional optical mouse in terms of the response time and the usability. These problems are caused by the mismatch between the size of the monitor and that of the active pixel area of the CMOS Image Sensor. To overcome these limitations, we designed a new input device that uses the face recognition as well as the speech recognition simultaneously. In the proposed system, the area of the monitor is partitioned into 'n' zones. The face recognition is performed using the web-camera, so that the mouse pointer follows the movement of the face of the user in a particular zone. The user can switch the zone by speaking the name of the zone. The multimodal mouse is analyzed using the Keystroke Level Model and the initial experiments was performed to evaluate the feasibility and the performance of the proposed system.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.11 no.9
• /
• pp.3465-3471
• /
• 2010

In this paper, we propose assistant device system based on camera that can perform general mouse function for the physically disabled. Most disabled people use special hardware and rely largely on foreign-made assistance device and the using rate of assistance device was very low because of high price. To solve this problem, we propose effective system based on web camera that can perform general mouse function and can raise accessibility for the physically disabled. In the proposed method, we firstly attach color marker on arbitrary device or body parts and then input the information of color using camera and extract coordinate information of color marker and finally, match processing information(coordinate) to special event(keyboard, mouse) and control various applications. The proposed method shows good performance in price and performance compared with other techniques by real field test.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.15 no.5
• /
• pp.1060-1065
• /
• 2011

In this paper, the proposed method is recognized the hands using color information with input image of the camera. It controls the mouse pointer using recognized hands. In addition, specific commands with the mouse pointer is designed to perform. Most users felt uncomfortable since existing interaction multimedia systems depend on a particular external input devices such as pens and mouse However, the proposed method is to compensate for these shortcomings by hand without the external input devices. In experimental methods, hand areas and backgrounds are separated using color information obtaining image from camera. And coordinates of the mouse pointer is determined using coordinates of the center of a separate hand. The mouse pointer is located in pre-filled area using these coordinates, and the robot will move and execute with the command. In experimental results, the recognition of the proposed method is more accurate but is still sensitive to the change of color of light.

• Journal of IKEEE
• /
• v.18 no.4
• /
• pp.478-484
• /
• 2014

In this paper, we propose new algorithm for positioning of mouse cursor using fingertip direction on kinect depth camera. The proposed algorithm uses center of parm points from distance transform when fingertip point toward screen. Otherwise, algorithm use fingertip points. After image preprocessing, the center of parm points is calculated from distance transform results. If the direction of the finger towards the camera becomes close to the distance between the fingertip point and center of parm point, it is possible to improve the accuracy of positioning by using the center of parm point. After remove arm on image, the fingertip points is obtained by using a pixel on the long distance from the center of the image. To calculate accuracy of mouse positioning, we selected any 5 points. Also, we calculated error rate between reference points and mouse points by performed 500 times. The error rate results could be confirmed the accuracy of our algorithm indicated an average error rate of less than 11%.

• Journal of Korea Multimedia Society
• /
• v.20 no.4
• /
• pp.671-685
• /
• 2017

We propose a finger detection algorithm for computer mouse control to control the most commonly actions of a computer mouse(left, right and double click, scroll up and down then we add open and close, minimize and maximize a window, control the mouse.) We use a built-in web camera to control the mouse tasks. We detected, segment, then recognize the hand in our previous papers [1, 2]. The user will be able to interact with the computer with the number of fingers detected.

• ETRI Journal
• /
• v.30 no.4
• /
• pp.621-623
• /
• 2008

We propose a novel input pointing device called the multimodal mouse (MM) which uses two modalities: face recognition and speech recognition. From an analysis of Microsoft Office workloads, we find that 80% of Microsoft Office Specialist test tasks are compound tasks using both the keyboard and the mouse together. When we use the optical mouse (OM), operation is quick, but it requires a hand exchange delay between the keyboard and the mouse. This takes up a significant amount of the total execution time. The MM operates more slowly than the OM, but it does not consume any hand exchange time. As a result, the MM shows better performance than the OM in many cases.

• Journal of Korea Multimedia Society
• /
• v.23 no.12
• /
• pp.1454-1463
• /
• 2020

An important factor in eye-tracking PC interface for general paralyzed patients is the implementation of the mouse interface, for manipulating the GUI. With a successfully implemented mouse interface, users can generate mouse events exactly at the point of their choosing. However, it is difficult to define this interaction in the eye-tracking interface. This problem has been defined as the Midas touch problem and has been a major focus of eye-tracking research. There have been many attempts to solve this problem using blink, voice input, etc. However, it was not suitable for general paralyzed patients because some of them cannot wink or speak. In this paper, we propose a mouth-pop-up, eye-tracking mouse interface that solves the Midas touch problem as well as becoming a suitable interface for general paralyzed patients using a common RGB camera. The interface presented in this paper implements a mouse interface that detects the opening and closing of the mouth to activate a pop-up menu that the user can select the mouse event. After implementation, a performance experiment was conducted. As a result, we found that the number of malfunctions and the time to perform tasks were reduced compared to the existing method.

• Journal of the Korea Society of Computer and Information
• /
• v.12 no.6
• /
• pp.69-76
• /
• 2007

The main stream of presentation is interrupted because of the direct manipulation of their PC frequently so as to control the screen and file open and so on. A variety of products have been developed to solve these inconveniences of the conventional laser beam pointer [LBP] by simply adding a mouse function to the previous LBP. However. the LBPs fully supporting a mouse function are not yet appeared. In this paper. we developed the LBP fully fulfilling a mouse function using mono-camera as well as a robust image processing and analyzed the position detection accuracy. Finally we verified the developed LBP does not only fulfill a mouse function but also solve the defects of the current laser pointer such as inconvenient installation and Position detection errors due to the illumination and viewing direction changes.

• Journal of the HCI Society of Korea
• /
• v.5 no.2
• /
• pp.1-6
• /
• 2010

In this research, we designed the head mouse system for disabled and gamers, a mouse controller which can be controlled by head movements and eye blinks only, and compared its performance with other regular mouse controller systems. The head mouse was moved by a gyro-sensor, which can measure an angular rotation of a head movement, and the eye blink was used as a clicking event of the mouse system. Accumulated errors caused by integral, which was a problem that previous head mouse system had, were removed periodically, and treated as dead zones in the non-linear relative point graph, and direct mouse point control was possible using its moving distance and acceleration calculation. We used the active light sources to minimize the influence of the ambient light changes, so that the head mouse was not affected by the change in external light source. In a comparison between the head mouse and the gazing tracking mouse (Quick Glance), the above method resulted about 21% higher score on the clicking event experiment called "20 clicks", about 25% higher on the dasher experiment, and about 37% higher on on-screen keyboard test respectively, which concludes that the proposed head mouse has better performance than the standard mouse system.

• Journal of Institute of Control, Robotics and Systems
• /
• v.17 no.11
• /
• pp.1168-1172
• /
• 2011

Beam projector is popularly used for presentation. In order to pay attention to local area of the beam projector display, a laser pointer is used together with a pointing device(Mouse). Simple wireless presenter has limited functions of a pointing device such as "go to next slide" or "back to previous slide" in a specific application(Microsoft PowerPoint) through wireless channel; thus, there is inconvenience to do other tasks e.g., program execution, maximize/minimize window etc. provided by clicking mouse buttons. The main objective of this paper is to implement a multi-functional laser-pointer mouse that has the same functions of a computer mouse. In order to get position of laser spot in the projector display, an image processing to extract the laser spot in the camera image is required. In addition, we propose a transformation of the spot position into computer display coordinates to execute mouse functions on computer display.