Real-time Dynamic Hand Shape Gesture Controller

Real-time Dynamic Hand Shape Gesture Controller
Author: Rajesh Radhakrishnan
Publisher:
Total Pages:
Release: 2011
Genre:
ISBN:

The main objective of this thesis is to build a real time gesture recognition system which can spot and recognize specific gestures from continuous stream of input video. We address the recognition of single handed dynamic gestures. We have considered gestures which are sequences of distinct hand poses. Gestures are classified based on their hand poses and its nature of motion. The recognition strategy uses a combination of spatial hand shape recognition using chamfer distance measure and temporal characteristics through dynamic programming. The system is fairly robust to background clutter and uses skin color for tracking. Gestures are an important modality for human-machine communication, and robust gesture recognition can be an important component of intelligent homes and assistive environments in general. Challenging task in a robust recognition system is the amount of unique gesture classes that the system can recognize accurately. Our problem domain is two dimensional tracking and recognition with a single static camera. We also address the reliability of the system as we scale the size of gesture vocabulary. Our system is based on supervised learning, both detection and recognition uses the existing trained models. The hand tracking framework is based on non-parametric histogram bin based approach. A coarser histogram bin containing skin and non-skin models of size 32x32x32 was built. The histogram bins were generated by using samples of skin and non-skin images. The tracker framework effectively finds the moving skin locations as it integrates both the motion and skin detection. Hand shapes are another important modality of our gesture recognition system. Hand shapes can hold important information about the meaning of a gesture, or about the intent of an action. Recognizing hand shapes can be a very challenging task, because the same hand shape may look very different in different images, depending on the view point of the camera. We use chamfer matching of edge extracted hand regions to compute the minimum chamfer matching score. Dynamic Programming technique is used align the temporal sequences of gesture. In this paper, we propose a novel hand gesture recognition system where in user can specify his/her desired gestures vocabulary. The contributions made to the gesture recognition framework are, user-chosen gesture vocabulary (i.e) user is given an option to specify his/her desired gesture vocabulary, confusability analysis of gesture (i.e) During training, if user provides similar gesture pattern for two different gesture patterns the system automatically alerts the user to provide a different gesture pattern for a specific class, novel methodology to combine both hand shape and motion trajectory for recognition, hand tracker (using motion and skin color detection) aided hand shape recognition. The system runs in real time with frame rate of 15 frames per second in debug mode and 17 frames per second in release mode. The system was built in a normal hardware configuration with Microsoft Visual Studio, using OpenCV and C++. Experimental results establish the effectiveness of the system.

Robust Hand Gesture Recognition for Robotic Hand Control

Robust Hand Gesture Recognition for Robotic Hand Control
Author: Ankit Chaudhary
Publisher: Springer
Total Pages: 108
Release: 2017-06-05
Genre: Technology & Engineering
ISBN: 9811047987

This book focuses on light invariant bare hand gesture recognition while there is no restriction on the types of gestures. Observations and results have confirmed that this research work can be used to remotely control a robotic hand using hand gestures. The system developed here is also able to recognize hand gestures in different lighting conditions. The pre-processing is performed by developing an image-cropping algorithm that ensures only the area of interest is included in the segmented image. The segmented image is compared with a predefined gesture set which must be installed in the recognition system. These images are stored and feature vectors are extracted from them. These feature vectors are subsequently presented using an orientation histogram, which provides a view of the edges in the form of frequency. Thereby, if the same gesture is shown twice in different lighting intensities, both repetitions will map to the same gesture in the stored data. The mapping of the segmented image's orientation histogram is firstly done using the Euclidian distance method. Secondly, the supervised neural network is trained for the same, producing better recognition results. An approach to controlling electro-mechanical robotic hands using dynamic hand gestures is also presented using a robot simulator. Such robotic hands have applications in commercial, military or emergency operations where human life cannot be risked. For such applications, an artificial robotic hand is required to perform real-time operations. This robotic hand should be able to move its fingers in the same manner as a human hand. For this purpose, hand geometry parameters are obtained using a webcam and also using KINECT. The parameter detection is direction invariant in both methods. Once the hand parameters are obtained, the fingers’ angle information is obtained by performing a geometrical analysis. An artificial neural network is also implemented to calculate the angles. These two methods can be used with only one hand, either right or left. A separate method that is applicable to both hands simultaneously is also developed and fingers angles are calculated. The contents of this book will be useful for researchers and professional engineers working on robotic arm/hand systems.

Real-time Immersive Human-computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures

Real-time Immersive Human-computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures
Author: Gan Lu
Publisher:
Total Pages:
Release: 2011
Genre:
ISBN:

With fast developing and ever growing use of computer based technologies, human-computer interaction (HCI) plays an increasingly pivotal role. In virtual reality (VR), HCI technologies provide not only a better understanding of three-dimensional shapes and spaces, but also sensory immersion and physical interaction. With the hand based HCI being a key HCI modality for object manipulation and gesture based communication, challenges are presented to provide users a natural, intuitive, effortless, precise, and real-time method for HCI based on dynamic hand gestures, due to the complexity of hand postures formed by multiple joints with high degrees-of-freedom, the speed of hand movements with highly variable trajectories and rapid direction changes, and the precision required for interaction between hands and objects in the virtual world. Presented in this thesis is the design and development of a novel real-time HCI system based on a unique combination of a pair of data gloves based on fibre-optic curvature sensors to acquire finger joint angles, a hybrid tracking system based on inertia and ultrasound to capture hand position and orientation, and a stereoscopic display system to provide an immersive visual feedback. The potential and effectiveness of the proposed system is demonstrated through a number of applications, namely, hand gesture based virtual object manipulation and visualisation, hand gesture based direct sign writing, and hand gesture based finger spelling. For virtual object manipulation and visualisation, the system is shown to allow a user to select, translate, rotate, scale, release and visualise virtual objects (presented using graphics and volume data) in three-dimensional space using natural hand gestures in real-time. For direct sign writing, the system is shown to be able to display immediately the corresponding SignWriting symbols signed by a user using three different signing sequences and a range of complex hand gestures, which consist of various combinations of hand postures (with each finger open, half-bent, closed, adduction and abduction), eight hand orientations in horizontal/vertical plans, three palm facing directions, and various hand movements (which can have eight directions in horizontal/vertical plans, and can be repetitive, straight/curve, clockwise/anti-clockwise). The development includes a special visual interface to give not only a stereoscopic view of hand gestures and movements, but also a structured visual feedback for each stage of the signing sequence. An excellent basis is therefore formed to develop a full HCI based on all human gestures by integrating the proposed system with facial expression and body posture recognition methods. Furthermore, for finger spelling, the system is shown to be able to recognise five vowels signed by two hands using the British Sign Language in real-time.

Challenges and Applications for Hand Gesture Recognition

Challenges and Applications for Hand Gesture Recognition
Author: Kane, Lalit
Publisher: IGI Global
Total Pages: 249
Release: 2022-03-25
Genre: Computers
ISBN: 1799894363

Due to the rise of new applications in electronic appliances and pervasive devices, automated hand gesture recognition (HGR) has become an area of increasing interest. HGR developments have come a long way from the traditional sign language recognition (SLR) systems to depth and wearable sensor-based electronic devices. Where the former are more laboratory-oriented frameworks, the latter are comparatively realistic and practical systems. Based on various gestural traits, such as hand postures, gesture recognition takes different forms. Consequently, different interpretations can be associated with gestures in various application contexts. A considerable amount of research is still needed to introduce more practical gesture recognition systems and associated algorithms. Challenges and Applications for Hand Gesture Recognition highlights the state-of-the-art practices of HGR research and discusses key areas such as challenges, opportunities, and future directions. Covering a range of topics such as wearable sensors and hand kinematics, this critical reference source is ideal for researchers, academicians, scholars, industry professionals, engineers, instructors, and students.

Probabilistic Graphical Models for Computer Vision

Probabilistic Graphical Models for Computer Vision
Author: Qiang Ji
Publisher: Academic Press
Total Pages: 294
Release: 2019-11
Genre:
ISBN: 012803467X

Probabilistic Graphical Models for Computer Vision introduces probabilistic graphical models (PGMs) for computer vision problems and teaches how to develop the PGM model from training data. This book discusses PGMs and their significance in the context of solving computer vision problems, giving the basic concepts, definitions and properties. It also provides a comprehensive introduction to well-established theories for different types of PGMs, including both directed and undirected PGMs, such as Bayesian Networks, Markov Networks and their variants. Discusses PGM theories and techniques with computer vision examples Focuses on well-established PGM theories that are accompanied by corresponding pseudocode for computer vision Includes an extensive list of references, online resources and a list of publicly available and commercial software Covers computer vision tasks, including feature extraction and image segmentation, object and facial recognition, human activity recognition, object tracking and 3D reconstruction

Tracking of Dynamic Hand Gestures on a Mobile Platform

Tracking of Dynamic Hand Gestures on a Mobile Platform
Author: Robert Prior
Publisher:
Total Pages:
Release: 2017
Genre:
ISBN:

Hand gesture recognition is an expansive and evolving field. Previous work addresses methods for tracking hand gestures primarily with specialty gaming/desktop environments in real time. The method proposed here focuses on enhancing performance for mobile GPU platforms with restricted resources by limiting memory use/transfers and by reducing the need for code branches. An encoding scheme has been designed to allow contour processing typically used for finding fingertips to occur efficiently on a GPU for non-touch, remote manipulation of on-screen images. Results show high resolution video frames can be processed in real time on a modern mobile consumer device, allowing for fine grained hand movements to be detected and tracked.

Depth From Defocus: A Real Aperture Imaging Approach

Depth From Defocus: A Real Aperture Imaging Approach
Author: Subhasis Chaudhuri
Publisher: Springer Science & Business Media
Total Pages: 188
Release: 2012-12-06
Genre: Computers
ISBN: 1461214904

Depth recovery is important in machine vision applications when a 3-dimensional structure must be derived from 2-dimensional images. This is an active area of research with applications ranging from industrial robotics to military imaging. This book provides the comprehensive details of the methodology, along with the complete mathematics and algorithms involved. Many new models, both deterministic and statistical, are introduced.

"Real Time Hand Gesture Recognition For Mouse Controlling Function"

Author: Suhas Baliram
Publisher:
Total Pages: 0
Release: 2022-07-25
Genre:
ISBN:

Hand gestures are an easy to use and natural way of interaction. Using hands as a device can help people communicate with computers in a more intuitive and natural way. When we interact with other people, our hand movements play an important role and the information they convey is very rich in many ways. We use our hands for pointing at a person or at an object, conveying information about space, shape and temporal characteristics. We constantly use our hands to interact with objects: move them, modify them, and transform them. In the same unconscious way, we gesticulate while speaking to communicate ideas ('stop', 'come closer', 'no', etc). Hand movements are thus a mean of non-verbal communication, ranging from simple actions (pointing at objects for example) to more complex ones (such as expressing feelings or communicating with others). In this sense, gestures are not only an ornament of spoken language, but are essential components of the language generation process itself [1].

Applications of Soft Computing

Applications of Soft Computing
Author: Ashutosh Tiwari
Publisher: Springer Science & Business Media
Total Pages: 421
Release: 2010-04-08
Genre: Computers
ISBN: 3540362665

This book provides a comprehensive overview of recent advances in the industrial applications of soft computing. It covers a wide range of application areas, including optimisation, data analysis and data mining, computer graphics and vision, prediction and diagnosis, design, intelligent control, and traffic and transportation systems. The book is aimed at researchers and professional engineers engaged in developing and applying intelligent systems.