GESTURE RECOGNITION SYSTEM WITH FINITE STATE MACHINE CONTROL OF CURSOR DETECTOR AND DYNAMIC GESTURE DETECTOR
An image processing system comprises an image processor having image processing circuitry and an associated memory. The image processor is configured to implement a gesture recognition system. The gesture recognition system comprises a cursor detector, a dynamic gesture detector, a static pose recognition module, and a finite state machine configured to control selectively enabling of the cursor detector, the dynamic gesture detector and the static pose recognition module. By way of example, the finite state machine includes a cursor detected state in which cursor location and tracking are applied responsive to detection of a cursor in a current frame, a dynamic gesture detected state in which dynamic gesture recognition is applied responsive to detection of a dynamic gesture in the current frame, and a static pose recognition state in which static pose recognition is applied responsive to failure to detect a cursor or a dynamic gesture in the current frame.
1 . A method comprising:
configuring a gesture recognition system to include a cursor detector, a dynamic gesture detector and a static pose recognition module; and
providing a finite state machine to control selective enabling of the cursor detector, the dynamic gesture detector and the static pose recognition module;
wherein the configuring and providing are implemented in an image processor comprising a processor coupled to a memory.
2 . The method of claim 1 wherein the finite state machine has a plurality of states including:
a cursor detected state in which cursor location and tracking are applied responsive to detection of a cursor in a current frame;
a dynamic gesture detected state in which dynamic gesture recognition is applied responsive to detection of a dynamic gesture in the current frame; and
a static pose recognition state in which static pose recognition is applied responsive to failure to detect a cursor or a dynamic gesture in the current frame.
3 . The method of claim 1 wherein a final state of the finite state machine for a current frame is determined as a function of outputs of respective ones of the cursor detector, dynamic gesture detector and static pose recognition module for the current frame.
4 . The method of claim 3 wherein the final state of the finite state machine for the current frame is utilized as an initial state of the finite state machine for a subsequent frame.
5 . The method of claim 3 wherein an initial state of the finite state machine for the current frame is given by a final state of the finite state machine for a previous frame.
6 . The method of claim 1 wherein the finite state machine is configured such that only one of the cursor detector, dynamic gesture detector and static pose recognition module is enabled at a time.
7 . The method of claim 1 wherein the cursor detector and the dynamic gesture detector operate at a higher frame rate than the static pose recognition module.
8 . The method of claim 1 wherein the finite state machine is configured to adjust a frame rate of operation of the gesture recognition system responsive to outputs of the cursor detector and the dynamic gesture detector.
9 . The method of claim 1 wherein if an initial state of the finite state machine for a current frame is a dynamic gesture detected state, the dynamic gesture detector is initially enabled for the current frame.
10 . The method of claim 9 wherein if a dynamic gesture is detected by the dynamic gesture detector for the current frame, dynamic gesture recognition is applied, and if a dynamic gesture is not detected by the dynamic gesture detector for the current frame, the finite state machine enables the cursor detector for the current frame.
11 . The method of claim 10 wherein if a dynamic gesture is not detected by the dynamic gesture detector and a cursor is not detected by the cursor detector, the finite state machine enables the static pose recognition module for the current frame.
12 . The method of claim 1 wherein if an initial state of the finite state machine for a current frame is not a dynamic gesture detected state, the cursor detector is initially enabled for the current frame.
13 . The method of claim 12 wherein if a cursor is detected by the cursor detector for the current frame, cursor location and tracking is applied, and if a cursor is not detected by the cursor detector for the current frame, the finite state machine enables the dynamic gesture detector for the current frame.
14 . The method of claim 13 wherein if a dynamic gesture is not detected by the dynamic gesture detector and a cursor is not detected by the cursor detector, the finite state machine enables the static pose recognition module for the current frame.
15 . A non-transitory computer-readable storage medium having computer program code embodied therein, wherein the computer program code when executed in the image processor causes the image processor to perform the method of claim 1 .
16 . An apparatus comprising:
an image processor comprising image processing circuitry and an associated memory;
wherein the image processor is configured to implement a gesture recognition system utilizing the image processing circuitry and the memory, the gesture recognition system comprising:
a cursor detector;
a dynamic gesture detector;
a static pose recognition module; and
a finite state machine configured to control selective enabling of the cursor detector, the dynamic gesture detector and the static pose recognition module.
17 . The apparatus of claim 16 wherein the finite state machine has a plurality of states including:
a cursor detected state in which cursor location and tracking are applied responsive to detection of a cursor in a current frame;
a dynamic gesture detected state in which dynamic gesture recognition is applied responsive to detection of a dynamic gesture in the current frame; and
a static pose recognition state in which static pose recognition is applied responsive to failure to detect a cursor or a dynamic gesture in the current frame.
18 . The apparatus of claim 16 wherein the finite state machine is configured such that only one of the cursor detector, dynamic gesture detector and static pose recognition module is enabled at a time.
19 . An integrated circuit comprising the apparatus of claim 16 .
20 . An image processing system comprising the apparatus of claim 16 .