IP Library Patent Application 14374392
Patent Application
App. No. 14/374,392

IMAGE PROCESSOR COMPRISING GESTURE RECOGNITION SYSTEM WITH STATIC HAND POSE RECOGNITION BASED ON DYNAMIC WARPING

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/374,392
Abstract

An image processing system comprises an image processor having image processing circuitry and an associated memory. The image processor is configured to implement a gesture recognition system comprising a static pose recognition module. The static pose recognition module is configured to identify a hand region of interest in at least one image, to extract a contour of the hand region of interest, to compute a feature vector based at least in part on the extracted contour, and to recognize a static pose of the hand region of interest utilizing a dynamic warping operation based at least in part on the feature vector.

Claims (44)

1 . A method comprising steps of:

identifying a hand region of interest in at least one image;

extracting a contour of the hand region of interest;

computing a feature vector based at least in part on the extracted contour; and

recognizing a static pose of the hand region of interest utilizing a dynamic warping operation based at least in part on the feature vector;

wherein the steps are implemented in an image processor comprising a processor coupled to a memory.

2 . The method of claim 1 wherein the steps are implemented in a static pose recognition module of a gesture recognition system of the image processor.

3 . The method of claim 1 wherein identifying a hand region of interest comprises generating a hand image comprising a binary region of interest mask in which pixels within the hand region of interest all have a first binary value and pixels outside the hand region of interest all have a second binary value complementary to the first binary value.

4 . The method of claim 1 further comprising:

identifying a palm boundary of the hand region of interest; and

modifying the hand region of interest to exclude from the hand region of interest any pixels below the identified palm boundary.

5 . The method of claim 1 wherein the extracted contour comprises an ordered list of n points c 1 , C 2 , . . . , c n .

6 . The method of claim 5 wherein the feature vector comprises an ordered list of n radius vectors r 1 , r 2 , . . . , r n corresponding to respective ones of the n contour points c 1 , c 2 , . . . , c n .

7 . The method of claim 6 wherein the feature vector further comprises an ordered list of pairs (r 1 , φ 1 ), (r 2 , φ 2 ), . . . , (r n , φ n ), where φ k denotes an angle associated with radius vector r k .

8 . The method of claim 1 further comprising:

determining if the extracted contour corresponds to a particular predetermined one of a left hand version and a right hand version; and

if the extracted contour does not correspond to the particular predetermined one of the left hand version and the right hand version, normalizing the extracted contour to correspond to the particular predetermined one of the left hand version and the right hand version.

9 . The method of claim 1 further comprising:

determining a first center point as a center of mass of the extracted contour and a second center point as a center of a maximal-circumference circle that can be inscribed in the extracted contour; and

comparing the first and second center points to determine if the extracted contour corresponds to a left hand version or a right hand version.

10 . The method of claim 9 wherein the second center point is determined by applying an iterative process to an initial center point, the iterative process comprising:

computing distances between points of the contour and the initial center point;

computing local minimums of said distances;

computing a new center point based at least in part on the local minimums; and

repeating said computing using the new center point until a designated convergence property is satisfied.

11 . The method of claim 5 further comprising adjusting a point distribution of the extracted contour by converting the ordered list of points c 1 , . . . , c n into a processed list of m points cc 1 , . . . , cc m , where distances ∥cc i −cc i+1 ∥ are approximately equal for all i=1 . . . m−1, and where m may, but need not, be equal to n.

12 . The method of claim 1 wherein the dynamic warping operation comprises:

identifying pairs of allowed lists of integer indexes; and

computing a minimal sum of a similarity measure over the identified pairs of allowed lists of integer indexes.

13 . The method of claim 12 wherein the allowed lists of integer indexes in a given one of the pairs are permitted to differ from one another by no more than a specified threshold value.

14 . The method of claim 12 wherein the allowed lists of integer indexes in a given one of the pairs are prevented from having a segment length that exceeds a specified threshold value.

15 . An article of manufacture comprising a computer-readable storage medium having computer program code embodied therein, wherein the computer program code when executed in the image processor causes the image processor to perform the method of claim 1 .

16 . An apparatus comprising:

an image processor comprising image processing circuitry and an associated memory;

wherein the image processor is configured to implement a gesture recognition system utilizing the image processing circuitry and the memory, the gesture recognition system comprising a static pose recognition module; and

wherein the static pose recognition module is configured to identify a hand region of interest in at least one image, to extract a contour of the hand region of interest, to compute a feature vector based at least in part on the extracted contour, and to recognize a static pose of the hand region of interest utilizing a dynamic warping operation based at least in part on the feature vector.

17 . The apparatus of claim 16 wherein the extracted contour comprises an ordered list of n points c 1 , c 2 , . . . , c n , and the feature vector comprises at least one of:

an ordered list of n radius vectors r 1 , r 2 , . . . , r n corresponding to respective ones of n contour points c 1 , c 2 , . . . , c n ; and

an ordered list of pairs (r 1 , φ 1 ), (r 2 , φ 2 ), . . . , (r n , φ n ), where φ k denotes an angle associated with radius vector r k .

18 . The apparatus of claim 16 wherein the dynamic warping operation comprises:

identifying pairs of allowed lists of integer indexes; and

computing a minimal sum of a similarity measure over the identified pairs of allowed lists of integer indexes.

19 . An integrated circuit comprising the apparatus of claim 16 .

20 . An image processing system comprising the apparatus of claim 16 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2016
From: LSI CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 038062/0967 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2014
From: PETYUSHKO, ALEXANDER A.; MAZURENKO, IVAN L.; BABIN, DMITRY N.; LETUNOVSKIY, ALEKSEY A.; KHOLODENKO, ALEXANDER B.
To: LSI CORPORATION
Reel/Frame 033385/0134 →