IP Library Granted Patent US 11,782,516
Granted Patent B2
US 11,782,516 · App. 17/693,200 · Granted Oct 10, 2023

Differentiating a detected object from a background using a gaussian brightness falloff pattern

Inventors: David S. Holz (San Francisco, CA); Hua Yang (Millbrae, CA)
Assignee: Ultrahaptics IP Two Limited
G06F3/017G06F3/0304G06T7/10G06T7/11G06T7/194G06T7/215G06T7/248G06T7/251G06T7/254G06T7/262G06T7/344G06T7/37G06T7/70G06T7/90G06V20/64G06V40/107H04N13/254H04N23/661G06F18/00G06T2200/04G06T2207/10012G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,782,516
App. No.
17/693,200
Granted
Oct 10, 2023
Kind
B2
Abstract

A method for detecting a finger is provided. The method includes obtaining a plurality of digital images including a first digital image captured by a camera from a field of view containing a background and a hand including at least one finger, and obtaining an identification of pixels of the plurality of digital images that correspond to at least one finger that is visible in the plurality of digital images rather than to the background, the pixels being identified by: obtaining, from the digital images, a Gaussian brightness falloff pattern indicative of at least one finger, identifying an axis of the at least one finger based on the obtained Gaussian brightness falloff pattern indicative of the at least one finger without identifying edges of the at least one finger, and identifying the pixels that correspond to the at least one finger based on the identified axis.

Claims (59)

1. A method comprising:

obtaining a plurality of digital images including a first digital image captured by a camera at a time when at least one light source is illuminating a field of view containing a background and a hand including at least one finger;

obtaining an identification of pixels of the plurality of digital images that correspond to at least one finger of the hand that is visible in the plurality of digital images rather than to the background, the pixels being identified by:

obtaining, from the plurality of digital images, a Gaussian brightness falloff pattern indicative of at least one finger of the hand;

identifying an axis of the at least one finger of the hand based on the obtained Gaussian brightness falloff pattern indicative of the at least one finger without identifying edges of the at least one finger; and

identifying the pixels that correspond to the at least one finger based on the identified axis; and

tracking motion of the identified pixels that correspond to the at least one finger through the plurality of digital images.

2. The method of claim 1 , further comprising:

comparing the tracked motion to a library of gestures;

identifying a particular gesture from the library of gestures that corresponds to the tracked motion; and

enabling the particular gesture that corresponds to the tracked motion.

3. The method of claim 1 , wherein:

the method further includes constructing a model of the at least one finger based on the identified pixels that correspond to the at least one finger and the tracked motion of the identified pixels that correspond to the at least one finger;

the constructing of the model includes constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger corresponds to an object of interest; and

the at least one light source is positioned such that objects of interest are located within a proximal zone of the field of view, the proximal zone extending from the camera to a distance less than twice an expected maximum distance between the objects of interest and the camera.

4. The method of claim 1 , wherein:

the constructing of the model includes constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger corresponds to an object of interest; and

the at least one light source is positioned such that objects of interest are located within a proximal zone of the field of view, the proximal zone extending from the camera to a distance that is half or less than a distance to the background.

5. The method of claim 1 , wherein edges of the at least one finger is not visible in at least one digital image of the plurality of digital images.

6. The method of claim 1 , wherein the Gaussian brightness falloff pattern is characterized by a negative second derivative.

7. The method of claim 1 , wherein the Gaussian brightness falloff pattern includes an asymmetric curve.

8. The method of claim 1 , wherein the identifying of the pixels that correspond to the at least one finger includes:

comparing pixels in successive digital images of the plurality of digital images to distinguish pixels corresponding to the at least one finger from pixels corresponding to the background.

9. The method of claim 1 , wherein the identifying of the pixels that correspond to the at least one finger includes:

generating a reduced representation of each digital image of the plurality of digital images in which identified pixels corresponding to the background are zeroed out.

10. An image capture and analysis system comprising:

an image analyzer configured to:

obtain a plurality of digital images including a first digital image captured by a camera at a time when at least one light source is illuminating a field of view containing a background and a hand including at least one finger;

obtain an identification of pixels of the plurality of digital images that correspond to at least one finger of the hand that is visible in the plurality of digital images rather than to the background, the image analyzer identifying the pixels by:

obtaining, from the plurality of digital images, a Gaussian brightness falloff pattern indicative of at least one finger of the hand that is visible;

identifying an axis of the at least one finger of the hand based on the obtained Gaussian brightness falloff pattern indicative of the at least one finger without identifying edges of the at least one finger; and

identifying the pixels that correspond to the at least one finger based on the identified axis of the at least one fingers; and

track motion of the identified pixels that correspond to the at least one finger through the plurality of digital images.

11. The image capture and analysis system of claim 10 , wherein image analyzer is further configured to:

compare the tracked motion to a library of gestures;

identify a particular gesture from the library of gestures that corresponds to the tracked motion; and

enable the particular gesture that corresponds to the tracked motion.

12. The image capture and analysis system of claim 10 , wherein:

the image analyzer is further configured to construct a model of the at least one finger based on the identified pixels that correspond to the at least one finger and the tracked motion of the identified pixels that correspond to the at least one finger;

the image analyzer constructs the model by constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger correspond to an object of interest; and

the at least one light source is positioned such that objects of interest are located within a proximal zone of the field of view, the proximal zone extending from the camera to a distance less than twice an expected maximum distance between the objects of interest and the camera.

13. The image capture and analysis system of claim 10 , wherein:

the image analyzer constructs the model by constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger corresponds to an object of interest; and

the at least one light source is positioned such that objects of interest are located within a proximal zone of the field of view, the proximal zone extending from the camera to a distance that is half or less than a distance to the background.

14. The image capture and analysis system of claim 10 , wherein edges of the at least one finger is not visible in at least one digital image of the plurality of digital images.

15. The image capture and analysis system of claim 10 , wherein the Gaussian brightness falloff pattern is characterized by a negative second derivative.

16. The image capture and analysis system of claim 10 , wherein the Gaussian brightness falloff pattern includes an asymmetric curve.

17. The image capture and analysis system of claim 10 , wherein the image analyzer identifies the pixels that correspond to the at least one fingers by:

comparing pixels in successive digital images of the plurality of digital images to distinguish pixels corresponding to the at least one finger from pixels corresponding to the background.

18. The image capture and analysis system of claim 10 , wherein the image analyzer identifies the pixels that correspond to the at least one finger by:

generating a reduced representation of each digital image of the plurality of digital images in which identified pixels corresponding to the background are zeroed out.

19. A wearable goggle, comprising:

a processor configured to:

obtain a plurality of digital images including a first digital image captured by a camera at a time when at least one light source is illuminating a field of view containing a background and a hand including at least one finger;

obtain an identification of pixels of the plurality of digital images that correspond to at least one finger of the hand that is visible in the plurality of digital images rather than to the background, the processor identifying the pixels by:

obtaining, from the plurality of digital images, a Gaussian brightness falloff pattern indicative of at least one finger of the hand that is visible;

identifying an axis of the at least one finger of the hand based on the obtained Gaussian brightness falloff pattern indicative of the at least one finger without identifying edges of the at least one finger; and

identifying the pixels that correspond to the at least one finger based on the identified axis of the at least one fingers; and

track motion of the identified pixels that correspond to the at least one finger through the plurality of digital images.

Assignments (6)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0545 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0573 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2022
From: HOLZ, DAVID S.; YANG, HUA
To: LEAP MOTION, INC.
Reel/Frame 062203/0080 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2022
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO. LLC
Reel/Frame 062203/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2022
From: LMI LIQUIDATING CO. LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 062203/0100 →