IP Library Granted Patent US 10,366,308
Granted Patent B2
US 10,366,308 · App. 15/937,717 · Granted Jul 30, 2019

Enhanced contrast for object detection and characterization by optical imaging based on differences between images

Inventors: David S. Holz (San Francisco, CA); Hua Yang (Millbrae, CA)
Assignee: Leap Motion, Inc.
G06K9/6202G06F3/017G06F3/0304G06K9/00201G06K9/00375G06K9/2027G06K9/3233G06K9/46G06T7/10G06T7/11G06T7/194G06T7/215G06T7/248G06T7/251G06T7/254G06T7/262G06T7/344G06T7/37G06T7/70G06T7/90H04N5/232H04N13/254G06K9/00G06T2200/04G06T2207/10012G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,366,308
App. No.
15/937,717
Granted
Jul 30, 2019
Kind
B2
Abstract

Enhanced contrast between an object of interest and background surfaces visible in an image is provided using controlled lighting directed at the object. Exploiting the falloff of light intensity with distance, a light source (or multiple light sources), such as an infrared light source, can be positioned near one or more cameras to shine light onto the object while the camera(s) capture images. The captured images can be analyzed to distinguish object pixels from background pixels.

Claims (34)

1. A method of capturing and analyzing an image, the method comprising:

utilizing an image analyzer coupled to at least one camera and at least one light source to:

operate the at least one camera to capture a sequence of images including a first image captured at a time when the at least one light source is illuminating a field of view;

based on information obtained from an object of interest, construct at least a position and a shape of the object of interest; and

distinguish between (i) foreground image components corresponding to objects located within a proximal zone of the field of view, the proximal zone extending from the at least one camera and having a depth relative to an expected maximum distance between the objects corresponding to the foreground image components and the at least one camera, and (ii) background image components corresponding to objects located within a distal zone of the field of view, the distal zone being located, relative to the at least one camera, beyond the proximal zone.

2. The method of claim 1 , wherein the proximal zone has a depth of at least four times the expected maximum distance.

3. The method of claim 1 , wherein the at least one light source is a diffuse emitter.

4. The method of claim 3 , wherein the at least one light source is an infrared light-emitting diode and the at least one camera is an infrared-sensitive camera.

5. The method of claim 1 , wherein at least two light sources flank the at least one camera and are substantially coplanar therewith.

6. The method of claim 1 , wherein the at least one camera and the at least one light source are oriented vertically upward or horizontally outward.

7. The method of claim 1 , wherein the image analyzer controls the at least one camera to provide an exposure time no greater than 100 microseconds and wherein the image analyzer activates the at least one light source during the exposure time at a power level of at least 5 watts.

8. The method of claim 1 , wherein a holographic diffraction grating is positioned between a lens of the at least one camera and the field of view.

9. The method of claim 1 , wherein the image analyzer is further configured to operate the at least one camera to capture second and third images when the at least one light source is not illuminating the field of view and identify pixels corresponding to the object of interest based on a difference between the first and second images and a difference between the first and third images, and wherein the second image is captured before the first image and the third image is captured after the second image.

10. A wearable goggle, comprising:

at least one camera oriented toward a field of view containing a background and a hand including fingers;

at least one light source disposed on a same side of the field of view as the camera and oriented to illuminate the field of view; and

a processor coupled to the at least one camera and the light source and configured to:

activate at least one light source to illuminate the field of view containing the hand;

capture a sequence of digital images of the field of view using the at least one camera at a time when the at least one light source is activated; and

based on information obtained from the hand, constructing at least a position and a shape of the hand,

wherein the at least one light source is positioned such that hand is located within a proximal zone of the field of view, the proximal zone extending from the at least one camera to a distance at least twice an expected maximum distance between the hand and the at least one camera.

11. The wearable goggle of claim 10 wherein the proximal zone has a depth of at least four times the expected maximum distance.

12. The wearable goggle of claim 10 wherein the at least one light source is a diffuse emitter.

13. The wearable goggle of claim 10 wherein the at least one light source is an infrared light-emitting diode and the at least one camera is an infrared-sensitive camera.

14. The wearable goggle of claim 10 wherein at least two light sources are activated, and the at least two light sources flank the at least one camera and are substantially coplanar therewith.

15. The wearable goggle of claim 10 wherein the at least one camera and the at least one light source are oriented horizontally outward with respect to a wearable goggle.

16. A wearable goggle, comprising:

at least one camera oriented toward a field of view containing a background and a hand including fingers;

at least one light source disposed on a same side of the field of view as the camera and oriented to illuminate the field of view; and

a processor coupled to the at least one camera and the light source and configured to:

activate the at least one light source to illuminate the field of view containing the hand;

capture a sequence of digital images of the field of view using that at least one camera at a time when the at least one light source is activated;

based on information obtained from the hand, construct at least a position and shape of the hand; and

capture a first image when the at least one light source is not activated, a second image when the at least one light source is activated, and a third image when the at least one light source is not activated, wherein pixels corresponding to the hand are identified based on a difference between the second and first images and a difference between the second and third images.

Assignments (13)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
RELEASE OF SECURITY INTEREST Recorded Mar 27, 2026
From: TRIPLEPOINT CAPITAL LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 075288/0632 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0604 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0573 →
SECURITY INTEREST Recorded Jun 10, 2020
From: LMI LIQUIDATING CO., LLC
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 052902/0571 →
SECURITY INTEREST Recorded Jun 5, 2020
From: ULTRAHAPTICS IP TWO LIMITED
To: LMI LIQUIDATING CO., LLC
Reel/Frame 052848/0240 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO., LLC.
Reel/Frame 052914/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LMI LIQUIDATING CO., LLC.
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 051580/0165 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2019
From: HAYNES BEFFEL WOLFELD LLP
To: LEAP MOTION, INC.
Reel/Frame 049926/0631 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: TRIPLEPOINT CAPITAL LLC
To: LEAP MOTION, INC.
Reel/Frame 049337/0130 →
SECURITY INTEREST Recorded Apr 11, 2019
From: LEAP MOTION, INC.
To: HAYNES BEFFEL WOLFELD LLP
Reel/Frame 048919/0109 →
SECOND AMENDMENT TO PLAIN ENGLISH INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Sep 21, 2018
From: LEAP MOTION, INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 047123/0666 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2018
From: HOLZ, DAVID; YANG, HUA
To: LEAP MOTION, INC.
Reel/Frame 045464/0116 →
Continuity (11)
Continuation 15586048 · May 3, 2017
Continuation 15349864 · Nov 11, 2016
Continuation 14959891 · Dec 4, 2015
Continuation 14106148 · Dec 13, 2013
Continuation 13742845 · Jan 16, 2013
Continuation In Part 13724357 · Dec 21, 2012
Continuation In Part 13414485 · Mar 7, 2012
Provisional Application 61587554 · Jan 17, 2012
Provisional Application 61724091 · Nov 8, 2012
Provisional Application 61724068 · Nov 8, 2012
Related Publication 20190012564A1 · Jan 10, 2019
Cited By (3)
US 12,260,023 US 12,306,301 US 12,693,717