IP Library Granted Patent US 9,632,572
Granted Patent B2
US 9,632,572 · App. 14/506,596 · Granted Apr 25, 2017

Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,632,572
App. No.
14/506,596
Filed
Oct 3, 2014
Granted
Apr 25, 2017
Kind
B2
Art Unit
2627
USPC
345/156
Abstract

The technology disclosed relates to enhancing the fields of view of one or more cameras of a gesture recognition system for augmenting the three-dimensional (3D) sensory space of the gesture recognition system. The augmented 3D sensory space allows for inclusion of previously uncaptured of regions and points for which gestures can be interpreted i.e. blind spots of the cameras of the gesture recognition system. Some examples of such blind spots include areas underneath the cameras and/or within 20-85 degrees of a tangential axis of the cameras. In particular, the technology disclosed uses a Fresnel prismatic element and/or a triangular prism element to redirect the optical axis of the cameras, giving the cameras fields of view that cover at least 45 to 80 degrees from tangential to the vertical axis of a display screen on which the cameras are mounted.

Claims (48)

1. A rim mounted space imaging apparatus, mounted in a rim of a display that has a vertical axis, comprising:

two cameras mounted in the rim of a display with optical axes facing within 20 degrees of tangential to a vertical axis of the display;

at least one Fresnel prismatic element that redirects the optical axes of the cameras, giving each camera a field of view that covers at least 45 to 80 degrees from tangential to the vertical axis of the display; and

a camera controller coupled to the two cameras that compensates for redirection by the Fresnel prismatic element and determines a position of at least one control object within the camera fields of view.

2. The apparatus of claim 1 , further comprising:

a bender that bends or reorients the Fresnel prismatic element of at least one of the cameras to modify the relative optical axes of the two cameras mounted in the rim of the display.

3. The apparatus of claim 1 , further comprising:

at least one illumination source; and

the Fresnel prismatic element that redirects the illumination source to cover an effective area of the camera fields of view.

4. The apparatus of claim 1 , further comprising:

the Fresnel prismatic element that redirects the optical axes of the cameras, giving each camera a field of view that covers at least 20 to 85 degrees from tangential to the vertical axis of the display.

5. The apparatus of claim 1 , further comprising:

at least one camera mounted in the rim of the display with an optical axis facing within 20 degrees of tangential to a vertical axis of the display, wherein the camera is different from the two cameras of claim 1 ; and

the Fresnel prismatic element does not redirect the optical axis of the camera.

6. The apparatus of claim 1 , wherein the display is at least one of planar or cylindrical.

7. The apparatus of claim 1 , wherein the Fresnel prismatic element is an optical film.

8. A rim mounted space imaging apparatus, mounted in a rim of a display that has a vertical axis, comprising:

two cameras mounted in the rim of a display with optical axes facing within 20 degrees of tangential to a vertical axis of the display;

at least one triangular solid prism that redirects the optical axes of the cameras, giving each camera a field of view that covers at least 45 to 80 degrees from tangential to the vertical axis of the display; and

a camera controller coupled to the two cameras that compensates for redirection by the triangular solid prism and determines a position of at least one control object within the camera fields of view.

9. The apparatus of claim 8 , further comprising:

a bender that bends or reorients the triangular solid prism of at least one of the cameras to modify the relative optical axes of the two cameras mounted in the rim of the display.

10. The apparatus of claim 8 , further comprising:

at least one illumination source; and

the triangular solid prism that redirects the illumination source to cover an effective area of the camera fields of view.

11. The apparatus of claim 8 , further comprising:

the triangular solid prism that redirects the optical axes of the cameras, giving each camera a field of view that covers at least 20 to 85 degrees from tangential to the vertical axis of the display.

12. The apparatus of claim 8 , further comprising:

at least one camera mounted in the rim of the display with an optical axis facing within 20 degrees of tangential to a vertical axis of the display, wherein the camera is different from the two cameras of claim 8 ; and

the triangular solid prism does not redirect the optical axis of the camera.

13. The apparatus of claim 8 , wherein the display is at least one of planar or cylindrical.

14. The apparatus of claim 8 , wherein the triangular solid prism is an optical film.

15. A portable electronic device with a bezel for a display screen, comprising:

a bezel for a display screen that has a vertical axis;

at least one camera mounted in the bezel with optical axis facing within 20 degrees of tangential to the vertical axis of the display screen;

a Fresnel prismatic element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 45 to 80 degrees from tangential to the vertical axis of the display screen; and

a camera controller coupled to the camera that compensates for redirection by the Fresnel prismatic element and determines a position of at least one control object within the camera field of view.

16. The apparatus of claim 15 , wherein the Fresnel prismatic element is an optical film.

17. The portable electronic device of claim 15 , further comprising:

a bender that bends or reorients the Fresnel prismatic element of the camera to modify the optical axis of the camera.

18. The portable electronic device of claim 15 , further comprising:

at least one illumination source; and

the Fresnel prismatic element that redirects the illumination source to cover an effective area of the camera field of view.

19. The portable electronic device of claim 15 , further comprising:

the Fresnel prismatic element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 20 to 85 degrees from tangential to the vertical axis of the display screen.

20. The portable electronic device of claim 15 , further comprising:

at least one other camera mounted in the bezel with an optical axis facing within 20 degrees of tangential to a vertical axis of the display screen, wherein the other camera is different from the camera of claim 14 ; and

the Fresnel prismatic element does not redirect the optical axis of the other camera.

Assignments (16)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
RELEASE OF SECURITY INTEREST Recorded Mar 27, 2026
From: TRIPLEPOINT CAPITAL LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 075288/0632 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0604 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0573 →
SECURITY INTEREST Recorded Jun 10, 2020
From: LMI LIQUIDATING CO., LLC
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 052902/0571 →
SECURITY INTEREST Recorded Jun 5, 2020
From: ULTRAHAPTICS IP TWO LIMITED
To: LMI LIQUIDATING CO., LLC
Reel/Frame 052848/0240 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO., LLC.
Reel/Frame 052914/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LMI LIQUIDATING CO., LLC.
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 051580/0165 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2019
From: HAYNES BEFFEL WOLFELD LLP
To: LEAP MOTION, INC.
Reel/Frame 049926/0631 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: TRIPLEPOINT CAPITAL LLC
To: LEAP MOTION, INC.
Reel/Frame 049337/0130 →
SECURITY INTEREST Recorded Apr 11, 2019
From: LEAP MOTION, INC.
To: HAYNES BEFFEL WOLFELD LLP
Reel/Frame 048919/0109 →
TERMINATION OF SECURITY AGREEMENT Recorded Nov 7, 2018
From: THE FOUNDERS FUND IV, LP, AS COLLATERAL AGENT
To: LEAP MOTION, INC.
Reel/Frame 047444/0567 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ORIGINAL ASSIGNMENT DOCUMENT PREVIOUSLY RECORDED ON REEL 035409 FRAME 0081. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNORS INTEREST. Recorded Jul 21, 2016
From: HOLZ, DAVID S.; DURDIK, PAUL A.
To: LEAP MOTION, INC.
Reel/Frame 039427/0992 →
SECURITY INTEREST Recorded Oct 6, 2015
From: LEAP MOTION, INC.
To: THE FOUNDERS FUND IV, LP
Reel/Frame 036796/0151 →
SECURITY INTEREST Recorded Sep 21, 2015
From: LEAP MOTION, INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 036644/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2015
From: HOLZ, DAVID S.; DURDIK, PAUL A.
To: LEAP MOTION, INC.
Reel/Frame 035409/0081 →