IP Library Granted Patent US 11,775,033
Granted Patent B2
US 11,775,033 · App. 17/901,542 · Granted Oct 3, 2023

Enhanced field of view to augment three-dimensional (3D) sensory space for free-space gesture interpretation

Inventors: David S. Holz (San Francisco, CA); Paul Durdik (Foster City, CA)
Assignee: Ultrahaptics IP Two Limited
G06F1/1686G02B5/04G02B5/045G02B7/1805G06F3/005G06F3/017G06F3/0425H04N23/67H04N23/90G06F2200/1633
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,775,033
App. No.
17/901,542
Filed
Sep 1, 2022
Granted
Oct 3, 2023
Kind
B2
Art Unit
2693
USPC
348/369
Abstract

The technology disclosed relates to enhancing the fields of view of one or more cameras of a gesture recognition system for augmenting the three-dimensional (3D) sensory space of the gesture recognition system. The augmented 3D sensory space allows for inclusion of previously uncaptured of regions and points for which gestures can be interpreted i.e. blind spots of the cameras of the gesture recognition system. Some examples of such blind spots include areas underneath the cameras and/or within 20-85 degrees of a tangential axis of the cameras. In particular, the technology disclosed uses a Fresnel prismatic element and/or a triangular prism element to redirect the optical axis of the cameras, giving the cameras fields of view that cover at least 45 to 80 degrees from tangential to the vertical axis of a display screen on which the cameras are mounted.

Claims (48)

1. An apparatus for space imaging, mounted relative to a display that has a vertical axis, comprising:

a camera with an optical axis facing within 20 degrees of tangential to the vertical axis of the display;

at least one optical element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 45 to 80 degrees from tangential to the vertical axis of the display; and

a camera controller coupled to the camera determines a position of at least one control object within the field of view of the camera.

2. The apparatus of claim 1 , further comprising:

a bender that bends or reorients the optical element of the camera to modify the optical axis of the camera.

3. The apparatus of claim 1 , further comprising:

at least one illumination source; and

the optical element that redirects the illumination source to cover an effective area of the field of view of the camera.

4. The apparatus of claim 1 , further comprising:

the optical element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 20 to 85 degrees from tangential to the vertical axis of the display.

5. The apparatus of claim 1 , further comprising:

a second camera mounted to the display with an optical axis facing within 20 degrees of tangential to the vertical axis of the display, wherein the second camera is different from the camera of claim 1 ; and

the optical element does not redirect the optical axis of the second camera.

6. The apparatus of claim 1 , wherein the display is at least one of planar or cylindrical.

7. The apparatus of claim 1 , wherein the optical element comprises an optical film.

8. An apparatus mountable to a display for space imaging, mounted relative to a display that has a vertical axis, comprising:

a camera with optical axis facing within 20 degrees of tangential to the vertical axis of the display;

at least one prismatic optical element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 45 to 80 degrees from tangential to the vertical axis of the display; and

a camera controller coupled to the camera that determines a position of at least one control object within the field of view of the camera.

9. The apparatus of claim 8 , further comprising:

modifying the optical axis of the camera.

10. The apparatus of claim 8 , further comprising:

at least one illumination source; and

the prismatic optical element that redirects the illumination source to cover an effective area of the field of view of the camera.

11. The apparatus of claim 8 , further comprising:

the prismatic optical element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 20 to 85 degrees from tangential to the vertical axis of the display.

12. The apparatus of claim 8 , further comprising:

at least one camera mounted to the display with an optical axis facing within 20 degrees of tangential to the vertical axis of the display, wherein the camera is different from the camera of claim 8 ; and

the prismatic optical element does not redirect the optical axis of the camera.

13. The apparatus of claim 8 , wherein the display is at least one of planar or cylindrical.

14. The apparatus of claim 8 , wherein the prismatic optical element comprises an optical film.

15. A portable electronic device with a display screen, comprising:

the display screen that has a vertical axis;

one camera with an optical axis facing within 20 degrees of tangential to the vertical axis of the display screen;

an optical element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 45 to 80 degrees from tangential to the vertical axis of the display screen; and

a camera controller coupled to the camera that determines a position of at least one control object within the field of view of the camera.

16. The portable electronic device of claim 15 , wherein the optical element comprises an optical film.

17. The portable electronic device of claim 15 , further comprising:

a bender that bends or reorients the optical element of the camera to modify the optical axis of the camera.

18. The portable electronic device of claim 15 , further comprising:

at least one illumination source; and

the optical element that redirects the illumination source to cover an effective area of the field of view of the camera.

19. The portable electronic device of claim 15 , further comprising:

the optical element that redirects the optical axis of the camera, giving the camera a field of view that covers at least 20 to 85 degrees from tangential to the vertical axis of the display screen.

20. The portable electronic device of claim 15 , further comprising:

at least one other camera mounted to the portable electronic device with an optical axis facing within 20 degrees of tangential to the vertical axis of the display screen, wherein the other camera is different from the camera of claim 15 ; and

the optical element does not redirect the optical axis of the other camera.

Assignments (6)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0793 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0573 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2022
From: HOLZ, DAVID S.; DURDIK, PAUL A.
To: LEAP MOTION, INC.
Reel/Frame 060981/0782 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2022
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO. LLC
Reel/Frame 060981/0851 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2022
From: LMI LIQUIDATING CO. LLC
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 060981/0907 →
Continuity (6)
Continuation 17189111 · Mar 1, 2021
Continuation 16283693 · Feb 22, 2019
Continuation 15493091 · Apr 20, 2017
Continuation 14506596 · Oct 3, 2014
Provisional Application 61886586 · Oct 3, 2013
Related Publication 20220413566A1 · Dec 29, 2022