IP Library Granted Patent US 11,698,605
Granted Patent B2
US 11,698,605 · App. 17/200,681 · Granted Jul 11, 2023

Holographic reality system, multiview display, and method

Inventor: David A. Fattal (Menlo Park, CA)
Assignee: LEIA INC.
G03H1/0005G06F3/016G06F3/017G06F3/04812G03H2001/0061G03H2226/05
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,698,605
App. No.
17/200,681
Granted
Jul 11, 2023
Kind
B2
Abstract

A holographic reality system and multiview display monitor a user position and provide virtual haptic feedback to the user. The holographic reality system includes a multiview display configured to display a multiview image, a position sensor configured to monitor the user position, and a virtual haptic feedback unit configured to provide the virtual haptic feedback. An extent of the virtual haptic feedback corresponds to an extent of a virtual control within the multiview image. The holographic reality multiview display includes an array of multiview pixels configured to provide different views of the multiview image by modulating directional light beams having directions corresponding to the different views and an array of multibeam elements configured to provide the directional light beams to corresponding multiview pixels.

Claims (28)

1. A holographic reality system, comprising:

a multiview display configured to display multiview content as a multiview image and further configured to provide a plurality of directional light beams corresponding to a plurality of different views of the multiview display, the plurality of directional light beams having different principal angular directions from one another corresponding to different view directions of the different views, the multiview display comprising a light guide configured to guide light in a propagation direction along a length of the light guide as guided light, the multiview display further comprising a plurality of multibeam elements distributed along the length of the light guide, a multibeam element of the multibeam element plurality being configured to scatter out from the light guide a portion of the guided light as the plurality of directional light beams having the different principal angular directions of the different views;

a position sensor configured to monitor a position of a hand of a user and provide a monitored position of the hand, the monitored position being provided by the position sensor without contact between the user and the holographic reality system; and

a virtual haptic feedback unit configured to provide virtual haptic feedback to the user based on the monitored position, the virtual haptic feedback being provided using one or more of ultrasonic pressure and air pressure without contact between the user and holographic reality system,

wherein an extent of the virtual haptic feedback corresponds to an extent of a virtual control within the multiview image.

2. The holographic reality system of claim 1 , wherein the holographic reality system is configured to modify the displayed multiview content according to the monitored position.

3. The holographic reality system of claim 1 , wherein the position sensor comprises one or more of a capacitive sensor, a plurality of image sensors, and a time-of-flight sensor.

4. The holographic reality system of claim 3 , wherein the time-of-flight sensor is configured to use one or more of a radio frequency, a microwave signal, an acoustic signal, an infrared signal, and another optical signal.

5. The holographic reality system of claim 1 , wherein the position sensor is configured to detect motion of one or more digits of the hand.

6. The holographic reality system of claim 1 , wherein the position sensor is configured to detect a gesture by the user corresponding to a command.

7. The holographic reality system of claim 1 , wherein the virtual haptic feedback unit is configured to provide information about activation of the virtual control in the multiview content in response to the monitored position.

8. The holographic reality system of claim 1 , wherein the multiview display further comprises an array of multiview pixels, each including a plurality of sub-pixels configured to provide the different views by modulating directional light beams of the plurality of directional light beams.

9. The holographic reality system of claim 1 , wherein the multiview display further comprises a light source optically coupled to an input of the light guide, the light source being configured to provide the light to be guided as the guided light.

10. A holographic reality multiview display comprising:

an array of multiview pixels configured to provide a plurality of different views of a multiview image, a multiview pixel comprising a plurality of sub-pixels configured to modulate a plurality of directional light beams having directions corresponding to view directions of the different views;

a light guide configured to guide light in a propagation direction along a length of the light guide as guided light;

an array of multibeam elements distributed along the length of the light guide, each multibeam element being configured to scatter out from the light guide a portion of the guided light to form the plurality of directional light beams and provide the plurality of directional light beams to a corresponding multiview pixel;

a position sensor configured to monitor a position of a hand of a user relative to a virtual control within the multiview image without contact between the user and the holographic reality multiview display; and

a virtual haptic feedback unit configured to provide virtual haptic feedback to the user using one or more of ultrasonic pressure and air pressure, the virtual haptic feedback being provided based on the monitored position of the hand, an extent of the virtual haptic feedback corresponding to an extent of the virtual control.

11. The holographic reality multiview display of claim 10 , wherein the holographic reality display is configured to modify multiview content of the multiview image based on the monitored position.

12. The holographic reality multiview display of claim 10 , wherein the position sensor comprises one or more of a capacitive sensor, a plurality of image sensors, and a time-of-flight sensor.

13. The holographic reality multiview display of claim 10 , wherein the virtual control within the multiview image comprises a virtual icon and the virtual haptic feedback unit is configured to provide sensory information to the user corresponding to an activation of the virtual icon in response to the monitored position.

14. A method of holographic reality system operation, comprising:

displaying multiview content as a multiview image using a multiview display of the holographic reality system, the multiview display comprising a light guide that guides light in a propagation direction along a length of the light guide as guided light, the multiview display further comprising a plurality of multibeam elements distributed along the length of the light guide a multibeam element of the multibeam element plurality scattering out from the light guide a portion of the guided light as a plurality of directional light beams having different principal angular directions that correspond to different views of the multiview display;

monitoring a position of a hand of a user using a position sensor of the holographic reality system without physical contact between the user and the holographic reality system; and

providing virtual haptic feedback to the user using a virtual haptic feedback unit, the virtual haptic feedback being based on the monitored position of the hand and being provided using one or more of ultrasonic pressure and air pressure without physical contact between the user and the holographic reality system, wherein an extent of the virtual haptic feedback corresponds to an extent of a virtual control within the multiview image.

15. The method of holographic reality system operation of claim 14 , wherein monitoring the position of a hand using a position sensor comprises one or more of monitoring a change in capacitance corresponding to the position of the hand using a capacitive sensor, monitoring the position of the hand using image processing of images captured by different image sensors of a plurality of image sensors, and monitoring the position of the hand using reflection of a wireless signal by the hand using a time-of-flight sensor.

16. The method of holographic reality system operation of claim 14 , wherein providing virtual haptic feedback using a virtual haptic feedback unit comprises generating a physical sensation at the hand using one or more of ultrasonic pressure and air pressure, the physical sensation being generated in a region of space corresponding to the extent of the virtual haptic feedback.

Assignments (5)
SECURITY INTEREST Recorded Nov 4, 2024
From: LEIA, INC.; LEIA SPV LLC; DIMENCO HOLDING B.V.
To: LELIS, INC., AS AGENT
Reel/Frame 069296/0265 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2024
From: AON IP ADVANTAGE FUND LP, AS AGENT
To: LELIS, INC., AS AGENT
Reel/Frame 068548/0763 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2022
From: LEIA INC.
To: LEIA SPV LLC
Reel/Frame 061509/0435 →
SECURITY INTEREST Recorded Sep 22, 2022
From: LEIA SPV LLC
To: AON IP ADVANTAGE FUND LP, AS AGENT
Reel/Frame 061509/0456 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2021
From: FATTAL, DAVID A.
To: LEIA INC.
Reel/Frame 056164/0085 →
Continuity (2)
Continuation PCTUS2018053816 · Oct 1, 2018
Related Publication 20210200150A1 · Jul 1, 2021