IP Library Patent Application 15159746
Patent Application
App. No. 15/159,746

ACOUSTO-OPTICAL DISPLAY FOR AUGMENTED REALITY

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/159,746
Abstract

A system and method for an acousto-optical display for augmented reality are described. In some embodiments, a viewing device includes a transparent acousto-optical display and an augmented reality (AR) device. The transparent acousto-optical display displays virtual content. The augmented reality (AR) device dynamically adjusts optical properties of the transparent acousto-optical display and controls a depth of field of the virtual content displayed in the transparent acousto-optical display based on the optical properties.

Claims (54)

1 . A viewing device comprising:

a transparent acousto-optical display configured to display virtual content; and

an augmented reality (AR) device coupled to the transparent acousto-optical display, the AR device comprising a hardware processor including an AR application configured to dynamically adjust optical properties of the transparent acousto-optical display and control a depth of field of the virtual content displayed in the transparent acousto-optical display based on the optical properties.

2 . The viewing device of claim 1 , wherein the transparent acousto-optical display comprises a transparent display coupled to an optical element, and

wherein the AR application is configured to dynamically adjust optical properties of the optical element to control the depth of field of the virtual content displayed in the transparent display.

3 . The viewing device of claim 2 , wherein the AR device comprises:

a sensor configured to capture an image of an object viewed by a user of the viewing device through the transparent acousto-optical display, and to determine a focal depth of the object relative to the transparent acousto-optical display;

a display controller coupled to the transparent display, the display controller being configured to communicate the virtual content to be displayed in the transparent display; and

an acousto-optical modulator coupled to the optical element, the acousto-optical modulator being configured to generate and modulate a frequency of a signal to the optical element to dynamically adjust a density of a material of the optical element and affect diffraction properties of the optical element, the diffraction properties of the optical element affecting the depth of field of the virtual content displayed in the transparent display.

4 . The viewing device of claim 3 , wherein the AR application comprises:

a recognition module configured to identify the object depicted in the image captured with the sensor;

an AR rendering module configured to retrieve the virtual content associated with the object, and to communicate a three-dimensional model of the virtual content to the display controller; and

a dynamic depth encoder configured to determine the frequency of the signal based on the focal depth of the object relative to the transparent acousto-optical display, and to communicate the determined frequency of the signal to the acousto-optical modulator.

5 . The viewing device of claim 4 , wherein the AR rendering module comprises:

an AR content module configured to access the three-dimensional model of the virtual content from a library of virtual content; and

an AR visualization module configured to render the three-dimensional model of the virtual content.

6 . The viewing device of claim 4 , wherein the dynamic depth encoder comprises:

an AR size computation module configured to compute a size of the three-dimensional model of the virtual content based on the depth of the object; and

a depth computation module configured to compute a depth of field of the three-dimensional model of the virtual content based on the focal depth of the object.

7 . The viewing device of claim 6 , wherein the dynamic depth encoder is configured to monitor the focal depth of the object and to dynamically adjust at least one of the size of the three-dimensional model of the virtual content and the depth of field of the three-dimensional model of the virtual content based on the monitored focal depth of the object.

8 . The viewing device of claim 2 , wherein the transparent display comprises at least one of a transparent organic light-emitting diode (OLED) and a reflective display coupled to a projection device external to the reflective display.

9 . The viewing device of claim 2 , wherein the optical element comprises at least one of a transparent waveguide and a holographic grating.

10 . The wearable device of claim 1 , wherein the viewing device comprises a transparent visor of a helmet, the transparent visor including the transparent acousto-optical display.

11 . A method comprising:

adjusting optical properties of a transparent acousto-optical display;

controlling a depth of field of virtual content in a transparent acousto-optical display based on the optical properties; and

displaying the virtual content with the corresponding depth of field in the transparent acousto-optical display.

12 . The method of claim 11 , further comprising:

dynamically adjusting optical properties of an optical element of the transparent acousto-optical display to control the depth of field of the virtual content displayed in a transparent display coupled to the optical element.

13 . The method of claim 12 , further comprising:

capturing an image of an object viewed by a user of the viewing device through the transparent acousto-optical display with a sensor;

determining a focal depth of the object relative to the transparent acousto-optical display;

communicating the virtual content to a display controller coupled to the transparent display; and

generating and modulating a frequency of a signal to the optical element with an acousto-optical modulator coupled to the optical element, the acousto-optical modulator configured to dynamically adjust a density of a material of the optical element and affect diffraction properties of the optical element, the diffraction properties of the optical element affecting the depth of field of the virtual content displayed in the transparent display.

14 . The method of claim 13 , further comprising:

identifying the object depicted in the image captured with the sensor;

retrieving the virtual content associated with the object;

communicating a three-dimensional model of the virtual content to the display controller; and

determining the frequency of the signal based on the focal depth of the object relative to the transparent acousto-optical display, and to communicate the determined frequency of the signal to the acousto-optical modulator.

15 . The method of claim 14 , further comprising:

accessing the three-dimensional model of the virtual content from a library of virtual content; and

rendering the three-dimensional model of the virtual content.

16 . The method of claim 14 , further comprising:

computing a size of the three-dimensional model of the virtual content based on the focal depth of the object; and

computing a depth of field of the three-dimensional model of the virtual content based on the focal depth of the object.

17 . The method of claim 16 , further comprising:

monitoring the focal depth of the object; and

dynamically adjusting at least one of the size of the three-dimensional model of the virtual content and the depth of field of the three-dimensional model of the virtual content based on the monitored focal depth of the object.

18 . The method of claim 12 , wherein the transparent display comprises at least one of a transparent organic light-emitting diode (OLED) and a reflective display coupled to a projection device external to the reflective display.

19 . The method of claim 12 , wherein the optical element comprises at least one of a transparent waveguide and a holographic grating.

20 . A non-transitory machine-readable storage medium, tangibly embodying a set of instructions that, when executed by at least one processor, causes the at least one processor to perform a set of operations comprising:

adjusting optical properties of a transparent acousto-optical display;

controlling a depth of field of virtual content in a transparent acousto-optical display based on the optical properties; and

displaying the virtual content with the corresponding depth of field in the transparent acousto-optical display.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2016
From: MULLINS, BRIAN
To: DAQRI, LLC
Reel/Frame 039385/0473 →