IP Library › Granted Patent US 9,922,464
Granted Patent B2
US 9,922,464 · App. 15/150,916 · Granted Mar 20, 2018

Occluded virtual image display

Inventors: Eric C. Haseltine (Silver Spring, MD); Quinn Yorklun Jen Smithwick (Pasadena, CA)
Assignee: Disney Enterprises, Inc.
G06T19/006G02B27/017G02B2027/0178G06F3/011G06F3/012G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,922,464
App. No.
15/150,916
Granted
Mar 20, 2018
Kind
B2
Abstract

Embodiments described herein include an augmented reality (AR) optical system, and associated method and computer program product, defining a field of view relative to an optical reference point. The optical system comprises an imagery display configured to display images using a received first display signal, and a beam-splitter disposed within the field of view and configured to cause the displayed images to appear in a first focal plane within the field of view. The optical system further comprises an occluding display disposed within the field of view and configured to display, based on the first display signal, occluding images in a second focal plane nearer to the beam-splitter than the first focal plane, thereby reducing environmental light at the optical reference point for at least a portion of the displayed images.

Claims (42)

1. An augmented reality (AR) optical system defining a field of view relative to an optical reference point, the optical system comprising:

an imagery display configured to display images using a received first display signal;

a beam-splitter disposed within the field of view and configured to cause the displayed images to appear in a first focal plane within the field of view; and

an occluding display disposed within the field of view and configured to display, based on the first display signal, occluding images in a second focal plane nearer to the beam-splitter than the first focal plane, thereby reducing environmental light at the optical reference point for at least a portion of the displayed images.

2. The optical system of claim 1 , further comprising:

an eyepiece disposed within the field of view on a first side of the beam-splitter and having a postive optical power; and

an objective disposed within the field of view on an opposing, second side of the beam-splitter and having a negative optical power complementary to the positive optical power.

3. The optical system of claim 2 , wherein the occluding display is disposed between the beam-splitter and the objective.

4. The optical system of claim 2 , wherein the occluding display is disposed on an opposite side of the objective from the beam-splitter.

5. The optical system of claim 1 , wherein the occluding display comprises one of a transmissive liquid crystal display (LCD), a transmissive electrowetting display, and a transmissive electronic ink (e-ink) display.

6. The optical system of claim 1 , further comprising one or more computer processors configured to:

identify, based on the first display signal, an object depicted in the displayed images; and

generate a second display signal for updating the occluding display, the second display signal depicting the object in a first region of the occluding images while a second region of the occluding images is substantially transmissive of the environmental light.

7. The optical system of claim 6 , wherein generating the second display signal for updating the occluding display comprises at least one of: (i) defocusing the identified object within the occluding images, (ii) adjusting a size of the identified object within the occluding images, and (iii) adjusting a relative position of the identified object within the occluding images.

8. A method for operating an augmented reality (AR) optical system for a viewer within an environment, the viewer having a field of view, the method comprising:

updating an imagery display using a first display signal, the imagery display configured to display images that are coupled by a beam-splitter into the field of view, the displayed images appearing in a first focal plane relative to the viewer; and

updating, in synchronization with updating the imagery display, an occluding display based on the first display signal,

the occluding display disposed within the field of view and configured to display occluding images in a second focal plane nearer to the viewer than the first focal plane, thereby reducing environmental light viewed by the viewer for at least a portion of the displayed images.

9. The method of claim 8 , wherein updating the occluding display comprises:

identifying, based on the first display signal, an object depicted in the displayed images; and

generating a second display signal for updating the occluding display, the second display signal depicting the object in a first region of the occluding images while a second region of the occluding images is substantially transmissive of the environmental light.

10. The method of claim 9 , wherein generating the second display signal for updating the occluding display comprises at least one of: (i) defocusing the identified object within the occluding images, (ii) adjusting a size of the identified object within the occluding images, and (iii) adjusting a relative position of the identified object within the occluding images.

11. The method of claim 9 , wherein identifiying an object depicted in the displayed images comprises performing image processing on the displayed images.

12. The method of claim 11 , wherein performing image processing on the displayed images comprises at least one of: (i) object detection, (ii) determining color information, and (iii) determining brightness information.

13. The method of claim 8 , further comprising:

determining, using a visual sensor, environmental brightness information,

wherein generating the second display signal comprises determining display values of the occluding images based on the determined environmental brightness information.

14. The method of claim 8 , wherein the occluding display is updated with the first display signal.

15. A computer program product for operating an augmented reality (AR) optical system defining a field of view relative to an optical reference point, the computer program product comprising:

a computer-readable device having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to:

update an imagery display using a first display signal, the imagery display configured to display images that are caused by a beam-splitter to appear in a first focal plane within the field of view; and

update, in synchronization with updating the imagery display, an occluding display based on the first display signal,

the occluding display disposed within the field of view and configured to display occluding images in a second focal plane nearer to the beam-splitter than the first focal plane, thereby reducing environmental light at the optical reference point for at least a portion of the displayed images.

16. The computer program product of claim 15 , wherein updating the occluding display comprises:

identifying, based on the first display signal, an object depicted in the displayed images; and

generating a second display signal for updating the occluding display, the second display signal depicting the object in a first region of the occluding images while a second region of the occluding images is substantially transmissive of the environmental light.

17. The computer program product of claim 16 , wherein generating the second display signal for updating the occluding display comprises at least one of: (i) defocusing the identified object within the occluding images, (ii) adjusting a size of the identified object within the occluding images, and (iii) adjusting a relative position of the identified object within the occluding images.

18. The computer program product of claim 16 , wherein identifiying an object depicted in the displayed images comprises performing image processing on the displayed images.

19. The computer program product of claim 18 , wherein performing image processing on the display images comprises at least one of: (i) object detection, (ii) determining color information, and (iii) determining brightness information.

20. The computer program product of claim 15 , wherein the computer-readable program code is further configured to:

determine, using a visual sensor, environmental brightness information,

wherein generating the second display signal comprises determining display values of the occluding images based on the determined environmental brightness information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2016
From: HASELTINE, ERIC C.; SMITHWICK, QUINN YORKLUN JEN
To: DISNEY ENTERPRISES, INC.
Reel/Frame 038538/0659 →
Continuity (1)
Related Publication 20170330376A1 · Nov 16, 2017