IP Library › Granted Patent US 12,393,036
Granted Patent B2
US 12,393,036 · App. 18/768,338 · Granted Aug 19, 2025

Display device with optical waveguide and projector

Inventor: David Hayes (Robertsbridge, GB)
Assignee: Snap Inc.
G02B27/0172G02B6/34G02B27/0176H04N9/3185G02B2027/0161G06F1/163
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,393,036
App. No.
18/768,338
Granted
Aug 19, 2025
Kind
B2
Abstract

A display device for use in displaying an augmented reality image of a real-world view or a virtual reality image. The display device comprises an optical waveguide having an input optical element for receiving an image and at least one output optical element for outputting the image, a projector for generating the image, the projector being physically coupled to the optical waveguide, and a projector housing containing at least some components of the projector. The projector housing is moveable with respect to the optical waveguide. The projector housing contains the at least some components of the projector so that the image generated by the projector is fixed relative to the projector housing. The projector includes an image processor to correct the image generated by the projector and received by the input optical element of the optical waveguide dependent on a position of the projector housing relative to the optical waveguide.

Claims (41)

1. A display device for use in displaying an augmented reality image of a real-world view or a virtual reality image to a user, the display device comprising:

an optical waveguide having an input optical element for receiving an image;

a projector for generating the image, the projector being physically coupled to the optical waveguide; and

a projector housing containing at least some components of the projector, the projector housing being moveable with respect to the optical waveguide, the projector housing containing the at least some components of the projector so that the image generated by the projector is fixed relative to the projector housing,

the projector including an image processor to correct the image generated by the projector and received by the input optical element of the optical waveguide dependent on a position of the projector housing relative to the optical waveguide.

2. The display device of claim 1 , wherein the projector housing:

is rotatably attached to the optical waveguide; and

is rotatable with respect to the optical waveguide between a first relative position and a second relative position.

3. The display device of claim 2 , wherein the projector housing is coupled to the optical waveguide to rotate about the input optical element.

4. The display device of claim 2 , wherein the optical waveguide extends in a plane, and the projector housing is rotatable about an axis substantially normal to the plane of the optical waveguide.

5. The display device of claim 4 , wherein the image processor correcting the image comprises correcting an orientation of the image.

6. The display device of claim 4 , wherein the projector housing extends substantially parallel to the optical waveguide, and the projector housing is rotatable relative to the optical waveguide so that the projector housing remains substantially parallel to the optical waveguide.

7. The display device of claim 4 , wherein the projector housing is rotatable about an axis substantially parallel to the plane of the optical waveguide.

8. The display device of claim 2 , wherein the first relative position is at 90°, 180°, or 270° to the second relative position.

9. The display device of claim 2 , wherein;

a projector output element of the projector is fixed to the optical waveguide separate from the projector housing;

the projector housing rotates relative to the projector output element; and

at least one optical coupling is provided between components in the projector housing and the projector output element.

10. The display device of claim 9 , wherein the projector output element includes at least one optical component.

11. The display device of claim 1 , wherein the optical waveguide and the projector housing are configured to enable the projector housing to move with respect to the optical waveguide by translation.

12. The display device of claim 11 , wherein:

a projector output element of the projector is fixed to the optical waveguide separate from the projector housing;

the projector housing translates relative to the projector output element; and

at least one optical coupling is provided between components in the projector housing and the projector output element.

13. The display device of claim 12 , wherein the projector output element includes at least one optical component.

14. The display device of claim 1 , wherein the optical waveguide includes an output optical element configured to output the image.

15. The display device of claim 14 , wherein at least one of the input optical element and the output optical element is a surface relief diffractive element.

16. The display device of claim 14 , wherein the output optical element is adapted to output the image in a form that is expanded compared with a form of the image input to the input optical element from the projector.

17. The display device of claim 14 , wherein the optical waveguide includes a least one intermediate optical element to receive the image from the input optical element and to output the image in an expanded form to the output optical element, where the output image is expanded compared with the form of the image input to the input optical element from the projector.

18. The display device of claim 14 , wherein the projector is arranged to input the image to the input optical element on a first side of the optical waveguide, and the output optical element is arranged to output the image on a second side opposed the first side.

19. A method of displaying an augmented reality image of a real-world view or a virtual reality image to a user, the method comprising:

generating an image using a projector based on image data;

receiving the image at an input optical element of an optical waveguide;

outputting the image from at least one output optical element of the optical waveguide, the at least one output optical element occupying a region of the optical waveguide, the optical waveguide being physically coupled to the projector;

moving a projector housing with respect to the optical waveguide from a first relative position to a second relative position, the projector housing containing at least some components of the projector; and

processing the image data to correct the image generated by the projector and received by the input optical element of the optical waveguide dependent on a position of the projector housing relative to the optical waveguide.

20. A device for displaying an augmented reality image of a real-world view or a virtual reality image to a user, comprising:

a projector for projecting an image;

an optical waveguide having an input optical element and at least one output optical element occupying a region of the optical waveguide, the optical waveguide being configured to receive the image and to output the image from the at least one output optical element; and

a projector housing containing at least some components of the projector, the projector housing being moveable with respect to the optical waveguide, the projector housing containing the at least some components of the projector so that the image generated by the projector is fixed relative to the projector housing,

the projector including an image processor to correct the image generated by the projector and received by the input optical element of the optical waveguide dependent on a position of the projector housing relative to the optical waveguide.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2024
From: HAYES, DAVID
To: SNAP INC.
Reel/Frame 068031/0715 →
Continuity (3)
Continuation 17561081 · Dec 23, 2021
Provisional Application 63199427 · Dec 27, 2020
Related Publication 20240361604A1 · Oct 31, 2024
References Cited (73)
US 9132342B2 · Balachandreswaran · 2015 [cited by examiner]
US 9480919B2 · Kalaboukis · 2016 [cited by examiner]
US 9520072B2 · Sun · 2016 [cited by examiner]
US 9740006B2 · Gao · 2017 [cited by applicant]
US 10108013B2 · Wall et al. · 2018 [cited by applicant]
US 10254546B2 · Poulos · 2019 [cited by examiner]
US 10311644B2 · Rodriguez, II · 2019 [cited by applicant]
US 10339718B1 · Kamal et al. · 2019 [cited by applicant]
US 10482327B1 · Ouimet et al. · 2019 [cited by applicant]
US 10607053B1 · Boyd et al. · 2020 [cited by applicant]
US 10627565B1 · Trail · 2020 [cited by applicant]
US 10663731B2 · Son et al. · 2020 [cited by applicant]
US 10670805B2 · Tervo · 2020 [cited by examiner]
US 10996476B2 · Maimone et al. · 2021 [cited by applicant]
US 11029523B2 · Travers · 2021 [cited by applicant]
US 11054647B1 · Lin et al. · 2021 [cited by applicant]
US 11113889B1 · Castañeda et al. · 2021 [cited by applicant]
US 11125993B2 · Pennell et al. · 2021 [cited by applicant]
US 11169374B1 · Kubala et al. · 2021 [cited by applicant]
US 11209650B1 · Trail · 2021 [cited by applicant]
US 11215827B1 · Zhang · 2022 [cited by applicant]
US 11614585B2 · Huang · 2023 [cited by examiner]
US 11662582B2 · Li et al. · 2023 [cited by applicant]
US 11666825B2 · Delamont · 2023 [cited by examiner]
US 11668930B1 · Pennell et al. · 2023 [cited by applicant]
US 20100103075A1 · Kalaboukis · 2010 [cited by examiner]
US 20100149073A1 · Chaum et al. · 2010 [cited by applicant]
US 20120142415A1 · Lindsay · 2012 [cited by examiner]
US 20130044128A1 · Liu · 2013 [cited by examiner]
US 20130322810A1 · Robbins · 2013 [cited by applicant]
US 20140153103A1 · Gupta · 2014 [cited by applicant]
US 20150062715A1 · Yamada et al. · 2015 [cited by applicant]
US 20150168731A1 · Robbins · 2015 [cited by applicant]
US 20170045746A1 · Ellsworth et al. · 2017 [cited by applicant]
US 20180157051A1 · Sahlsten et al. · 2018 [cited by applicant]
US 20180249151A1 · Freeman et al. · 2018 [cited by applicant]
US 20190005733A1 · Wehner · 2019 [cited by examiner]
US 20190250407A1 · Della Nave et al. · 2019 [cited by applicant]
US 20200012031A1 · Mukawa · 2020 [cited by applicant]
US 20200150405A1 · Bates et al. · 2020 [cited by applicant]
US 20200278554A1 · Schultz et al. · 2020 [cited by applicant]
US 20210132387A1 · Stevens et al. · 2021 [cited by applicant]
US 20210231953A1 · Rodriguez, II et al. · 2021 [cited by applicant]
US 20210239982A1 · Valera · 2021 [cited by applicant]
US 20210256773A1 · Hare et al. · 2021 [cited by applicant]
US 20210304450A1 · Smith et al. · 2021 [cited by applicant]
US 20210304507A1 · Smith et al. · 2021 [cited by applicant]
US 20210306386A1 · Smith et al. · 2021 [cited by applicant]
US 20210306387A1 · Smith et al. · 2021 [cited by applicant]
US 20210319625A1 · Goodrich et al. · 2021 [cited by applicant]
US 20210390784A1 · Smith et al. · 2021 [cited by applicant]
US 20220206304A1 · Hayes · 2022 [cited by applicant]
US 20230161163A1 · Leighton · 2023 [cited by examiner]
CN 116670567A · 2023 [cited by applicant]
GB 2529003B · 2020 [cited by applicant]
WO WO2008081070A1 · 2008 [cited by applicant]
WO WO2022136638A1 · 2022 [cited by applicant]
U.S. Appl. No. 17/561,081, filed Dec. 23, 2021, Display Device With Optical Waveguide and Projector. [cited by applicant]
“U.S. Appl. No. 17/561,081, Examiner Interview Summary mailed Feb. 2, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/561,081, Examiner Interview Summary mailed Mar. 25, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/561,081, Final Office Action mailed Feb. 29, 2024”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/561,081, Non Final Office Action mailed Jan. 22, 2024”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/561,081, Notice of Allowance mailed Apr. 10, 2024”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/561,081, Response filed Feb. 22, 2024 to Non Final Office Action mailed Jan. 22, 2024”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/561,081, Response filed Mar. 26, 2024 to Final Office Action mailed Feb. 29, 2024”, 8 pgs. [cited by applicant]
“Chinese Application Serial No. 202180066542.7, Voluntary Amendment filed Dec. 8, 2023”, W/English Translation, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/EP2021/087480, International Search Report mailed Apr. 20, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/EP2021/087480, Written Opinion mailed Apr. 20, 2022”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/561,081, Supplemental Notice of Allowability mailed Jul. 24, 2024”, 2 pgs. [cited by applicant]
“Chinese Application Serial No. 202180087573.0, Voluntary Amendment filed Dec. 8, 2023”, W/English Translation, 8 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7025115, Notice of Preliminary Rejection mailed Nov. 7, 2024”, w/ English translation, 8 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7025115, Response filed Jan. 7, 2025 to Notice of Preliminary Rejection mailed Nov. 7, 2024”, w/ English Claims, 21 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7025115, Voluntary Amendment filed Jun. 5, 2024”, w/ English claims, 18 pgs. [cited by applicant]