IP Library Granted Patent US 12,422,674
Granted Patent B2
US 12,422,674 · App. 16/907,070 · Granted Sep 23, 2025

Head mounted augmented reality system, apparatus and device with freeform surfaced optical combiner

Inventors: Ke Xu (San Jose, CA); Peng Shao (San Jose, CA)
Assignee: Firefly Dimension Inc.
G02B27/0172G02B27/017G02B27/0176G02B2027/013G02B2027/0159
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,422,674
App. No.
16/907,070
Granted
Sep 23, 2025
Kind
B2
Abstract

An augmented reality device includes two optical combiners configured to correspond to two eyes of a user respectively, each of the two optical combiners comprising an internal surface for reflecting light from the image source to a respective eye of the user, wherein the internal surface is a freeform surface with a surface function that is based on an XY-polynomial including at least one multivariate monomial; an image source positioned above the eyes of the user to emit light onto the optical combiners, wherein the image source comprises two active displaying areas which are on two different planes; and a housing structure configured to maintain relative position and orientation of the optical combiners and the image source.

Claims (65)

1. An augmented reality device comprising two optical combiners, an image source, and a housing structure, wherein:

the two optical combiners are configured to correspond to two eyes of a user respectively, each of the two optical combiners comprising an internal surface for reflecting light from the image source to a respective eye of the user, and an external surface for allowing light from real-world to enter the respective optical combiner, wherein each of the external surface and the internal surface is a freeform surface with a surface function that is based on an XY-polynomial including at least one multivariate monomial, wherein the surface functions of the external surfaces and the internal surfaces of the two optical combiners reads:

z

=

c

r

2

1

+

1

-

(

1

+

k

)

c

2

r

2

+

c

j

x

m

y

n

where z is a sag of a surface parallel to a z-axis, x and y are coordinates in a coordinate system for the corresponding optical combiner, c is a vertex curvature, k is a conic constant, r equals

x

2

+

y

2

,

c j is a coefficient of j-th monomial x m y n , and m and n are non-negative integers;

each of the surface functions of the external surfaces is optimized by using ray tracing and is based on a design of the corresponding internal surface and a refraction index of a material for the two optical combiners;

each of the two optical combiners comprises a first local curvature on the internal surface corresponding to an outward vision field and a second local curvature on the internal surface corresponding to an inward vision field;

the image source is positioned above the eyes of the user, the image source configured to emit light onto the internal surfaces of the two optical combiners, wherein the image source comprises two active displaying areas which are on two different planes;

the image source comprises two independent display panels respectively corresponding to the eyes of the user;

each of the two active displaying areas is a portion or the entirety of a respective one of the two independent display panels, and each independent display panel is associated with a respective one of the two optical combiners;

the two independent display panels are not coplanar and are arranged with respect to a reference plane formed by a horizontal axis and a longitudinal axis; each of the two independent display panels has a lower edge coinciding with the reference plane; each display surface of the two independent display panels forms a first angle with the reference plane at a lower edge of each independent display panel, wherein the first angle is between forty-five degrees and ninety degrees; wherein each of the lower edges of the two independent display panels forms a second angle with the horizontal axis, wherein the second angle from the horizontal axis to a left display panel of the two independent display panels is counterclockwise, and the second angle from the horizontal axis to a right display panel of the two independent display panels is clockwise; and

the housing structure is configured to maintain relative position and orientation of the two optical combiners and the image source.

2. The augmented reality device of claim 1 , wherein each of the two active displaying areas is angled, about a vertical axis, an absolute value between zero and forty-five degrees.

3. The augmented reality device of claim 1 , wherein each of the active displaying areas is angled, about the longitudinal axis, an absolute value between zero and forty-five degrees.

4. The augmented reality device of claim 1 , wherein the image source comprises a Liquid Crystal Display, a Micro-LED display, an Organic Light Emitting Diode display, or an Active-Matrix Organic Light-Emitting Diode display.

5. The augmented reality device of claim 1 , wherein:

the internal surface is coated with a partially-reflective-partially-transmissive layer;

the external surface is coated with an anti-reflective layer; and

each of the two optical combiners further comprises a translucent substrate between the internal surface and the external surface.

6. The augmented reality device of claim 1 , wherein:

the surface function has parameters that include a vertex curvature, a conic constant, and a constant associated with the multivariate monomial, wherein the parameters are each non-zero.

7. The augmented reality device of claim 1 , wherein the housing structure further comprises a headband configured to maintain the relative position and orientation of the two optical combiners and the image source relative to the user's head.

8. The augmented reality device of claim 1 , wherein the housing structure comprises an optical fixture configured to permit each of the two optical combiners to:

rotate about a horizontal axis to be maintained in a rotated position to reflect light to the respective eye of the user or to hide an augmented image from the respective eye of the user.

9. The augmented reality device of claim 1 , wherein the housing structure comprises an optical fixture configured to permit each of the two optical combiners to: be detached from the housing structure.

10. The augmented reality device of claim 1 , wherein the housing structure further comprises a film-light valve that controls a level of transparency of a substrate of each of the two optical combiners.

11. The augmented reality device of claim 1 , further comprising:

a computational device connected to the image source, the computational device configured to generate images to be presented by the image source on the internal surfaces of the two optical combiners; and

a power source configured to provide power to the image source and the computational device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2022
From: XU, KE; SHAO, PENG
To: FIREFLY DIMENSION INC.
Reel/Frame 062225/0695 →
Continuity (2)
Provisional Application 62864347 · Jun 20, 2019
Related Publication 20200400956A1 · Dec 24, 2020
References Cited (38)
US 6172657B1 · Kamakura · 2001 [cited by examiner]
US 7492330B2 · Hata · 2009 [cited by examiner]
US 9170425B1 · Harrison · 2015 [cited by examiner]
US 9638836B1 · Harrison · 2017 [cited by examiner]
US 9928629B2 · Benishti et al. · 2018 [cited by applicant]
US 9946074B2 · Cakmakci et al. · 2018 [cited by applicant]
US 10317690B2 · Cheng · 2019 [cited by applicant]
US 10495879B1 · Ahuja · 2019 [cited by examiner]
US 10928633B1 · Yuan · 2021 [cited by examiner]
US 20040227703A1 · Lamvik · 2004 [cited by examiner]
US 20070236800A1 · Cakmakci · 2007 [cited by examiner]
US 20120120498A1 · Harrison · 2012 [cited by examiner]
US 20120154920A1 · Harrison · 2012 [cited by examiner]
US 20150346494A1 · Tanaka · 2015 [cited by examiner]
US 20160041394A1 · Tanaka · 2016 [cited by examiner]
US 20160062123A1 · Tanaka · 2016 [cited by examiner]
US 20160116742A1 · Wei · 2016 [cited by examiner]
US 20160147069A1 · Tanaka · 2016 [cited by examiner]
US 20170045742A1 · Greenhalgh et al. · 2017 [cited by applicant]
US 20170184852A1 · Tanaka · 2017 [cited by examiner]
US 20170193706A1 · Lo · 2017 [cited by examiner]
US 20170323615A1 · Hazra · 2017 [cited by examiner]
US 20170343818A1 · Espie et al. · 2017 [cited by applicant]
US 20180217632A1 · Tseng · 2018 [cited by examiner]
US 20190018247A1 · Gao et al. · 2019 [cited by applicant]
US 20190064524A1 · Cobb · 2019 [cited by examiner]
US 20190064526A1 · Connor · 2019 [cited by examiner]
CN 107111138A · 2017 [cited by applicant]
CN 107272184A · 2017 [cited by applicant]
CN 206638889U · 2017 [cited by applicant]
CN 109270694A · 2019 [cited by applicant]
CN 109425985A · 2019 [cited by applicant]
Jingfei Ye, Lu Chen, Xinhua Li, Qun Yuan, and Zhishan Gao, “Review of Optical Freeform Surface Representation Technique and its Application,” Optical Engineering, vol. 56, Issue 11 (Year: 2017). [cited by examiner]
International Search Report and Written Opinion for Application No. PCT/US2020/038819, mailed on Sep. 21, 2020, 10 pages. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No. PCT/US2020/038819, mailed on Dec. 30, 2021, 10 pages. [cited by applicant]
First Search for Chinese Application No. 202080045207.4 mailed on Jul. 28, 2023. [cited by applicant]
Third Office Action for Chinese Application No. 202080045207.4 mailed on Jul. 27, 2024. [cited by applicant]
Decision of Rejection for Chinese Application No. 202080045207.4 mailed on Feb. 28, 2025. [cited by applicant]