IP Library Granted Patent US 12,253,676
Granted Patent B2
US 12,253,676 · App. 18/393,525 · Granted Mar 18, 2025

Virtual image display system with enhanced resolution for virtual reality and augmented reality devices

Inventors: Jiunn-Yiing Lai (New Taipei, TW); Feng-Chun Yeh (Taipei, TW)
Assignee: HES IP HOLDINGS, LLC
G02B27/0172G06V10/16H04N13/332H04N13/351
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,253,676
App. No.
18/393,525
Granted
Mar 18, 2025
Kind
B2
Abstract

A virtual image display system for displaying virtual images having expanded resolution and field of view is disclosed. The virtual image display system comprises a first light emitter emitting a plurality of first light signals to be projected into a viewer's eye; a first light direction modifier varying a light direction of the plurality of first light signals emitted from the first light emitter. The light direction of first light signals is varied at a first scan rate with respect to time within a first spatial range for displaying a first image frame with a predetermined number of light signals and the first scan rate is non-constant.

Claims (29)

1. A virtual image display system comprising:

a first light emitter emitting a plurality of first light signals to be projected into a viewer's first eye;

a first light direction modifier varying a light direction of the plurality of first light signals emitted from the first light emitter;

a first combiner to redirect and converge the plurality of first light signals to the viewer's first eye;

a second light emitter emits a plurality of second light signals to be projected into a viewer's second eye;

a second light direction modifier to vary a light direction of the plurality of second light signals emitted from the second light emitter; and

a second combiner to redirect and converge the plurality of second light signals to the viewer's second eye,

wherein the light direction of first light signals is varied at a first scan rate with respect to time within a first spatial range for displaying a first image frame with a predetermined number of light signals and the first scan rate is configured to be non-constant,

wherein each of the plurality of first light signals forms a pixel in the first image frame and a pixel density in the first image frame is configured to be not uniform, the first scan rate is decreased while rendering a central region of the first image frame, and the projection frequency of light emitter remains the same, such that the central region has the pixel density higher than that of a peripheral region of the first image frame,

wherein the light direction of second light signals is varied at a third scan rate with respect to time within a second spatial range for displaying a second image frame with a predetermined number of light signals and the third scan rate is configured to be non-constant; and

wherein a first light signal forming a pixel on the first image frame and a corresponding second light signal forming a pixel on the second image frame display a binocular virtual image pixel at a first depth which is related to a first angle between the first light signal and the second light signal projecting into the viewer's eyes.

2. The virtual image display system of claim 1 , wherein the light direction comprises a first coordinate component and a second coordinate component, the first coordinate component and the second coordinate component of the light direction of first light signals are respectively varied at the first scan rate and a second scan rate with respect to time within the first spatial range for displaying the first image frame with the predetermined number of light signals, and the second scan rate is configured to be non-constant.

3. The virtual image display system of claim 1 , wherein the first light direction modifier changes the first scan rate to adjust the pixel density of the first light signals in the first image frame.

4. The virtual image display system of claim 1 , wherein the first scan rate is a swing frequency with respect to an axis of rotation.

5. The virtual image display system of claim 4 , wherein the scan rate is reduced to increase a number of first light signals per cross-section area of a predetermined region in the first image frame.

6. The virtual image display system of claim 1 , wherein the first light direction modifier is a two-dimensional MEMS mirror or two one-dimensional MEMS mirrors.

7. The virtual image display system of claim 1 , wherein the first light emitter is a laser beam generator.

8. The virtual image display system of claim 1 , further comprising a first combiner to redirect and converge the plurality of first light signals to the viewer's first eye.

9. The virtual image display system of claim 8 , further comprising a first optical assembly disposed between the first light emitter and the first combiner to alter an area of a predetermined cross section of a light path of the plurality of first light signals.

10. The virtual image display system of claim 1 , further comprising:

a support structure wearable on a head of the viewer;

wherein the first light emitter, the first light direction modifier, the first combiner, the second light emitter, the second light direction modifier, and the second combiner are carried by the support structure.

11. The virtual image display system of claim 1 , further comprising:

the first light emitter to emit the plurality of first light signals to be projected into the viewer's second eye;

a second light emitter to emit a plurality of second light signals to be projected into a viewer's first eye;

a second light direction modifier to vary a light direction of the plurality of second light signals emitted from the second light emitter;

an integrated combiner to respectively redirect and converge the plurality of first light signals to the viewer's second eye and the plurality of second light signals to the viewer's first eye;

wherein the light direction of second light signals is varied at a third scan rate with respect to time within a second spatial range for displaying a second image frame with a predetermined number of light signals and the third scan rate is configured to be non-constant; and

wherein a first light signal forming a pixel on the first image frame and a corresponding second light signal forming a pixel on the second image frame display a binocular virtual image pixel at a first depth which is related to a first angle between the first light signal and the second light signal projecting into the viewer's eyes.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: HES IP HOLDINGS, LLC
To: OOMII INC.
Reel/Frame 070287/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2023
From: LAI, JIUNN-YIING; YEH, FENG-CHUN
To: HES IP HOLDINGS, LLC
Reel/Frame 065937/0021 →
Continuity (3)
Continuation 18017840
Provisional Application 63085172 · Sep 30, 2020
Related Publication 20240142778A1 · May 2, 2024
References Cited (120)
US 4953961A · Ubhayakar · 1990 [cited by applicant]
US 6454411B1 · Trumbull · 2002 [cited by applicant]
US 9319674B2 · Kim et al. · 2016 [cited by applicant]
US 9395543B2 · Lamb et al. · 2016 [cited by applicant]
US 9576398B1 · Zehner et al. · 2017 [cited by applicant]
US 9800844B2 · Nakahara et al. · 2017 [cited by applicant]
US 10222621B2 · Wang et al. · 2019 [cited by applicant]
US 10554940B1 · Ghazaryan · 2020 [cited by applicant]
US 10606161B2 · Hirata et al. · 2020 [cited by applicant]
US 11016380B2 · Hirata et al. · 2021 [cited by applicant]
US 11079601B2 · Greenberg · 2021 [cited by applicant]
US 11256092B2 · Shamir et al. · 2022 [cited by applicant]
US 11435572B2 · Yeoh et al. · 2022 [cited by applicant]
US 11493769B2 · Wen et al. · 2022 [cited by applicant]
US 20020024708A1 · Lewis et al. · 2002 [cited by applicant]
US 20020122217A1 · Nakajima · 2002 [cited by applicant]
US 20020180868A1 · Lippert · 2002 [cited by examiner]
US 20040179254A1 · Lewis et al. · 2004 [cited by applicant]
US 20080117289A1 · Schowengerdt · 2008 [cited by examiner]
US 20100103077A1 · Sugiyama et al. · 2010 [cited by applicant]
US 20100149073A1 · Chaum et al. · 2010 [cited by applicant]
US 20110032706A1 · Mukawa · 2011 [cited by applicant]
US 20110273722A1 · Charny et al. · 2011 [cited by applicant]
US 20130044101A1 · Kim et al. · 2013 [cited by applicant]
US 20140198017A1 · Lamb et al. · 2014 [cited by applicant]
US 20140211289A1 · Hino · 2014 [cited by examiner]
US 20150022783A1 · Lee et al. · 2015 [cited by applicant]
US 20150169070A1 · Harp et al. · 2015 [cited by applicant]
US 20160033771A1 · Tremblay · 2016 [cited by examiner]
US 20160150201A1 · Kilcher et al. · 2016 [cited by applicant]
US 20160178908A1 · Dobschal · 2016 [cited by applicant]
US 20160212394A1 · Nakahara et al. · 2016 [cited by applicant]
US 20160238845A1 · Alexander et al. · 2016 [cited by applicant]
US 20160284129A1 · Nishizawa et al. · 2016 [cited by applicant]
US 20160377865A1 · Alexander et al. · 2016 [cited by applicant]
US 20170078651A1 · Russell · 2017 [cited by applicant]
US 20170188021A1 · Lo et al. · 2017 [cited by applicant]
US 20170285343A1 · Belenkii et al. · 2017 [cited by applicant]
US 20170299872A1 · Ou et al. · 2017 [cited by applicant]
US 20170307890A1 · Wang et al. · 2017 [cited by applicant]
US 20180032812A1 · Sengelaub et al. · 2018 [cited by applicant]
US 20180081322A1 · Robbins et al. · 2018 [cited by applicant]
US 20180120559A1 · Yeoh et al. · 2018 [cited by applicant]
US 20180182174A1 · Choi · 2018 [cited by applicant]
US 20180246336A1 · Greenberg · 2018 [cited by applicant]
US 20180249150A1 · Takeda et al. · 2018 [cited by applicant]
US 20180252926A1 · Alexander et al. · 2018 [cited by applicant]
US 20180284441A1 · Cobb · 2018 [cited by applicant]
US 20180350032A1 · Bastani et al. · 2018 [cited by applicant]
US 20190064435A1 · Karafin et al. · 2019 [cited by applicant]
US 20190084419A1 · Suzuki et al. · 2019 [cited by applicant]
US 20190121132A1 · Shamir et al. · 2019 [cited by applicant]
US 20190146224A1 · Komori et al. · 2019 [cited by applicant]
US 20190172216A1 · Ninan et al. · 2019 [cited by applicant]
US 20190187473A1 · Tomizawa et al. · 2019 [cited by applicant]
US 20190243228A1 · Hirata et al. · 2019 [cited by applicant]
US 20190281279A1 · Peuhkurinen et al. · 2019 [cited by applicant]
US 20190285897A1 · Topliss et al. · 2019 [cited by applicant]
US 20190287495A1 · Mathur et al. · 2019 [cited by applicant]
US 20190293939A1 · Sluka · 2019 [cited by applicant]
US 20190320165A1 · French et al. · 2019 [cited by applicant]
US 20200090569A1 · Hajati et al. · 2020 [cited by applicant]
US 20200117012A1 · Wen et al. · 2020 [cited by applicant]
US 20200138518A1 · Lang · 2020 [cited by applicant]
US 20200233296A1 · Hirata et al. · 2020 [cited by applicant]
US 20200329961A1 · Oz et al. · 2020 [cited by applicant]
US 20210003900A1 · Chen · 2021 [cited by applicant]
US 20210055555A1 · Chi et al. · 2021 [cited by applicant]
US 20220311992A1 · Lai et al. · 2022 [cited by applicant]
US 20220326513A1 · Yeoh et al. · 2022 [cited by applicant]
US 20230049899A1 · Yeh et al. · 2023 [cited by applicant]
CN 102595178A · 2012 [cited by applicant]
CN 106371218A · 2017 [cited by applicant]
CN 107347152A · 2017 [cited by applicant]
CN 107438796A · 2017 [cited by applicant]
CN 108427498A · 2018 [cited by applicant]
CN 109073901A · 2018 [cited by applicant]
CN 109477961A · 2019 [cited by applicant]
CN 109716244A · 2019 [cited by applicant]
CN 110168419A · 2019 [cited by applicant]
CN 110168427A · 2019 [cited by applicant]
JP H4501927A · 1992 [cited by applicant]
JP H08166556A · 1996 [cited by applicant]
JP H09105885A · 1997 [cited by applicant]
JP 2004527793A · 2004 [cited by applicant]
JP 2007121581A · 2007 [cited by applicant]
JP 2010117542A · 2010 [cited by applicant]
JP 2011013688A · 2011 [cited by applicant]
JP 5925389B2 · 2016 [cited by applicant]
JP 2016180939A · 2016 [cited by applicant]
JP 2017056933A · 2017 [cited by applicant]
JP 2018508036A · 2018 [cited by applicant]
JP 2018132756A · 2018 [cited by applicant]
JP 2018533062A · 2018 [cited by applicant]
JP 2020509790A · 2020 [cited by applicant]
KR 20120069133A · 2012 [cited by applicant]
TW 201310974A · 2013 [cited by applicant]
TW 201435654A · 2014 [cited by applicant]
TW 201716827A · 2017 [cited by applicant]
TW 201738618A · 2017 [cited by applicant]
TW 201809214A · 2018 [cited by applicant]
TW 202016603A · 2020 [cited by applicant]
WO 9104508A2 · 1991 [cited by applicant]
WO 2016105281A1 · 2016 [cited by applicant]
WO 2018175265A1 · 2018 [cited by applicant]
WO 2021092314A1 · 2021 [cited by applicant]
WO 2022170284A1 · 2022 [cited by applicant]
PCT/US2020/059317 Isr and Written Opinion issued on Feb. 5, 2021. [cited by applicant]
TW 109141615 Non-Final Office Action issued on Aug. 23, 2022. [cited by applicant]
PCT/US2021/052750 International Search Report and Written Opinion issued on Dec. 28, 2021. [cited by applicant]
PCT/US2021/052750 International Preliminary Report issued on Dec. 6, 2022. [cited by applicant]
TW 110136602 Non-Final Office Action issued on Jun. 14, 2023. [cited by applicant]
PCT/US2022/015717 International Search Report and Written Opinion isuued on May 23, 2022. [cited by applicant]
Kim, J et al., “Foveated AR: Dynamically-Foveated Augmented Reality Display” pp. 1-15 [online]. Jul. 12, 2019; ACM Transactions on Graphics vol. 38, Issue 4 [Retrieved on Apr. 9, 2022]. Retrieved from the internet <url:… [cited by applicant]
TW 111104638 office action issued on Aug. 30, 2023. [cited by applicant]
EP 20886006.4 European Search Report issued on Nov. 21, 2023. [cited by applicant]
TW 112112456 Non Final Office aciton issued on Nov. 27, 2023. [cited by applicant]
EP 22750600.3 European Search Report issued on Jan. 30, 2024. [cited by applicant]
Japanese Office Action, dated Jun. 4, 2024 in a counterpart Japanese patent application, No. 2022-506646. [cited by applicant]
European Search Report for the corresponding EP application No. EP 21876437.1, issued on Sep. 30, 2024. [cited by applicant]