IP Library Granted Patent US 12,260,580
Granted Patent B2
US 12,260,580 · App. 17/796,252 · Granted Mar 25, 2025

System and method for enhancing visual acuity of head wearable displays

Inventors: Feng-Chun Yeh (Taipei, TW); Guo-Hsuan Chen (Taichung, TW); Jiunn-Yiing Lai (New Taipei, TW); Yin Chang (Taipei, TW); Po-Ya Hsu (New Taipei, TW)
Assignee: Oomii Inc.
G06T7/70G02B27/0093G02B27/017G02B27/30G06F3/013G06T15/00G06T19/006G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,580
App. No.
17/796,252
Granted
Mar 25, 2025
Kind
B2
Abstract

A head wearable display system comprising a target object detection module receiving multiple image pixels of a first portion and a second portion of a target object, and the corresponding depths; a first light emitter emitting multiple first-eye light signals to display a first-eye virtual image of the first portion and the second portion of the target object for a viewer; a first light direction modifier for respectively varying a light direction of each of the multiple first-eye light signals emitted from the first light emitter; a first collimator; a first combiner, for redirecting and converging the multiple first-eye light signals towards a first eye of the viewer. The first-eye virtual image of the first portion of the target object in a first field of view has a greater number of the multiple first-eye light signals per degree than that of the first-eye virtual image of the second portion of the target object in a second field of view.

Claims (44)

1. A head wearable display system comprising:

a target object detection module receiving multiple image pixels of a first portion and a second portion of a target object, and the corresponding depths;

a first light emitter emitting multiple first-eye light signals to display a first-eye virtual image of the first portion and the second portion of the target object for a viewer;

a first light direction modifier for respectively varying a light direction of each of the multiple first-eye light signals emitted from the first light emitter;

a first collimator, disposed between the first light emitter and the first light direction modifier, to adjust a beam waist location of each of the multiple first-eye light signals so that the multiple first-eye light signals are separable from each other;

a first combiner, for redirecting and converging the multiple first-eye light signals towards a first eye of the viewer; and

wherein the first-eye virtual image of the first portion of the target object in a first field of view has a greater number of the multiple first-eye light signals per degree than that of the first-eye virtual image of the second portion of the target object in a second field of view,

wherein the multiple first-eye light signals are separable from each other if a spatial distance between centers of any two adjacent first-eye light signals on a cross-sectional plane of light path is larger than half of a greatest diameter of the two adjacent first-eye light signals.

2. The head wearable display system of claim 1 , wherein the number of the multiple first-eye light signals per degree for the first-eye virtual image of the target object is adjusted based on the corresponding depth of the target object.

3. The head wearable display system of claim 1 , wherein the number of the multiple first-eye light signals per degree for the first-eye virtual image of the first portion of the target object in the first field of view exceeds 120.

4. The head wearable display system of claim 1 , wherein a projection duration of the first light emitter for each of the multiple first-eye light signals is varied to modify a spot size of the multiple first-eye light signals for the first-eye virtual image of the first portion of the target object.

5. The head wearable display system of claim 1 , wherein a projection frequency of the first-eye light emitter is varied to modify the number of the multiple first-eye light signals per degree for the first-eye virtual image of the first portion of the target object.

6. The head wearable display system of claim 1 , wherein a swing frequency of the first light direction modifier is varied to modify the number of the multiple first-eye light signals per degree for the first-eye virtual image of the first portion of the target object.

7. The head wearable display system of claim 6 , wherein a light direction of the multiple first-eye light signals is varied at the swing frequency with respect to time for displaying the first-eye virtual image of the target object and the swing frequency is non-constant.

8. The head wearable display system of claim 7 , wherein the light direction comprises a first coordinate component and a second coordinate component; the first coordinate component and the second coordinate component of the light direction of first-eye light signals are respectively varied at a first swing frequency and a second swing frequency with respect to time for displaying the first-eye virtual image of the target object; and the first swing frequency or the second swing frequency is non-constant.

9. The head wearable display system of claim 7 , wherein each of the multiple first-eye light signals forms a pixel in the first-eye virtual image of the target object and a pixel density in the first-eye virtual image is not uniform.

10. The head wearable display system of claim 9 , wherein the first portion of the target object is a central portion, the second portion of the target object is a peripheral portion, and the first-eye virtual image of the first portion of the target object has a pixel density higher than the first-eye virtual image of the second portion of the target object.

11. The head wearable display system of claim 1 , wherein a spot area of each of two adjacent first-eye light signals on a cross-sectional plane of light path approximately adjoins each other.

12. The head wearable display system of claim 1 , wherein the first light emitter comprises a red laser diode, a green laser diode, and a blue laser diode.

13. The head wearable display system of claim 1 , wherein a first distance between the first light direction modifier and the first collimator is varied to modify a spot size of the multiple first-eye light signals for the first-eye virtual image of the first portion of the target object.

14. The head wearable display system of claim 1 , further comprising:

a second light emitter emitting multiple second-eye light signals, corresponding to the multiple first-eye light signals, to display a second-eye virtual image of the first portion and the second portion of the target object for the viewer;

a second light direction modifier for respectively varying a light direction of each of the multiple second-eye light signals emitted from the second light emitter;

a second collimator, disposed between the second light emitter and the second light direction modifier, to adjust a beam waist location of each of the multiple second-eye light signals so that the multiple second-eye light signals are separable from each other;

wherein the first combiner receives and converges the multiple second-eye light signals towards a second eye of the viewer;

wherein the second-eye virtual image of the first portion of the target object in a third field of view has a greater number of the multiple second-eye light signals per degree than that of the second-eye virtual image of the second portion of the target object in a fourth field of view; and

wherein a first-eye light signal and a corresponding second-eye light signal are perceived by the viewer to display a virtual binocular pixel of a binocular virtual image of the target object with a depth that is related to an angle between the first-eye light signal and the corresponding second-eye light signal projected into the viewer's eyes.

15. The head wearable display system of claim 1 , further comprising:

a second light emitter emitting multiple second-eye light signals, corresponding to the multiple first-eye light signals, to display a second-eye virtual image of the first portion and the second portion of the target object for the viewer;

a second light direction modifier for respectively varying a light direction of each of the multiple second-eye light signals emitted from the second light emitter;

a second collimator, disposed between the second light emitter and the second light direction modifier, to adjust a beam waist location of each of the multiple second-eye light signals so that the multiple second-eye light signals are separable from each other;

a second combiner for redirecting and converging the multiple second-eye light signals towards a second eye of the viewer;

wherein the second-eye virtual image of the first portion of the target object in a third field of view has a greater number of the multiple second-eye light signals per degree than that of the second-eye virtual image of the second portion of the target object in a fourth field of view; and

wherein a first-eye light signal and a corresponding second-eye light signal are perceived by the viewer to display a virtual binocular pixel of a binocular virtual image of the target object with a depth that is related to an angle between the first-eye light signal and the corresponding second-eye light signal projected into the viewer's eyes.

16. The head wearable display system of claim 15 , further comprising an eye tracking device for respectively determining a visual axis of the viewer's first eye and the viewer's second eye to determine a location of fixation.

17. The head wearable display system of claim 16 , wherein a projection frequency of the first light emitter and a projection frequency of the second light emitter are varied according to the location of fixation to respectively modify the number of the multiple first-eye light signals per degree for the first-eye virtual image of the first portion of the target object and the number of the multiple second-eye light signals per degree for the second-eye virtual image of the first portion of the target object.

18. The head wearable display system of claim 16 , wherein a swing frequency of the first light direction modifier and the swing frequency of the second light direction modifier are varied according to the location of fixation to respectively modify the number of the multiple first-eye light signals per degree for the first-eye virtual image of the first portion of the target object and the number of the multiple second-eye light signals per degree for the second-eye virtual image of the first portion of the target object.

19. The head wearable display system of claim 16 , wherein a projection frequency of the first light emitter and a projection frequency of the second light emitter are varied according to the location of fixation to respectively modify the number of the multiple first-eye light signals per degree for the first-eye virtual image of the first portion of the target object and the number of the multiple second-eye light signals per degree for the second-eye virtual image of the first portion of the target object.

20. The head wearable display system of claim 16 , wherein a projection duration of the first light emitter for each of the multiple first-eye light signals and a projection duration of the second light emitter for each of the multiple second-eye light signals are varied according to the location of fixation to respectively modify a spot size of the multiple first-eye light signals for the first-eye virtual image of the first portion of the target object and a spot size of the multiple second-eye light signals for the second-eye virtual image of the first portion of the target object.

21. The head wearable display system of claim 16 , wherein a first distance between the first light direction modifier and the first collimator and a second distance between the second light direction modifier and the second collimator are varied according to the location of fixation to respectively modify a spot size of the multiple first-eye light signals for the first- eye virtual image of the first portion of the target object and a spot size of the multiple second- eye light signals for the second-eye virtual image of the first portion of the target object.

22. The head wearable display system of claim 15 , wherein the target object detection module determines a 3-dimensional coordinate for each of the multiple image pixels of the first portion and the second portion of the target object.

23. The head wearable display system of claim 15 , wherein the binocular virtual image of the target object is displayed to superimpose on the target object.

24. The head wearable display system of claim 15 , further comprising a shutter to substantially reduce environmental lights from entering the viewer's eyes.

25. The head wearable display system of claim 24 , wherein the shutter is activated by reducing transparency of the first combiner and the second combiner.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: HES IP HOLDINGS, LLC
To: OOMII INC.
Reel/Frame 070287/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2022
From: YEH, FENG-CHUN; CHEN, GUO-HSUAN; LAI, JIUNN-YIING; CHANG, YIN; HSU, PO-YA
To: HES IP HOLDINGS, LLC
Reel/Frame 060664/0001 →
Continuity (3)
Provisional Application 63217297 · Jul 1, 2021
Provisional Application 63147214 · Feb 8, 2021
Related Publication 20230049899A1 · Feb 16, 2023
References Cited (154)
US 4953961A · Ubhayakar · 1990 [cited by applicant]
US 6454411B1 · Trumbull · 2002 [cited by applicant]
US 9319674B2 · Kim et al. · 2016 [cited by applicant]
US 9395543B2 · Lamb et al. · 2016 [cited by applicant]
US 9442460B2 · Yoon et al. · 2016 [cited by applicant]
US 9576398B1 · Zehner · 2017 [cited by examiner]
US 9800844B2 · Nakahara et al. · 2017 [cited by applicant]
US 10222621B2 · Wang et al. · 2019 [cited by applicant]
US 10467770B2 · Sato et al. · 2019 [cited by applicant]
US 10554940B1 · Ghazaryan · 2020 [cited by applicant]
US 10606161B2 · Hirata et al. · 2020 [cited by applicant]
US 11079601B2 · Greenberg · 2021 [cited by applicant]
US 11256092B2 · Shamir et al. · 2022 [cited by applicant]
US 11435572B2 · Yeoh et al. · 2022 [cited by applicant]
US 11493769B2 · Wen et al. · 2022 [cited by applicant]
US 20020024708A1 · Lewis et al. · 2002 [cited by applicant]
US 20020122217A1 · Nakajima · 2002 [cited by applicant]
US 20020180868A1 · Lippert et al. · 2002 [cited by applicant]
US 20040179254A1 · Lewis et al. · 2004 [cited by applicant]
US 20080117289A1 · Schowengerdt et al. · 2008 [cited by applicant]
US 20100103077A1 · Sugiyama · 2010 [cited by examiner]
US 20100149073A1 · Chaum et al. · 2010 [cited by applicant]
US 20110032706A1 · Mukawa · 2011 [cited by applicant]
US 20110273722A1 · Charny et al. · 2011 [cited by applicant]
US 20120002163A1 · Neal et al. · 2012 [cited by applicant]
US 20120056799A1 · Solomon · 2012 [cited by applicant]
US 20130044101A1 · Kim et al. · 2013 [cited by applicant]
US 20130127980A1 · Haddick et al. · 2013 [cited by applicant]
US 20140118508A1 · Yoon et al. · 2014 [cited by applicant]
US 20140211289A1 · Hino et al. · 2014 [cited by applicant]
US 20150022783A1 · Lee et al. · 2015 [cited by applicant]
US 20150169070A1 · Harp et al. · 2015 [cited by applicant]
US 20150324568A1 · Publicover et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150338915A1 · Publicover et al. · 2015 [cited by applicant]
US 20160004908A1 · Lundberg · 2016 [cited by applicant]
US 20160033771A1 · Tremblay et al. · 2016 [cited by applicant]
US 20160062459A1 · Publicover et al. · 2016 [cited by applicant]
US 20160085302A1 · Publicover et al. · 2016 [cited by applicant]
US 20160150201A1 · Kilcher et al. · 2016 [cited by applicant]
US 20160178908A1 · Dobschal et al. · 2016 [cited by applicant]
US 20160212394A1 · Nakahara et al. · 2016 [cited by applicant]
US 20160238845A1 · Alexander et al. · 2016 [cited by applicant]
US 20160246441A1 · Westerman et al. · 2016 [cited by applicant]
US 20160274660A1 · Publicover et al. · 2016 [cited by applicant]
US 20160377865A1 · Alexander et al. · 2016 [cited by applicant]
US 20170027651A1 · Esterberg · 2017 [cited by applicant]
US 20170068091A1 · Greenberg · 2017 [cited by applicant]
US 20170078651A1 · Russell · 2017 [cited by applicant]
US 20170188021A1 · Lo et al. · 2017 [cited by applicant]
US 20170235931A1 · Publicover et al. · 2017 [cited by applicant]
US 20170285343A1 · Belenkii et al. · 2017 [cited by applicant]
US 20170299872A1 · Ou et al. · 2017 [cited by applicant]
US 20170367651A1 · Tzvieli et al. · 2017 [cited by applicant]
US 20180017815A1 · Chumbley et al. · 2018 [cited by applicant]
US 20180032812A1 · Sengelaub · 2018 [cited by examiner]
US 20180081322A1 · Robbins et al. · 2018 [cited by applicant]
US 20180091805A1 · Liang et al. · 2018 [cited by applicant]
US 20180120559A1 · Yeoh et al. · 2018 [cited by applicant]
US 20180157317A1 · Richter et al. · 2018 [cited by applicant]
US 20180182174A1 · Choi · 2018 [cited by applicant]
US 20180185665A1 · Osterhout et al. · 2018 [cited by applicant]
US 20180246336A1 · Greenberg · 2018 [cited by applicant]
US 20180249150A1 · Takeda et al. · 2018 [cited by applicant]
US 20180252926A1 · Alexander et al. · 2018 [cited by applicant]
US 20180262758A1 · El-Ghoroury et al. · 2018 [cited by applicant]
US 20180284441A1 · Cobb · 2018 [cited by applicant]
US 20180350032A1 · Bastani · 2018 [cited by examiner]
US 20190018479A1 · Minami · 2019 [cited by applicant]
US 20190064435A1 · Karafin et al. · 2019 [cited by applicant]
US 20190084419A1 · Suzuki et al. · 2019 [cited by applicant]
US 20190121132A1 · Shamir et al. · 2019 [cited by applicant]
US 20190146224A1 · Komori et al. · 2019 [cited by applicant]
US 20190172216A1 · Ninan et al. · 2019 [cited by applicant]
US 20190187473A1 · Tomizawa et al. · 2019 [cited by applicant]
US 20190222830A1 · Edwin et al. · 2019 [cited by applicant]
US 20190281279A1 · Peuhkurinen et al. · 2019 [cited by applicant]
US 20190285897A1 · Topliss et al. · 2019 [cited by applicant]
US 20190287495A1 · Mathur · 2019 [cited by examiner]
US 20190293939A1 · Sluka · 2019 [cited by applicant]
US 20190320165A1 · French et al. · 2019 [cited by applicant]
US 20190361250A1 · Lanman et al. · 2019 [cited by applicant]
US 20200090569A1 · Hajati · 2020 [cited by examiner]
US 20200097065A1 · Iyer et al. · 2020 [cited by applicant]
US 20200117006A1 · Kollin et al. · 2020 [cited by applicant]
US 20200138518A1 · Lang · 2020 [cited by applicant]
US 20200241650A1 · Kramer et al. · 2020 [cited by applicant]
US 20210003900A1 · Chen · 2021 [cited by applicant]
US 20210055555A1 · Chi et al. · 2021 [cited by applicant]
US 20210120222A1 · Holz et al. · 2021 [cited by applicant]
US 20220311992A1 · Lai et al. · 2022 [cited by applicant]
US 20220326513A1 · Yeoh et al. · 2022 [cited by applicant]
CN 102595178A · 2012 [cited by applicant]
CN 105527710A · 2016 [cited by applicant]
CN 106371218A · 2017 [cited by applicant]
CN 106537290A · 2017 [cited by applicant]
CN 107347152A · 2017 [cited by applicant]
CN 107438796A · 2017 [cited by applicant]
CN 108427498A · 2018 [cited by applicant]
CN 109073901A · 2018 [cited by applicant]
CN 109477961A · 2019 [cited by applicant]
CN 109716244A · 2019 [cited by applicant]
CN 110168419A · 2019 [cited by applicant]
CN 110168427A · 2019 [cited by applicant]
JP H4501927A · 1992 [cited by applicant]
JP H08166556A · 1996 [cited by applicant]
JP H09105885A · 1997 [cited by applicant]
JP 2004527793A · 2004 [cited by applicant]
JP 2007121581A · 2007 [cited by applicant]
JP 2010117542A · 2010 [cited by applicant]
JP 201113688A · 2011 [cited by applicant]
JP 5925389B2 · 2016 [cited by applicant]
JP 2016180939A · 2016 [cited by applicant]
JP 2017056933A · 2017 [cited by applicant]
JP 2018508036A · 2018 [cited by applicant]
JP 2018132756A · 2018 [cited by applicant]
JP 2018533062A · 2018 [cited by applicant]
KR 20120069133A · 2012 [cited by applicant]
TW 201310974A1 · 2013 [cited by applicant]
TW 201416717A · 2014 [cited by applicant]
TW 201435654A · 2014 [cited by applicant]
TW 201716827A · 2017 [cited by applicant]
TW 201738618A · 2017 [cited by applicant]
TW 201805688A · 2018 [cited by applicant]
TW 201809214A · 2018 [cited by applicant]
TW I619967B · 2018 [cited by applicant]
TW I691739B · 2020 [cited by applicant]
TW 202016603A · 2020 [cited by applicant]
TW I802826B · 2023 [cited by applicant]
WO 9104508A2 · 1991 [cited by applicant]
WO 2016105281A · 2016 [cited by applicant]
WO 2018175265A1 · 2018 [cited by applicant]
WO 2021092314A1 · 2021 [cited by applicant]
WO 2022072565A1 · 2022 [cited by applicant]
Taiwanese Office Action, dated Aug. 30, 2023, in a counterpart Taiwanese patent application, No. TW 111104638. [cited by applicant]
U.S. Office Action, dated Sep. 26, 2023, in a related U.S. Appl. No. 18/017,840. [cited by applicant]
European Search Report, dated Nov. 21, 2023, in a counterpart or related EP patent application, No. EP 20886006.4. [cited by applicant]
Taiwanese Office Action, dated Nov. 27, 2023, in a counterpart or related Taiwanese patent application, No. TW 112112456. [cited by applicant]
PCT/US2020/059317 International Search Report and Written Opinion issued on Feb. 5, 2021. [cited by applicant]
PCT/US2021/038318 International Search Report and Written Opinion issued on Sep. 24, 2021. [cited by applicant]
PCT/US2021/046078 International Search Report and Written Opinion issued on Nov. 24, 2021. [cited by applicant]
PCT/US2021/049171 International Search Report and Written Opinion issued on Dec. 6, 2021. [cited by applicant]
PCT/US2021/052750 International Search Report and Written Opinion issued on Dec. 28, 2021. [cited by applicant]
PCT/US2021/053048 International Search Report and Written Opinion issued on Jan. 14, 2022. [cited by applicant]
PCT/US2022/015717 International Search Report and Written Opinion issued on May 23, 2022. [cited by applicant]
PCT/US2022/013771 International Search Report and Written Opinion issued on Apr. 14, 2022. [cited by applicant]
U.S. Appl. No. 17/179,423 Final Rejection issued on Jul. 11, 2022. [cited by applicant]
U.S. Appl. No. 17/179,423 Non-Final Rejection issued on Jan. 21, 2022. [cited by applicant]
Kim et al., “Foveated AR: Dynamically-Foveated Augmented Reality Display” pp. 1-15 [online]. Jul. 12, 2019; ACM Transactions on Graphics vol. 38, Issue 4, Article 99. Retrieved from the internet <url:https://dl.acm.org/… [cited by applicant]
Taiwanese Office Action, dated Aug. 23, 2022 in a related Taiwanese patent application, No. TW 109141615. [cited by applicant]
IPRP in the related PCT application No. PCT/US2021/052750, dated Dec. 6, 2022. [cited by applicant]
Taiwanese Office Action, dated Jun. 14, 2023, in a related Taiwanese patent application, No. TW 110136602. [cited by applicant]
Japanese Office Action, dated Apr. 2, 2024 in a counterpart Japanese patent application, No. 2022-554308. [cited by applicant]
European Search Report, dated Jan. 30, 2024, in a counterpart or related EP patent application, No. EP 22750600.3. [cited by applicant]