IP Library › Granted Patent US 12,360,378
Granted Patent B2
US 12,360,378 · App. 18/321,704 · Granted Jul 15, 2025

Steerable high-resolution display

Inventors: Aaron Matthew Eash (San Francisco, CA); Andrew John Gross (Chassell, MI); Edward Chia Ning Tang (Menlo Park, CA); D. Scott Dewald (Dallas, TX); Joseph Roger Battelle (Belmont, CA); Kevin William King (San Francisco, CA); Warren Cornelius Welch, III (Foster City, CA)
Assignee: Avegant Corp.
G02B27/0172G06F1/163G06F3/011G06F3/013G06F3/147G06T7/70G09G3/002G09G5/00G09G5/026G02B2027/0123G02B2027/0147G02B2027/0178G06V20/20G06V40/18G09G2340/0407G09G2340/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,360,378
App. No.
18/321,704
Filed
May 22, 2023
Granted
Jul 15, 2025
Kind
B2
Art Unit
2483
USPC
348/115
Abstract

A display system comprising a foveal display having a monocular field of view of at least 1 degree is positioned within a scannable field of view of at least 20 degrees, the foveal display positioned for a user. In one embodiment, the foveal display is positioned for the user's fovea.

Claims (57)

1. A method of providing a hybrid display in a system including a field display having a field monocular field of view of at least 40 degrees and a foveal display having a foveal monocular field of view less than the field monocular field of view, the method comprising:

receiving image data for display;

determining that the image data comprises an image having a relevant field of view smaller than the foveal monocular field of view and, in response to the determining, using the foveal display only to display the image data as a foveal image, wherein using the foveal display comprises:

positioning the image within a scannable field of view spanning greater than the foveal monocular field of view using a positioning system;

generating a virtual image using intermediate optics between the foveal display and the positioning system; and

directing the virtual image toward a user's eye by the positioning system; and

determining that the image data comprises an image having a relevant field of view larger than the foveal monocular field of view and, in response to the determining, using the field display and the foveal display to display the image data.

2. The method of claim 1 , wherein the foveal display is implemented in a wearable device.

3. The method of claim 1 , further comprising:

verifying an actual position of the foveal image after the positioning system positions the foveal image, and to adjust foveal image data without adjusting the position of the foveal image, when the actual position is not an intended position.

4. The method of claim 1 , further comprising:

tracking a user's eye position and orientation;

classifying a movement type of the user's eye; and

using the movement type to provide a prediction for predictively positioning the foveal image.

5. The method of claim 1 , further comprising:

cutting out a portion of a field display image from the field display at a position corresponding to a position of the foveal image.

6. The method of claim 5 , further comprising:

blending edges where the foveal image and the field display image meet.

7. The method of claim 1 , wherein the field display is an external display and further comprising:

synchronizing the foveal display and the field display.

8. The method of claim 1 , further comprising:

moving the foveal display using position elements, wherein the position elements include one or more of: adjustable mirror, tunable prism, acousto-optical modulator, adjustable display panel, a curved mirror, a diffractive element, and a Fresnel reflector.

9. The method of claim 1 , further comprising:

providing a roll-off at edges of the foveal display.

10. The method of claim 9 , wherein the roll-off comprises one or more of: a resolution roll-off, decreasing resolution toward the edges, brightness roll-off, decreasing brightness toward the edges, and contrast roll-off, decreasing contrast toward the edges.

11. The method of claim 10 , wherein the roll-off gradually decreases from full brightness and contrast to one of: gray, black, and environmental colors.

12. A hybrid display system to display an image comprising:

field display configured to display a field image having a field monocular field of view of at least 40 degrees;

a foveal display configured to:

generate a foveal image having a foveal monocular field of view less than the field monocular field of view;

position the foveal image within a scannable field of view spanning greater than the foveal monocular field of view using a positioning system;

generate a virtual image using intermediate optics between the foveal display and the positioning system;

direct the virtual image toward a user's eye by the positioning system;

the hybrid display system to determine the image has a relevant field of view smaller than the foveal monocular field of view and, in response to the determining, using the foveal display only to display the image.

13. The system of claim 12 , wherein the foveal display is implemented in a wearable device.

14. The system of claim 12 , further comprising:

a processor to verify an actual position of the foveal image after the positioning system positions the foveal image, and to adjust foveal image data when the actual position is not an intended position.

15. The system of claim 12 , further comprising:

a processor to predict a future eye position, and positioning the foveal image based on the predicting.

16. The system of claim 15 , further comprising:

an eye tracker to track a user's eye position and orientation; and

the processor to classify a movement type of the user's eye, and using the movement type to provide the prediction for predictively positioning the foveal image.

17. The system of claim 12 , further comprising:

a processor to cut out a portion of a field display image from the field display at a position corresponding to a position of the foveal image.

18. The system of claim 12 , further comprising:

a processor to provide a roll-off at edges of the foveal display, the roll-off comprising one or more of: a resolution roll-off, decreasing resolution toward the edges, a brightness roll off decreasing brightness, and contrast roll-off decreasing contrast toward the edges.

19. The system of claim 18 , wherein the roll-off gradually decreases from full brightness and contrast to one of: gray, black, and environmental colors.

20. A hybrid display system to display an image comprising:

field display configured to display a field image having a field monocular field of view of at least 40 degrees;

a foveal display configured to:

generate a foveal image having a foveal monocular field of view less than the field monocular field of view;

position the foveal image within a scannable field of view spanning greater than the foveal monocular field of view using a positioning system;

generate a virtual image using intermediate optics between the foveal display and the positioning system;

direct the virtual image toward a user's eye by the positioning system;

the hybrid display system to display an image, the hybrid display to select from:

utilizing only the foveal display for an image with a field of view smaller than the foveal monocular field of view; and

utilizing the foveal display and the field display for an image larger than the foveal monocular field of view.

Continuity (6)
Continuation 17449946 · Oct 4, 2021
Continuation 16726212 · Dec 23, 2019
Continuation 15937770 · Mar 27, 2018
Provisional Application 62575354 · Oct 20, 2017
Provisional Application 62477404 · Mar 27, 2017
Related Publication 20240027771A1 · Jan 25, 2024
References Cited (148)
US 4924522A · Bray et al. · 1990 [cited by applicant]
US 5035500A · Rorabaugh et al. · 1991 [cited by applicant]
US 6008781A · Furness et al. · 1999 [cited by applicant]
US 6097353A · Melville et al. · 2000 [cited by applicant]
US 6275326B1 · Bhalla et al. · 2001 [cited by applicant]
US 6353503B1 · Spitzer et al. · 2002 [cited by applicant]
US 6356392B1 · Spitzer · 2002 [cited by applicant]
US 6411751B1 · Giles et al. · 2002 [cited by applicant]
US 7009752B1 · Lorell et al. · 2006 [cited by applicant]
US 7786648B2 · Xu et al. · 2010 [cited by applicant]
US 8203702B1 · Kane et al. · 2012 [cited by applicant]
US 9128281B2 · Osterhout et al. · 2015 [cited by applicant]
US 9335548B1 · Cakmakci et al. · 2016 [cited by applicant]
US 9588408B1 · Linnell · 2017 [cited by applicant]
US 9710887B1 · Sahlsten et al. · 2017 [cited by applicant]
US 9711072B1 · Konttori et al. · 2017 [cited by applicant]
US 9711114B1 · Konttori et al. · 2017 [cited by applicant]
US 9779478B1 · Wilson et al. · 2017 [cited by applicant]
US 9972071B2 · Wilson et al. · 2018 [cited by applicant]
US 10140695B2 · Wilson et al. · 2018 [cited by applicant]
US 10255714B2 · Mitchell et al. · 2019 [cited by applicant]
US 10284118B2 · Henderson et al. · 2019 [cited by applicant]
US 10504207B1 · Wilson et al. · 2019 [cited by applicant]
US 10514546B2 · Eash et al. · 2019 [cited by applicant]
US 11209650B1 · Trail · 2021 [cited by applicant]
US 12183047B2 · Bhanushali · 2024 [cited by examiner]
US 20020005976A1 · Behin et al. · 2002 [cited by applicant]
US 20080015553A1 · Zacharias · 2008 [cited by applicant]
US 20090122385A1 · Hilton · 2009 [cited by applicant]
US 20090160872A1 · Gibbons · 2009 [cited by applicant]
US 20090189830A1 · Deering et al. · 2009 [cited by applicant]
US 20100097580A1 · Yamamoto et al. · 2010 [cited by applicant]
US 20100149073A1 · Chaum et al. · 2010 [cited by applicant]
US 20100231706A1 · Maguire, Jr. · 2010 [cited by applicant]
US 20110075257A1 · Hua et al. · 2011 [cited by applicant]
US 20110141225A1 · Stec et al. · 2011 [cited by applicant]
US 20110285967A1 · Gollier · 2011 [cited by applicant]
US 20120120498A1 · Harrison · 2012 [cited by examiner]
US 20120154277A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120176483A1 · Border et al. · 2012 [cited by applicant]
US 20130100176A1 · Lewis et al. · 2013 [cited by applicant]
US 20130114146A1 · Larson · 2013 [cited by applicant]
US 20130208003A1 · Bohn et al. · 2013 [cited by applicant]
US 20130208330A1 · Naono · 2013 [cited by applicant]
US 20130286053A1 · Fleck et al. · 2013 [cited by applicant]
US 20140049643A1 · Segerstrom et al. · 2014 [cited by applicant]
US 20140300859A1 · Oz · 2014 [cited by applicant]
US 20150173846A1 · Schneider et al. · 2015 [cited by applicant]
US 20150201171A1 · Takehana · 2015 [cited by applicant]
US 20150247723A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150287165A1 · Berghoff · 2015 [cited by applicant]
US 20150338915A1 · Publicover · 2015 [cited by examiner]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160033771A1 · Tremblay et al. · 2016 [cited by applicant]
US 20160065921A1 · Sieler et al. · 2016 [cited by applicant]
US 20160077338A1 · Robbins et al. · 2016 [cited by applicant]
US 20160131912A1 · Border et al. · 2016 [cited by applicant]
US 20160209648A1 · Haddick et al. · 2016 [cited by applicant]
US 20160225192A1 · Jones et al. · 2016 [cited by applicant]
US 20160233793A1 · Henderson et al. · 2016 [cited by applicant]
US 20160240013A1 · Spitzer · 2016 [cited by applicant]
US 20160260258A1 · Lo et al. · 2016 [cited by applicant]
US 20160262608A1 · Krueger · 2016 [cited by applicant]
US 20160267716A1 · Patel · 2016 [cited by applicant]
US 20160274365A1 · Bailey et al. · 2016 [cited by applicant]
US 20160327789A1 · Klug et al. · 2016 [cited by applicant]
US 20160363841A1 · Hino et al. · 2016 [cited by applicant]
US 20160379606A1 · Kollin et al. · 2016 [cited by applicant]
US 20170083084A1 · Tatsuta et al. · 2017 [cited by applicant]
US 20170124760A1 · Murakawa et al. · 2017 [cited by applicant]
US 20170188021A1 · Lo et al. · 2017 [cited by applicant]
US 20170245753A1 · Donaldson · 2017 [cited by applicant]
US 20170255012A1 · Tam et al. · 2017 [cited by applicant]
US 20170255020A1 · Tam et al. · 2017 [cited by applicant]
US 20170255766A1 · Kaehler · 2017 [cited by applicant]
US 20170263046A1 · Patney et al. · 2017 [cited by applicant]
US 20170287446A1 · Young et al. · 2017 [cited by applicant]
US 20170287447A1 · Barry et al. · 2017 [cited by applicant]
US 20170316601A1 · Kakarlapudi et al. · 2017 [cited by applicant]
US 20170318235A1 · Schneider et al. · 2017 [cited by applicant]
US 20180003962A1 · Urey et al. · 2018 [cited by applicant]
US 20180031849A1 · Omanovic et al. · 2018 [cited by applicant]
US 20180096471A1 · Wilson et al. · 2018 [cited by applicant]
US 20180136471A1 · Miller et al. · 2018 [cited by applicant]
US 20180136473A1 · Cobb et al. · 2018 [cited by applicant]
US 20180174451A1 · Rao · 2018 [cited by applicant]
US 20180183356A1 · Henderson et al. · 2018 [cited by applicant]
US 20180227630A1 · Sengelaub et al. · 2018 [cited by applicant]
US 20180267294A1 · Aschwanden et al. · 2018 [cited by applicant]
US 20180269266A1 · Ahmed et al. · 2018 [cited by applicant]
US 20180275410A1 · Yeoh et al. · 2018 [cited by applicant]
US 20180284451A1 · Fash et al. · 2018 [cited by applicant]
US 20180293041A1 · Harviainen · 2018 [cited by applicant]
US 20180321484A1 · Bailey et al. · 2018 [cited by applicant]
US 20180341107A1 · Greenberg · 2018 [cited by applicant]
US 20180344413A1 · Rappel et al. · 2018 [cited by applicant]
US 20190041524A1 · Korsgaard et al. · 2019 [cited by applicant]
US 20190049721A1 · Anton et al. · 2019 [cited by applicant]
US 20190179149A1 · Curtis et al. · 2019 [cited by applicant]
US 20200018965A1 · Milner-Moore et al. · 2020 [cited by applicant]
US 20200133006A1 · Eash et al. · 2020 [cited by applicant]
US 20200271932A1 · Tuomisto et al. · 2020 [cited by applicant]
US 20210293931A1 · Nemet et al. · 2021 [cited by applicant]
CA 2815461A1 · 2012 [cited by applicant]
CN 103261943A · 2013 [cited by applicant]
CN 107392989A · 2017 [cited by applicant]
CN 107852521A · 2018 [cited by applicant]
CN 108474949A · 2018 [cited by applicant]
EP 1970887A1 · 2008 [cited by applicant]
GB 2510001A · 2014 [cited by applicant]
JP 08313843A · 1996 [cited by applicant]
JP 2001281594 · 2001 [cited by applicant]
JP 2007171228A · 2007 [cited by applicant]
JP 2009182754A · 2009 [cited by applicant]
JP 2009192561A · 2009 [cited by applicant]
JP 2014511512A · 2014 [cited by applicant]
JP 2015503934A · 2015 [cited by applicant]
JP 2017028510A · 2017 [cited by applicant]
JP 2017534075A · 2017 [cited by applicant]
KR 1020160129080A · 2016 [cited by applicant]
KR 1020170055992A · 2017 [cited by applicant]
KR 1020180104056A · 2018 [cited by applicant]
WO 2009131626A2 · 2009 [cited by applicant]
WO 2012082807A2 · 2012 [cited by applicant]
WO 2013035086A1 · 2013 [cited by applicant]
WO 2017113117A1 · 2017 [cited by applicant]
WO 2018019831A1 · 2018 [cited by applicant]
WO 2018165484A1 · 2018 [cited by applicant]
WO 2018175625A1 · 2018 [cited by applicant]
WO 2018183405A1 · 2018 [cited by applicant]
WO 2019104046A1 · 2019 [cited by applicant]
Decision to Grant, EP App. No. 18775536.8, Dec. 19, 2024, 3 pages. [cited by applicant]
Intention to Grant, EP App. No. 18775536.8, Oct. 22, 2024, 6 pages. [cited by applicant]
Milanovic et al., “Sub-100 US Settling Time and Low Voltage Operation for Gimbal-less Two-Axis Scanners,” IEEE/LEOS Optical MEMS 2004, Takamatsu, Japan, August (2004). (Year: 2004). [cited by applicant]
Office Action, JP App. No. 2022-206640, Dec. 8, 2023, 11 pages (06 pages of English Translation and 05 pages of Original Document). [cited by applicant]
Decision of Refusal, JP App. No. 2019-553025, Aug. 24, 2022, 11 pages (6 pages of English Translation and 5 pages of Original Document). [cited by applicant]
Final Office Action, U.S. Appl. No. 17/449,946, Oct. 7, 2022, 13 pages. [cited by applicant]
Final Rejection Mailed on Dec. 15, 2020 for U.S. Appl. No. 16/726,212. [cited by applicant]
Non Final Office Action, U.S. Appl. No. 16/726,212, Jul. 27, 2020, 23 pages. [cited by applicant]
Non-Final Office Action, U.S. Appl. No. 17/449,946, May 27, 2022, 18 pages. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 16/726,212, May 26, 2021, 15 pages. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 17/449,946, Jan. 11, 2023, 12 pages. [cited by applicant]
Notice of Allowance, U.S. Appl. No. 17/449,946, Mar. 29, 2023, 2 pages. [cited by applicant]
Notice of Reasons for Refusal, JP App. No. 2019-553025, Mar. 2, 2022, 11 pages (6 pages of English Translation and 5 pages of Original Document). [cited by applicant]
PCT International Search Report dated Jun. 8, 2018 (2 pages). [cited by applicant]
PCT International Written Opinion dated Jun. 8, 2018 (6 pages). [cited by applicant]
Supplementary European Search Report and Search Opinion, EP App No. 18775536.8, Apr. 9, 2020, 07 pages. [cited by applicant]
Office Action, JP App. No. 2022-206640, May 31, 2024, 13 pages (07 pages of English Translation and 06 pages of Original Document). [cited by applicant]