IP Library › Granted Patent US 12,282,169
Granted Patent B2
US 12,282,169 · App. 18/491,373 · Granted Apr 22, 2025

Hybrid see through augmented reality systems and methods for low vision users

Inventors: David Watola (Irvine, CA); Jay E. Cormier (Laguna Niguel, CA)
Assignee: Eyedaptic, Inc.
G02B27/0172G06T5/70G02B2027/0138G02B2027/0147G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,169
App. No.
18/491,373
Granted
Apr 22, 2025
Kind
B2
Abstract

Provided herein are augmented reality visual aid systems, software, and methods which enhance vision, to simulate natural vision, by utilizing hybrid see through occlusion enabled hardware, and software through image manipulation, reprocessing, blending, for presentation and display to the eyes thus enabling a range of tasks previously lost or impacted.

Claims (15)

1. A method of providing enhanced vision for a low-vision user, comprising:

preventing a majority of external light corresponding to a central portion of the user's field of view from entering at least one eye of the user;

allowing external light corresponding to a peripheral portion of the user's field of view to enter the at least one eye of the user;

obtaining video images with a camera;

applying image processing to the video images to produce an enhanced video stream that blends into the peripheral portion of the user's field of view; and

presenting the enhanced video stream on a display positioned on or within contact lenses to the central portion of the user's field of view.

2. The method of claim 1 , wherein applying image processing further comprises applying magnification to at least a central portion of the video images.

3. The method of claim 2 , wherein a portion of the video stream outside of the central portion is magnified less than the central portion.

4. The method of claim 1 , wherein applying image processing further comprises applying contrast enhancement to at least a central portion of the video images.

5. The method of claim 1 , wherein applying image processing further comprises applying color mapping to at least a central portion of the video images.

6. The method of claim 1 , wherein applying image processing to the video images comprises blending a top edge, a bottom edge, a left edge, and a right edge of the video images with the peripheral portion of the user's field of view.

7. The method of claim 1 , wherein applying image processing to the video images comprises blending only a left edge and a right edge of the video images with the peripheral portion of the user's field of view.

8. The method of claim 1 , wherein applying image processing to the video images comprises image coordinate remapping to blend the video stream with the peripheral portion of the user's field of view.

9. The method of claim 8 , wherein the image coordinate remapping comprises radial mapping.

10. The method of claim 1 , wherein presenting the enhanced video stream comprises presenting the enhanced video stream on a display positioned on or within an eyeglasses device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2023
From: WATOLA, DAVID; CORMIER, JAY E.
To: EYEDAPTIC, INC.
Reel/Frame 065297/0224 →
Continuity (5)
Continuation 17849028 · Jun 24, 2022
Continuation 17537193 · Nov 29, 2021
Continuation 17057181
Provisional Application 62677463 · May 29, 2018
Related Publication 20240061253A1 · Feb 22, 2024
References Cited (171)
US 5546099A · Quint et al. · 1996 [cited by applicant]
US 5777715A · Kruegle et al. · 1998 [cited by applicant]
US 5892570A · Stevens · 1999 [cited by applicant]
US 6418122B1 · Schoenblum et al. · 2002 [cited by applicant]
US 8135227B2 · Lewis · 2012 [cited by examiner]
US 8384999B1 · Crosby · 2013 [cited by applicant]
US 8976086B2 · Hilkes · 2015 [cited by applicant]
US 9516283B2 · Hilkes et al. · 2016 [cited by applicant]
US 9618748B2 · Munger · 2017 [cited by examiner]
US 9782084B2 · Maertz · 2017 [cited by applicant]
US 10091414B2 · Chan et al. · 2018 [cited by applicant]
US 10347048B2 · Fu et al. · 2019 [cited by applicant]
US 10397560B2 · Miyao et al. · 2019 [cited by applicant]
US 10429675B2 · Greget · 2019 [cited by applicant]
US 10564714B2 · Marggraff et al. · 2020 [cited by applicant]
US 10869026B2 · Gupta · 2020 [cited by applicant]
US 10872472B2 · Watola et al. · 2020 [cited by applicant]
US 10950049B1 · Kelly et al. · 2021 [cited by applicant]
US 10963999B2 · Werblin et al. · 2021 [cited by applicant]
US 10984508B2 · Kim et al. · 2021 [cited by applicant]
US 11016302B2 · Freeman et al. · 2021 [cited by applicant]
US 11030975B2 · Nishibe et al. · 2021 [cited by applicant]
US 11031120B1 · Freeman, deceased et al. · 2021 [cited by applicant]
US 11043036B2 · Kim et al. · 2021 [cited by applicant]
US 11132055B2 · Jones et al. · 2021 [cited by applicant]
US 11187906B2 · Watola et al. · 2021 [cited by applicant]
US 11282284B2 · Watola et al. · 2022 [cited by applicant]
US 11372479B2 · Bradley et al. · 2022 [cited by applicant]
US 11385468B2 · Watola et al. · 2022 [cited by applicant]
US 11521360B2 · Kim et al. · 2022 [cited by applicant]
US 11546527B2 · Werblin et al. · 2023 [cited by applicant]
US 11563885B2 · Watola et al. · 2023 [cited by applicant]
US 11676152B2 · Watola et al. · 2023 [cited by applicant]
US 11676352B2 · Watola et al. · 2023 [cited by applicant]
US 11726561B2 · Watola et al. · 2023 [cited by applicant]
US 11756168B2 · Kim et al. · 2023 [cited by applicant]
US 11803061B2 · Watola et al. · 2023 [cited by applicant]
US 11819273B2 · Freeman et al. · 2023 [cited by applicant]
US 11956414B2 · Freeman et al. · 2024 [cited by applicant]
US 12062430B2 · Riggs et al. · 2024 [cited by applicant]
US 20070200927A1 · Krenik · 2007 [cited by applicant]
US 20080013047A1 · Todd et al. · 2008 [cited by applicant]
US 20080247620A1 · Lewis et al. · 2008 [cited by applicant]
US 20080309878A1 · Hirji · 2008 [cited by applicant]
US 20090273758A1 · Wang et al. · 2009 [cited by applicant]
US 20110043644A1 · Munger et al. · 2011 [cited by applicant]
US 20110109876A1 · Reichow et al. · 2011 [cited by applicant]
US 20110181692A1 · Kuno · 2011 [cited by applicant]
US 20110227813A1 · Haddick et al. · 2011 [cited by applicant]
US 20110285960A1 · Kohn et al. · 2011 [cited by applicant]
US 20120206452A1 · Geisner et al. · 2012 [cited by applicant]
US 20120242865A1 · Vartanian et al. · 2012 [cited by applicant]
US 20120309529A1 · Westlund et al. · 2012 [cited by applicant]
US 20130021373A1 · Vaught et al. · 2013 [cited by applicant]
US 20130127980A1 · Haddick et al. · 2013 [cited by applicant]
US 20130215147A1 · Hilkes et al. · 2013 [cited by applicant]
US 20140002475A1 · Oh · 2014 [cited by applicant]
US 20140053111A1 · Beckman · 2014 [cited by applicant]
US 20140063062A1 · Fateh · 2014 [cited by applicant]
US 20140152530A1 · Venkatesha et al. · 2014 [cited by applicant]
US 20140210970A1 · Dalal et al. · 2014 [cited by applicant]
US 20150002808A1 · Rizzo, III et al. · 2015 [cited by applicant]
US 20150355481A1 · Hilkes · 2015 [cited by examiner]
US 20160033771A1 · Tremblay et al. · 2016 [cited by applicant]
US 20160037025A1 · Blum · 2016 [cited by applicant]
US 20160041615A1 · Ikeda · 2016 [cited by applicant]
US 20160085302A1 · Publicover et al. · 2016 [cited by applicant]
US 20160116979A1 · Border · 2016 [cited by applicant]
US 20160156850A1 · Werblin · 2016 [cited by examiner]
US 20160171779A1 · Bar-Zeev et al. · 2016 [cited by applicant]
US 20160178912A1 · Kusuda et al. · 2016 [cited by applicant]
US 20160180591A1 · Shiu et al. · 2016 [cited by applicant]
US 20160187654A1 · Border et al. · 2016 [cited by applicant]
US 20160187969A1 · Larsen et al. · 2016 [cited by applicant]
US 20160216515A1 · Bouchier et al. · 2016 [cited by applicant]
US 20160235291A1 · Goh et al. · 2016 [cited by applicant]
US 20160246057A1 · Hasegawa et al. · 2016 [cited by applicant]
US 20160264051A1 · Werblin · 2016 [cited by applicant]
US 20160270648A1 · Freeman et al. · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20160274381A1 · Haddadi · 2016 [cited by applicant]
US 20160314564A1 · Jones et al. · 2016 [cited by applicant]
US 20160349509A1 · Lanier et al. · 2016 [cited by applicant]
US 20160363770A1 · Kim et al. · 2016 [cited by applicant]
US 20160377865A1 · Alexander et al. · 2016 [cited by applicant]
US 20170068119A1 · Antaki et al. · 2017 [cited by applicant]
US 20170084203A1 · Aguren · 2017 [cited by applicant]
US 20170176748A1 · Kim · 2017 [cited by applicant]
US 20170185723A1 · McCallum et al. · 2017 [cited by applicant]
US 20170200296A1 · Jones et al. · 2017 [cited by applicant]
US 20170221264A1 · Perry · 2017 [cited by applicant]
US 20170235161A1 · Hilkes · 2017 [cited by examiner]
US 20170249862A1 · Border · 2017 [cited by applicant]
US 20170273552A1 · Leung et al. · 2017 [cited by applicant]
US 20170287222A1 · Fujimaki · 2017 [cited by applicant]
US 20170343822A1 · Border et al. · 2017 [cited by applicant]
US 20170365101A1 · Samec et al. · 2017 [cited by applicant]
US 20170372225A1 · Foresti · 2017 [cited by applicant]
US 20180005419A1 · Hao et al. · 2018 [cited by applicant]
US 20180052326A1 · Wall et al. · 2018 [cited by applicant]
US 20180077409A1 · Heo et al. · 2018 [cited by applicant]
US 20180103917A1 · Kim et al. · 2018 [cited by applicant]
US 20180104106A1 · Lee et al. · 2018 [cited by applicant]
US 20180144554A1 · Watola et al. · 2018 [cited by applicant]
US 20180150132A1 · Xiao et al. · 2018 [cited by applicant]
US 20180203231A1 · Glik et al. · 2018 [cited by applicant]
US 20180217380A1 · Nishimaki et al. · 2018 [cited by applicant]
US 20180249151A1 · Freeman et al. · 2018 [cited by applicant]
US 20180365877A1 · Watola et al. · 2018 [cited by applicant]
US 20190012841A1 · Kim et al. · 2019 [cited by applicant]
US 20190041642A1 · Haddick et al. · 2019 [cited by applicant]
US 20190204113A1 · He · 2019 [cited by examiner]
US 20190279407A1 · McHugh et al. · 2019 [cited by applicant]
US 20190302886A1 · Werblin · 2019 [cited by examiner]
US 20190331920A1 · Watola et al. · 2019 [cited by applicant]
US 20190331922A1 · Kim et al. · 2019 [cited by applicant]
US 20190339528A1 · Freeman et al. · 2019 [cited by applicant]
US 20190385342A1 · Freeman et al. · 2019 [cited by applicant]
US 20200371311A1 · Lobachinsky et al. · 2020 [cited by applicant]
US 20210022599A1 · Freeman et al. · 2021 [cited by applicant]
US 20210257084A1 · Freeman et al. · 2021 [cited by applicant]
US 20210271318A1 · Bradley et al. · 2021 [cited by applicant]
US 20220005587A1 · Freeman et al. · 2022 [cited by applicant]
US 20220171456A1 · Siddiqi et al. · 2022 [cited by applicant]
US 20230274507A1 · Kim et al. · 2023 [cited by applicant]
US 20230276122A1 · Watola et al. · 2023 [cited by applicant]
US 20230419623A1 · Watola et al. · 2023 [cited by applicant]
CA 2916780A1 · 2008 [cited by applicant]
CA 164180S · 2016 [cited by applicant]
CA 3043204C · 2021 [cited by applicant]
CA 2991644A1 · 2022 [cited by applicant]
CA 3084546C · 2023 [cited by applicant]
CA 3069173C · 2023 [cited by applicant]
CN 104076513A · 2014 [cited by applicant]
CN 104306102A · 2015 [cited by applicant]
CN 105930819A · 2016 [cited by applicant]
CN 112534467A · 2021 [cited by applicant]
CN 108475001B · 2021 [cited by applicant]
CN 114063302A · 2022 [cited by applicant]
CN 107121070B · 2023 [cited by applicant]
EP 2674805A2 · 2013 [cited by applicant]
EP 3830630A4 · 2023 [cited by applicant]
EP 2621169B1 · 2023 [cited by applicant]
JP 2017049916A · 2017 [cited by applicant]
JP 2017120550A · 2017 [cited by applicant]
KR 20140066258A · 2014 [cited by applicant]
WO WO2008119187A1 · 2008 [cited by applicant]
WO WO2011060525A1 · 2011 [cited by applicant]
WO WO2013120180A1 · 2013 [cited by applicant]
WO WO2013177654A1 · 2013 [cited by applicant]
WO WO2014107261A1 · 2014 [cited by applicant]
WO WO2016036860A1 · 2016 [cited by applicant]
WO WO2016077343A1 · 2016 [cited by applicant]
WO WO2016144419A1 · 2016 [cited by applicant]
WO WO2016149536A1 · 2016 [cited by applicant]
WO WO2016168913A1 · 2016 [cited by applicant]
WO WO2017059522A1 · 2017 [cited by applicant]
WO WO2018200717A1 · 2018 [cited by applicant]
WO WO2020014705A1 · 2020 [cited by applicant]
WO WO2020014707A1 · 2020 [cited by applicant]
WO WO2021003406A1 · 2021 [cited by applicant]
Carroll et al.; Visual field testing:from one medical student to another; 18 pages; retrieved from the internet (http://eyerounds.org/tutorials/VF-testing/); Aug. 22, 2013. [cited by applicant]
Gonzalez; Advanced Imaging in Head-Mounted Displays for Patients with Age-Related Macular Degeneration; Doctoral dissertation; Technical University of Munich; p. 1-129; 2011 (the year of publication is sufficiently earl… [cited by applicant]
Hwang et al.; An augmented-reality edge enhancement application for Google Glass; Optometry and vision science; 91(8); pp. 1021-1030; Aug. 1, 2014. [cited by applicant]
Nomoto et al.; Prototype and evaluation of magnifying reader using image processing; Proceedings of the 2011 JSME Conference on Robotics and Mechatronics; The Japan Society of Mechanical Engineers; pp. 2784-2785; (Abstr… [cited by applicant]
Unser et al.; B-spline signal processing: Part II—efficient design and applicationtions; IEEE Transactions on Signal Processing; 41(2); pp. 834-848; Feb. 1993. [cited by applicant]
Unser et al.; B-spline signal processing: part I—theory; IEEE Transactions on Signal Processing: 41(2)); pp. 821-832; Feb. 1993. [cited by applicant]
Unser et al.; TheL2 polynomial spline pyramid; IEEE Transactions on Pattern Analysis and Machine Intelligence; 15(4); pp. 364-379; Apr. 1993. [cited by applicant]
Unser; Splines—a perfect fit for signal and image processing; IEEE Signal Processing Magazine; 16 (Article); pp. 22-38; Nov. 1999. [cited by applicant]
Watola et al.; U.S. Appl. No. 18/344,337 entitled “Enhanced autonomous hands-free control in electronic visual aids,” filed Jun. 29, 2023. [cited by applicant]
Watola et al.; U.S. Appl. No. 18/675,974 entitled “Systems for augmented reality visual aids and tools,” filed May 28, 2024. [cited by applicant]