IP Library Granted Patent US 12,211,611
Granted Patent B2
US 12,211,611 · App. 18/606,941 · Granted Jan 28, 2025

Surgery visualization theatre

Inventors: Michael Hayes Freeman (Tulsa, OK); Mitchael C. Freeman (Sapulpa, OK); Jordan Boss (Tulsa, OK); Brian Santee (Tulsa, OK); Montgomery H. F. Freeman (Dana Point, CA); Thomas A. Finley (Tulsa, OK); Linda Lam (Sierra Madre, CA); Victoria M. McArtor (Tulsa, OK); Steven Yeager (Colorado Springs, CO); David Kessler (Rochester, NY); Ian Oswald (Stillwater, OK)
Assignee: RAYTRX, LLC
G16H30/40A61B3/0025A61B3/024A61B3/032A61B3/12G16H10/60G16H30/20G16H50/20G16Z99/00A61F9/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,611
App. No.
18/606,941
Granted
Jan 28, 2025
Kind
B2
Abstract

An augmented/extended reality (AXR) headset for use with a surgery visualization system is described herein. The AXR headset includes a wearable support frame, one or more forward-facing cameras pivotably mounted to the wearable support frame, an imaging system mounted to the wearable support frame, and a control logic processor coupled to the one or more front facing cameras and the image generator, and programmed to execute an algorithm including the steps of receiving image data from the one or more forward-facing cameras and operating the image generator to display the received image data onto the curved mirror.

Claims (42)

1. An augmented/extended reality (AXR) headset for use with a surgery visualization system, comprising:

a wearable support frame;

one or more forward-facing cameras pivotably mounted to the wearable support frame;

an imaging system mounted to the wearable support frame and including:

an image generator configured to form a 2D image; and

a catadioptric optics assembly including:

a partially transmissive curved mirror positioned in front of a wearer's eye;

a beam splitter positioned between the partially transmissive curved mirror and the viewer eye; and

an optical image relay configured to conjugate the 2D image formed from the image generator to a curved focal surface of the partially transmissive curved mirror and including a prism having a fold surface configured for folding the optical path for light generated by the image generator towards the beam splitter; and

a control logic processor coupled to the one or more front facing cameras and the image generator, and programmed to execute an algorithm including the steps of:

receiving image data from the one or more forward-facing cameras; and

operating the image generator to display the received image data onto the curved mirror.

2. The AXR headset of claim 1 , wherein the one or more forward-facing cameras is configured to rotate downward to a position substantially 90 degrees from a plane of a front of the AXR headset.

3. The AXR headset of claim 2 , wherein the one or more forward-facing cameras is configured to rotate between about 60 to 90 degrees.

4. The AXR headset of claim 1 , wherein the one or more forward-facing cameras includes a 4K resolution camera.

5. The AXR headset of claim 4 , wherein the one or more forward-facing cameras is configured to capture a wide field-of-view between about 180 to 210 degrees forward-facing vision.

6. The AXR headset of claim 1 , further comprising a first imaging system associated with a left eye of the wearer and a second imaging system associated with a right eye of the wearer.

7. The AXR headset of claim 6 , further comprising an interpupillary distance (IPD) adjustment system coupled to the first and second imaging systems for adjusting a distance between a first partially transmissive curved mirror and a second partially transmissive curved mirror.

8. The AXR headset of claim 1 , further comprising an outer lens mounted to the wearable support frame such that the partially transmissive curved mirror is positioned between the outer lens and the wearer's eye.

9. The AXR headset of claim 8 , wherein the outer lens includes a plurality of layers including a dynamic opacity layer.

10. A method of assembling an augmented/extended reality (AXR) headset for use with a surgery visualization system, including the steps of:

providing a wearable support frame;

coupling one or more forward-facing cameras to the wearable support frame such that the one or more forward-facing cameras are pivotable with respect to the wearable support frame;

coupling an imaging system to the wearable support frame, the imaging system including:

an image generator configured to form a 2D image; and

a catadioptric optics assembly including:

a partially transmissive curved mirror positioned in front of a wearer's eye;

a beam splitter positioned between the partially transmissive curved mirror and the viewer eye; and

an optical image relay configured to conjugate the 2D image formed from the image generator to a curved focal surface of the partially transmissive curved mirror and including a prism having a fold surface configured for folding the optical path for light generated by the image generator towards the beam splitter; and

coupling a control logic processor to the one or more front facing cameras and the image generator, the control logic processor programmed to execute an algorithm including the steps of:

receiving image data from the one or more forward-facing cameras; and

operating the image generator to display the received image data onto the curved mirror.

11. The method of claim 10 , wherein the one or more forward-facing cameras is configured to rotate downward to a position substantially 90 degrees from a plane of a front of the AXR headset.

12. The method of claim 11 , wherein the one or more forward-facing cameras is configured to rotate between about 60 to 90 degrees.

13. The method of claim 10 , wherein the one or more forward-facing cameras includes a 4K resolution camera.

14. The method of claim 13 , wherein the one or more forward-facing cameras is configured to capture a wide field-of-view between about 180 to 210 degrees forward-facing vision.

15. The method of claim 10 , wherein coupling the imaging system to the wearable support frame includes:

coupling a first imaging system associated with a left eye of the wearer to the wearable support frame; and

coupling a second imaging system associated with a right eye of the wearer to the wearable support frame.

16. The method of claim 15 , including the step of coupling an interpupillary distance (IPD) adjustment system to the first and second imaging systems for adjusting a distance between a first partially transmissive curved mirror and a second partially transmissive curved mirror.

17. The method of claim 10 , including the step of coupling an outer lens to the wearable support frame such that the partially transmissive curved mirror is positioned between the outer lens and the wearer's eye.

18. The method of claim 17 , wherein the outer lens includes a plurality of layers including a dynamic opacity layer.

Assignments (2)
SECURITY INTEREST Recorded Apr 5, 2024
From: RAYTRX LLC
To: SAGE CONSULTING & WAGE PRESERVATION, INC.
Reel/Frame 067526/0762 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2024
From: FREEMAN, MICHAEL HAYES; FREEMAN, MITCHAEL C.; BOSS, JORDAN; SANTEE, BRIAN; FREEMAN, MONTGOMERY H.F.; FINLEY, THOMAS A.; MCARTOR, VICTORIA; YEAGER, STEVEN; LAM, LINDA; KESSLER, DAVID; OSWALD, IAN
To: RAYTRX, LLC
Reel/Frame 066803/0399 →
Continuity (7)
Continuation 17307771 · May 4, 2021
Continuation In Part 17182022 · Feb 22, 2021
Provisional Application 63019796 · May 4, 2020
Provisional Application 63005202 · Apr 3, 2020
Provisional Application 62986461 · Mar 6, 2020
Provisional Application 62979999 · Feb 21, 2020
Related Publication 20240266033A1 · Aug 8, 2024
References Cited (159)
US 6449103B1 · Charles · 2002 [cited by applicant]
US 7639208B1 · Ha et al. · 2009 [cited by applicant]
US 8135227B2 · Lewis et al. · 2012 [cited by applicant]
US 8311328B2 · Spruck · 2012 [cited by applicant]
US 8350898B2 · Chang et al. · 2013 [cited by applicant]
US 8494298B2 · Lewis et al. · 2013 [cited by applicant]
US 8579194B2 · Boss et al. · 2013 [cited by applicant]
US 8771805B2 · Laude et al. · 2014 [cited by applicant]
US 8798756B2 · McClure et al. · 2014 [cited by applicant]
US 8812120B2 · Greenberg et al. · 2014 [cited by applicant]
US 8831734B2 · Nanduri et al. · 2014 [cited by applicant]
US 8831745B2 · Hung et al. · 2014 [cited by applicant]
US 8874224B2 · Greenberg et al. · 2014 [cited by applicant]
US 8874239B2 · Greenberg et al. · 2014 [cited by applicant]
US 8886329B2 · Greenberg et al. · 2014 [cited by applicant]
US 8912979B1 · Gomez · 2014 [cited by applicant]
US 8934983B2 · Greenberg et al. · 2015 [cited by applicant]
US 8954157B2 · Faraji et al. · 2015 [cited by applicant]
US 8976086B2 · Hilkes · 2015 [cited by applicant]
US 9002462B2 · McClure et al. · 2015 [cited by applicant]
US 9042985B2 · Marsh et al. · 2015 [cited by applicant]
US 9044590B2 · Greenberg et al. · 2015 [cited by applicant]
US 9044591B2 · Greenberg et al. · 2015 [cited by applicant]
US 9050468B2 · Greenberg et al. · 2015 [cited by applicant]
US 9061150B2 · Greenberg et al. · 2015 [cited by applicant]
US 9072888B2 · Greenberg et al. · 2015 [cited by applicant]
US 9072900B2 · Caspi et al. · 2015 [cited by applicant]
US 9078739B2 · Greenberg et al. · 2015 [cited by applicant]
US 9084895B2 · Greenberg et al. · 2015 [cited by applicant]
US 9089690B2 · Greenberg et al. · 2015 [cited by applicant]
US 9089701B2 · Zhou et al. · 2015 [cited by applicant]
US 9089702B2 · Dorn et al. · 2015 [cited by applicant]
US 9095709B2 · McClure et al. · 2015 [cited by applicant]
US 9095710B2 · Horsager et al. · 2015 [cited by applicant]
US 9095722B2 · Mech et al. · 2015 [cited by applicant]
US 9097891B2 · Border et al. · 2015 [cited by applicant]
US 9651784B2 · Osterhout · 2017 [cited by applicant]
US 9651786B1 · Browne · 2017 [cited by applicant]
US 9955862B2 · Freeman et al. · 2018 [cited by applicant]
US 10111583B1 · Freeman et al. · 2018 [cited by applicant]
US 10149958B1 · Tran et al. · 2018 [cited by applicant]
US 10323904B1 · Batten · 2019 [cited by applicant]
US 10345768B2 · Fullam et al. · 2019 [cited by applicant]
US 10638080B2 · Ovchinnikov et al. · 2020 [cited by applicant]
US 10732407B1 · Wood · 2020 [cited by examiner]
US 10874297B1 · Freeman et al. · 2020 [cited by applicant]
US 20020063807A1 · Margulis · 2002 [cited by applicant]
US 20020082498A1 · Wendt et al. · 2002 [cited by applicant]
US 20030223038A1 · Alster et al. · 2003 [cited by applicant]
US 20050036109A1 · Blum et al. · 2005 [cited by applicant]
US 20050168569A1 · Igarashi · 2005 [cited by applicant]
US 20050280603A1 · Aughey et al. · 2005 [cited by applicant]
US 20060087746A1 · Lipow · 2006 [cited by applicant]
US 20060238710A1 · Dick et al. · 2006 [cited by applicant]
US 20070121070A1 · Alster et al. · 2007 [cited by applicant]
US 20070273983A1 · Hebert · 2007 [cited by examiner]
US 20090086313A1 · Zimmer · 2009 [cited by applicant]
US 20090123036A1 · Huang et al. · 2009 [cited by applicant]
US 20090128834A1 · Matsuhira · 2009 [cited by applicant]
US 20090218400A1 · Boss et al. · 2009 [cited by applicant]
US 20100011959A1 · Marra · 2010 [cited by applicant]
US 20100079356A1 · Hoellwarth · 2010 [cited by applicant]
US 20100149073A1 · Chaum et al. · 2010 [cited by applicant]
US 20100254017A1 · Martins · 2010 [cited by applicant]
US 20100277471A1 · Beato et al. · 2010 [cited by applicant]
US 20110043644A1 · Munger et al. · 2011 [cited by applicant]
US 20120068913A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120206335A1 · Osterhout · 2012 [cited by examiner]
US 20120281181A1 · Chen et al. · 2012 [cited by applicant]
US 20120326948A1 · Crocco · 2012 [cited by applicant]
US 20130099700A1 · Kreye et al. · 2013 [cited by applicant]
US 20130155507A1 · Ryu et al. · 2013 [cited by applicant]
US 20130162632A1 · Varga et al. · 2013 [cited by applicant]
US 20130162673A1 · Bohn · 2013 [cited by applicant]
US 20130172902A1 · Lightcap et al. · 2013 [cited by applicant]
US 20130178868A1 · Roh · 2013 [cited by applicant]
US 20130194254A1 · Miyoshi et al. · 2013 [cited by applicant]
US 20130200595A1 · Mackay et al. · 2013 [cited by applicant]
US 20130215147A1 · Hilkes et al. · 2013 [cited by applicant]
US 20130329184A1 · Barzak et al. · 2013 [cited by applicant]
US 20130329190A1 · Lewis et al. · 2013 [cited by applicant]
US 20130335543A1 · Hilkes et al. · 2013 [cited by applicant]
US 20140002587A1 · Aguren · 2014 [cited by applicant]
US 20140002597A1 · Aguren · 2014 [cited by applicant]
US 20140063054A1 · Osterhout et al. · 2014 [cited by applicant]
US 20140094655A1 · Newman · 2014 [cited by applicant]
US 20140098226A1 · Pletcher · 2014 [cited by applicant]
US 20140160264A1 · Taylor et al. · 2014 [cited by applicant]
US 20140214122A1 · Nanduri et al. · 2014 [cited by applicant]
US 20140232645A1 · Ali et al. · 2014 [cited by applicant]
US 20140243971A1 · Pugh et al. · 2014 [cited by applicant]
US 20140275760A1 · Lee et al. · 2014 [cited by applicant]
US 20140283429A1 · Sullivan et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150005785A1 · Olson · 2015 [cited by applicant]
US 20150084841A1 · Hilkes · 2015 [cited by applicant]
US 20150193984A1 · Bar-Zeev et al. · 2015 [cited by applicant]
US 20150201532A1 · Osterhout et al. · 2015 [cited by applicant]
US 20150355481A1 · Hilkes et al. · 2015 [cited by applicant]
US 20150362733A1 · Spivack · 2015 [cited by applicant]
US 20150378074A1 · Kollin et al. · 2015 [cited by applicant]
US 20160027216A1 · da Veiga et al. · 2016 [cited by applicant]
US 20160037849A1 · Shearman et al. · 2016 [cited by applicant]
US 20160055822A1 · Bell · 2016 [cited by applicant]
US 20160091968A1 · Angelo et al. · 2016 [cited by applicant]
US 20160183779A1 · Ren et al. · 2016 [cited by applicant]
US 20160196694A1 · Lindeman · 2016 [cited by applicant]
US 20160247418A1 · Folzenlogen et al. · 2016 [cited by applicant]
US 20160252325A1 · Sammut et al. · 2016 [cited by applicant]
US 20160262608A1 · Krueger · 2016 [cited by applicant]
US 20160267720A1 · Mandella et al. · 2016 [cited by applicant]
US 20160270648A1 · Freeman et al. · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20160361643A1 · Allin · 2016 [cited by examiner]
US 20160377871A1 · Kress et al. · 2016 [cited by applicant]
US 20160379593A1 · Borenstein et al. · 2016 [cited by applicant]
US 20170007351A1 · Yu · 2017 [cited by applicant]
US 20170010469A1 · Samec et al. · 2017 [cited by applicant]
US 20170011706A1 · Namkung et al. · 2017 [cited by applicant]
US 20170068119A1 · Antaki et al. · 2017 [cited by applicant]
US 20170094167A1 · Riedel · 2017 [cited by applicant]
US 20170236332A1 · Kipman et al. · 2017 [cited by applicant]
US 20170242253A1 · Benesh · 2017 [cited by applicant]
US 20170257619A1 · Kashima · 2017 [cited by examiner]
US 20170293380A1 · Chauveau et al. · 2017 [cited by applicant]
US 20170323615A1 · Hazra et al. · 2017 [cited by applicant]
US 20180024369A1 · Kato · 2018 [cited by examiner]
US 20180045964A1 · Jones et al. · 2018 [cited by applicant]
US 20180116742A1 · Dell et al. · 2018 [cited by applicant]
US 20180125340A1 · Ishikawa · 2018 [cited by applicant]
US 20180153632A1 · Tokarchuk et al. · 2018 [cited by applicant]
US 20180250085A1 · Simi et al. · 2018 [cited by applicant]
US 20180325618A1 · Justin et al. · 2018 [cited by applicant]
US 20190339528A1 · Freeman et al. · 2019 [cited by applicant]
US 20190353457A1 · Northrup · 2019 [cited by applicant]
US 20190359351A1 · Fisher et al. · 2019 [cited by applicant]
US 20200030054A1 · Okawara · 2020 [cited by applicant]
US 20200038120A1 · Ziraknejad et al. · 2020 [cited by applicant]
US 20200281670A1 · Moskowitz · 2020 [cited by applicant]
US 20210022599A1 · Freeman et al. · 2021 [cited by applicant]
US 20210149173A1 · Knoblich et al. · 2021 [cited by applicant]
CN 105188516A · 2015 [cited by applicant]
EP 4106664A1 · 2021 [cited by applicant]
EP 4052647A1 · 2022 [cited by applicant]
JP 09245195 · 1997 [cited by applicant]
JP 5571901B2 · 2014 [cited by applicant]
KR 1020130082637 · 2013 [cited by applicant]
KR 1020140112207 · 2014 [cited by applicant]
KR 1020180068351 · 2018 [cited by applicant]
WO 2014140849A2 · 2014 [cited by applicant]
WO 2016133644 · 2016 [cited by applicant]
WO 2017020081A1 · 2017 [cited by applicant]
WO 2017064301 · 2017 [cited by applicant]
WO 2018067611 · 2018 [cited by applicant]
WO 2020014707A1 · 2020 [cited by applicant]
WO 2020075501A1 · 2020 [cited by applicant]
Loshin, David S. et al., The Programmable Remapper: Clinical Applications for Patients with Field Defects, Optometry and Vision Science, received Nov. 4, 1988, revision received Mar. 3, 1989, pp. 389-395, vol. 66, No. 6… [cited by applicant]
Wrobleswki, Dariusz et al., Testing of Visual Field with Virtual Reality Goggles in Manual and Visual Grasp Modes, Biomed Research International, vol. 2014 (2014), Article ID 206082, pp. 1-7, http://www.hindawi.com/jour… [cited by applicant]
Hainich, Rolf R. et al., Near-Eye Displays (NED), Displays: Fundamentals and Applications, Second Edition, 2016, XP093124959, pp. 417-494. [cited by applicant]