IP Library › Granted Patent US 12,201,382
Granted Patent B2
US 12,201,382 · App. 18/385,101 · Granted Jan 21, 2025

System, method and apparatus for magnetic tracking of ultrasound probe and generation of 3D visualization thereof

Inventor: Anthony K. Misener (Bountiful, UT)
Assignee: Bard Access Systems, Inc.
A61B34/20A61B8/0891A61B8/12A61B8/4263A61B8/483A61B8/488A61B17/3403A61B2034/2051A61B2090/365
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,201,382
App. No.
18/385,101
Filed
Oct 30, 2023
Granted
Jan 21, 2025
Kind
B2
Art Unit
3798
USPC
600/424
Abstract

A magnetic-based tracking system for tracking an ultrasound probe to create a three-dimensional visualization. The system can include a reference device including a reference magnet and an ultrasound probe including an ultrasound acoustic transducer or acoustic array that acquires ultrasound images and a magnetometer that detects a magnetic field generated by the reference magnet. The ultrasound probe couples a first ultrasound image with a first magnetic field strength, wherein both of the first ultrasound image is received and the first magnetic field strength is detected at a first time. The system can include a console including a processor and non-transitory computer-readable medium having stored thereon a plurality of processor executed logic modules that perform operations including receiving and recording a plurality of coupling of ultrasound images and detected magnetic field strengths, and generating a 3D visualization from the ultrasound images.

Claims (47)

1. A magnetic based tracking system for tracking an ultrasound probe to create a three-dimensional (3D) visualization, the system comprising:

a reference device including a magnetometer that is configured to detect a magnetic field generated by a reference magnet and capture a first set of timestamps for a set of magnetic field strengths of the magnetic field detected over time, wherein the reference device is a structure that wraps around a body segment to be imaged or a structure that allows the body segment to be placed within the structure for imaging;

the ultrasound probe including an ultrasound acoustic transducer or acoustic array configured to capture ultrasound images and a second set of timestamps for each of the ultrasound images, and wherein the ultrasound probe includes the reference magnet configured to generate the magnetic field; and

a console including a processor and non-transitory computer-readable medium having stored thereon logic that, when executed by the processor, is configured to perform operations including:

receiving (i) the ultrasound images and the second set of timestamps from the ultrasound probe, and (ii) the set of magnetic field strengths and the first set of timestamps from the reference device;

pairing the ultrasound images with the set of magnetic field strengths resulting in ultrasound image-magnetic field strength pairings, wherein each ultrasound image-magnetic field strength pairing includes a first ultrasound image having a first timestamp and a first magnetic field strength having a second timestamp, wherein the first timestamp corresponds to a same time as the second timestamp; and

generating the 3D visualization of a portion of a patient body from the ultrasound images by (i) aligning each of the ultrasound images in accordance with the ultrasound image-magnetic field strength pairings and (ii) stitching the ultrasound images together.

2. The magnetic based tracking system according to claim 1 , wherein the structure of the reference device is a cuff like wrapping around the body segment to be imaged.

3. The magnetic based tracking system according to claim 1 , wherein the structure of the reference device is U-shaped allowing the body segment to be placed within for imaging.

4. The magnetic based tracking system according to claim 1 , further comprising:

a needle tracking system configured to capture a trajectory of a needle in three-dimensions, wherein the needle tracking system is configured to record a path of the needle to a target structure.

5. The magnetic based tracking system according to claim 4 , wherein the target structure is one of a vessel center, a nerve bundle, a drainage site, or a pneumothorax.

6. The magnetic based tracking system according to claim 1 , further comprising:

a magnetic or electromagnetic needle guidance system configured to track a path of a needle to a target structure.

7. The magnetic based tracking system according to claim 1 , wherein the 3D visualization is rendered via a virtual, augmented, or mixed-reality system.

8. The magnetic based tracking system according to claim 1 , further comprising:

a vessel identification system; and

a Doppler system, wherein the vessel identification system and the Doppler system are configured to map one or more veins or one or more arteries.

9. The magnetic based tracking system according to claim 1 , wherein the ultrasound probe is a hands-free ultrasound probe.

10. The magnetic based tracking system according to claim 1 , further comprising:

a remote-controlled tourniquet configured to compress a portion of the body segment being imaged by the ultrasound probe.

11. The magnetic based tracking system according to claim 1 , further comprising:

a remote-controlled heating element configured to engorge blood vessels.

12. A method of creating a 3D image using a magnetic based tracking system for tracking an ultrasound probe comprising:

configuring a reference device around a body segment to be imaged, wherein the reference device includes a magnetometer configured to detect a magnetic field generated by a reference magnet and capture a first set of timestamps for a set of magnetic field strengths of the magnetic field detected over time, wherein the reference device is a structure that wraps around the body segment to be imaged or a structure that allows the body segment to be placed within the structure for imaging;

advancing the ultrasound probe on skin surface of the body segment to be imaged, wherein the ultrasound probe includes an ultrasound acoustic transducer or acoustic array configured to capture ultrasound images and a second set of timestamps for each of the ultrasound images, and wherein the ultrasound probe includes the reference magnet configured to generate the magnetic field;

detecting the magnetic field generated by the reference magnet and capturing the first set of timestamps for the set of magnetic field strengths of the magnetic field detected over time;

capturing time stamped the ultrasound images by the ultrasound probe and the second set of timestamps for each of the ultrasound images;

pairing the ultrasound images with the set of magnetic field strengths resulting in ultrasound image-magnetic field strength pairings, wherein each ultrasound image-magnetic field strength pairing includes a first ultrasound image having a first timestamp and a first magnetic field strength having a second timestamp, wherein the first timestamp corresponds to a same time as the second timestamp; and

generating a 3D visualization of a portion of a patient body from the ultrasound images by (i) aligning each of the ultrasound images in accordance with the ultrasound image-magnetic field strength pairings and (ii) stitching the ultrasound images together while simultaneously detecting time stamped magnetic field strength of the reference magnet by magnetometer;

determining a distance between the reference magnet and the magnetometer; and stitching together ultrasound images using magnetic field strength data and time stamps to create the 3D image.

13. The method according to claim 12 , wherein the reference device structure is cuff like wrapped around the body segment to be imaged.

14. The method according to claim 12 , wherein the structure of the reference structure is U-shaped allowing the body segment to be placed within for imaging.

15. The method according to claim 12 , further comprising:

a needle tracking system configured to capture a trajectory of a needle in three-dimensions, wherein the needle tracking system is configured to record a path of the needle to a target structure.

16. The method according to claim 15 , wherein the target structure is one of a vessel center, a nerve bundle, a drainage site, or a pneumothorax.

17. The method according to claim 12 , further comprising:

a magnetic or electromagnetic needle guidance system configured to track a path of a needle to a target structure.

18. The method according to claim 12 , wherein the 3D visualization is rendered via a virtual, an augmented, or a mixed-reality system.

19. The method according to claim 12 , further comprising:

a vessel identification system; and

a Doppler system, wherein the vessel identification system and the Doppler system are configured to map one or more veins or one or more arteries.

20. The method according to claim 12 , wherein the ultrasound probe is a hands-free ultrasound probe.

21. The method according to claim 12 , further comprising:

a remote-controlled tourniquet configured to compress a portion of the body segment being imaged by the ultrasound probe.

22. The method according to claim 12 , further comprising:

a remote-controlled heating element configured to engorge blood vessels.

Continuity (3)
Division 17380767 · Jul 20, 2021
Provisional Application 63054622 · Jul 21, 2020
Related Publication 20240058074A1 · Feb 22, 2024
References Cited (400)
US 5148809A · Biegeleisen-Knight et al. · 1992 [cited by applicant]
US 5181513A · Touboul et al. · 1993 [cited by applicant]
US 5325293A · Dorne · 1994 [cited by applicant]
US 5441052A · Miyajima · 1995 [cited by applicant]
US 5549554A · Miraki · 1996 [cited by applicant]
US 5573529A · Haak et al. · 1996 [cited by applicant]
US 5775322A · Silverstein et al. · 1998 [cited by applicant]
US 5879297A · Haynor et al. · 1999 [cited by applicant]
US 5908387A · LeFree et al. · 1999 [cited by applicant]
US 5967984A · Chu et al. · 1999 [cited by applicant]
US 5970119A · Hofmann · 1999 [cited by applicant]
US 6004270A · Urbano et al. · 1999 [cited by applicant]
US 6019724A · Gronningsaeter et al. · 2000 [cited by applicant]
US 6068599A · Saito et al. · 2000 [cited by applicant]
US 6074367A · Hubbell · 2000 [cited by applicant]
US 6129668A · Haynor et al. · 2000 [cited by applicant]
US 6132379A · Patacsil et al. · 2000 [cited by applicant]
US 6216028B1 · Haynor et al. · 2001 [cited by applicant]
US 6233476B1 · Strommer et al. · 2001 [cited by applicant]
US 6245018B1 · Lee · 2001 [cited by applicant]
US 6263230B1 · Haynor et al. · 2001 [cited by applicant]
US 6375615B1 · Flaherty et al. · 2002 [cited by applicant]
US 6436043B2 · Bonnefous · 2002 [cited by applicant]
US 6498942B1 · Esenaliev et al. · 2002 [cited by applicant]
US 6503205B2 · Manor et al. · 2003 [cited by applicant]
US 6508769B2 · Bonnefous · 2003 [cited by applicant]
US 6511458B2 · Milo et al. · 2003 [cited by applicant]
US 6524249B2 · Moehring et al. · 2003 [cited by applicant]
US 6543642B1 · Milliorn · 2003 [cited by applicant]
US 6554771B1 · Buil et al. · 2003 [cited by applicant]
US 6592520B1 · Peszynski et al. · 2003 [cited by applicant]
US 6592565B2 · Twardowski · 2003 [cited by applicant]
US 6601705B2 · Molina et al. · 2003 [cited by applicant]
US 6612992B1 · Hossack et al. · 2003 [cited by applicant]
US 6613002B1 · Clark et al. · 2003 [cited by applicant]
US 6623431B1 · Sakuma et al. · 2003 [cited by applicant]
US 6641538B2 · Nakaya et al. · 2003 [cited by applicant]
US 6647135B2 · Bonnefous · 2003 [cited by applicant]
US 6687386B1 · Ito et al. · 2004 [cited by applicant]
US 6749569B1 · Pellegretti · 2004 [cited by applicant]
US 6754608B2 · Svanerudh et al. · 2004 [cited by applicant]
US 6755789B2 · Stringer et al. · 2004 [cited by applicant]
US 6840379B2 · Franks-Farah et al. · 2005 [cited by applicant]
US 6857196B2 · Dalrymple · 2005 [cited by applicant]
US 6979294B1 · Selzer et al. · 2005 [cited by applicant]
US 7074187B2 · Selzer et al. · 2006 [cited by applicant]
US 7244234B2 · Ridley et al. · 2007 [cited by applicant]
US 7359554B2 · Klingensmith et al. · 2008 [cited by applicant]
US 7534209B2 · Abend et al. · 2009 [cited by applicant]
US 7599730B2 · Hunter et al. · 2009 [cited by applicant]
US 7637870B2 · Flaherty et al. · 2009 [cited by applicant]
US 7681579B2 · Schwartz · 2010 [cited by applicant]
US 7691061B2 · Hirota · 2010 [cited by applicant]
US 7699779B2 · Sasaki et al. · 2010 [cited by applicant]
US 7720520B2 · Willis · 2010 [cited by applicant]
US 7727153B2 · Fritz et al. · 2010 [cited by applicant]
US 7734326B2 · Pedain et al. · 2010 [cited by applicant]
US 7831449B2 · Ying et al. · 2010 [cited by applicant]
US 7905837B2 · Suzuki · 2011 [cited by applicant]
US 7925327B2 · Weese · 2011 [cited by applicant]
US 7927278B2 · Selzer et al. · 2011 [cited by applicant]
US 8014848B2 · Birkenbach et al. · 2011 [cited by applicant]
US 8050523B2 · Younge et al. · 2011 [cited by applicant]
US 8060181B2 · Rodriguez Ponce et al. · 2011 [cited by applicant]
US 8068581B2 · Boese et al. · 2011 [cited by applicant]
US 8075488B2 · Burton · 2011 [cited by applicant]
US 8090427B2 · Eck et al. · 2012 [cited by applicant]
US 8105239B2 · Specht · 2012 [cited by applicant]
US 8172754B2 · Watanabe et al. · 2012 [cited by applicant]
US 8175368B2 · Sathyanarayana · 2012 [cited by applicant]
US 8200313B1 · Rambod et al. · 2012 [cited by applicant]
US 8211023B2 · Swan et al. · 2012 [cited by applicant]
US 8228347B2 · Beasley et al. · 2012 [cited by applicant]
US 8298147B2 · Huennekens et al. · 2012 [cited by applicant]
US 8303505B2 · Webler et al. · 2012 [cited by applicant]
US 8323202B2 · Roschak et al. · 2012 [cited by applicant]
US 8328727B2 · Miele et al. · 2012 [cited by applicant]
US 8388541B2 · Messerly et al. · 2013 [cited by applicant]
US 8409103B2 · Grunwald et al. · 2013 [cited by applicant]
US 8449465B2 · Nair et al. · 2013 [cited by applicant]
US 8553954B2 · Saikia · 2013 [cited by applicant]
US 8556815B2 · Pelissier et al. · 2013 [cited by applicant]
US 8585600B2 · Liu et al. · 2013 [cited by applicant]
US 8622913B2 · Dentinger et al. · 2014 [cited by applicant]
US 8706457B2 · Hart et al. · 2014 [cited by applicant]
US 8727988B2 · Flaherty et al. · 2014 [cited by applicant]
US 8734357B2 · Taylor · 2014 [cited by applicant]
US 8744211B2 · Owen · 2014 [cited by applicant]
US 8754865B2 · Merritt et al. · 2014 [cited by applicant]
US 8764663B2 · Smok et al. · 2014 [cited by applicant]
US 8781194B2 · Malek et al. · 2014 [cited by applicant]
US 8781555B2 · Burnside et al. · 2014 [cited by applicant]
US 8790263B2 · Randall et al. · 2014 [cited by applicant]
US 8849382B2 · Cox et al. · 2014 [cited by applicant]
US 8939908B2 · Suzuki et al. · 2015 [cited by applicant]
US 8961420B2 · Zhang · 2015 [cited by applicant]
US 9022940B2 · Meier · 2015 [cited by applicant]
US 9138290B2 · Hadjicostis · 2015 [cited by applicant]
US 9155517B2 · Dunbar et al. · 2015 [cited by applicant]
US 9204858B2 · Pelissier et al. · 2015 [cited by applicant]
US 9220477B2 · Urabe et al. · 2015 [cited by applicant]
US 9257220B2 · Nicholls et al. · 2016 [cited by applicant]
US 9295447B2 · Shah · 2016 [cited by applicant]
US 9320493B2 · Visveshwara · 2016 [cited by applicant]
US 9357980B2 · Toji et al. · 2016 [cited by applicant]
US 9364171B2 · Harris et al. · 2016 [cited by applicant]
US 9427207B2 · Sheldon et al. · 2016 [cited by applicant]
US 9445780B2 · Hossack et al. · 2016 [cited by applicant]
US 9456766B2 · Cox et al. · 2016 [cited by applicant]
US 9456804B2 · Tamada · 2016 [cited by applicant]
US 9459087B2 · Dunbar et al. · 2016 [cited by applicant]
US 9468413B2 · Hall et al. · 2016 [cited by applicant]
US 9492097B2 · Wilkes et al. · 2016 [cited by applicant]
US 9521961B2 · Silverstein et al. · 2016 [cited by applicant]
US 9554716B2 · Burnside et al. · 2017 [cited by applicant]
US 9582876B2 · Specht · 2017 [cited by applicant]
US 9597008B2 · Henkel et al. · 2017 [cited by applicant]
US 9610061B2 · Ebbini et al. · 2017 [cited by applicant]
US 9636031B2 · Cox · 2017 [cited by applicant]
US 9649037B2 · Lowe et al. · 2017 [cited by applicant]
US 9649048B2 · Cox et al. · 2017 [cited by applicant]
US 9702969B2 · Hope Simpson et al. · 2017 [cited by applicant]
US 9715757B2 · Ng et al. · 2017 [cited by applicant]
US 9717415B2 · Cohen et al. · 2017 [cited by applicant]
US 9731066B2 · Liu et al. · 2017 [cited by applicant]
US 9814433B2 · Benishti et al. · 2017 [cited by applicant]
US 9814531B2 · Yagi et al. · 2017 [cited by applicant]
US 9861337B2 · Patwardhan et al. · 2018 [cited by applicant]
US 9895138B2 · Sasaki · 2018 [cited by applicant]
US 9913605B2 · Harris et al. · 2018 [cited by applicant]
US 9949720B2 · Southard et al. · 2018 [cited by applicant]
US 10043272B2 · Forzoni et al. · 2018 [cited by applicant]
US 10380919B2 · Savitsky et al. · 2019 [cited by applicant]
US 10380920B2 · Savitsky et al. · 2019 [cited by applicant]
US 10424225B2 · Nataneli et al. · 2019 [cited by applicant]
US 10434278B2 · Dunbar et al. · 2019 [cited by applicant]
US 10449330B2 · Newman et al. · 2019 [cited by applicant]
US 10524691B2 · Newman et al. · 2020 [cited by applicant]
US 10674935B2 · Henkel et al. · 2020 [cited by applicant]
US 10751509B2 · Misener · 2020 [cited by applicant]
US 10758155B2 · Henkel et al. · 2020 [cited by applicant]
US 10765343B2 · Henkel et al. · 2020 [cited by applicant]
US 10896628B2 · Savitsky et al. · 2021 [cited by applicant]
US 11062624B2 · Savitsky et al. · 2021 [cited by applicant]
US 11120709B2 · Savitsky et al. · 2021 [cited by applicant]
US 11311269B2 · Dunbar et al. · 2022 [cited by applicant]
US 11315439B2 · Savitsky et al. · 2022 [cited by applicant]
US 11600201B1 · Savitsky et al. · 2023 [cited by applicant]
US 20020038088A1 · Imran et al. · 2002 [cited by applicant]
US 20020148277A1 · Umeda · 2002 [cited by applicant]
US 20030047126A1 · Tomaschko · 2003 [cited by applicant]
US 20030060714A1 · Henderson et al. · 2003 [cited by applicant]
US 20030073900A1 · Senarith et al. · 2003 [cited by applicant]
US 20030093001A1 · Martikainen · 2003 [cited by applicant]
US 20030106825A1 · Molina et al. · 2003 [cited by applicant]
US 20030120154A1 · Sauer et al. · 2003 [cited by applicant]
US 20040055925A1 · Franks-Farah et al. · 2004 [cited by applicant]
US 20050000975A1 · Carco et al. · 2005 [cited by applicant]
US 20050049504A1 · Lo et al. · 2005 [cited by applicant]
US 20050165299A1 · Kressy et al. · 2005 [cited by applicant]
US 20050251030A1 · Azar et al. · 2005 [cited by applicant]
US 20050267365A1 · Sokulin et al. · 2005 [cited by applicant]
US 20060013523A1 · Childlers et al. · 2006 [cited by applicant]
US 20060015039A1 · Cassidy et al. · 2006 [cited by applicant]
US 20060020204A1 · Serra et al. · 2006 [cited by applicant]
US 20060079781A1 · Germond-Rouet et al. · 2006 [cited by applicant]
US 20060184029A1 · Haim et al. · 2006 [cited by applicant]
US 20060210130A1 · Germond-Rouet et al. · 2006 [cited by applicant]
US 20070043341A1 · Anderson et al. · 2007 [cited by applicant]
US 20070049822A1 · Bunce et al. · 2007 [cited by applicant]
US 20070073155A1 · Park et al. · 2007 [cited by applicant]
US 20070199848A1 · Ellswood et al. · 2007 [cited by applicant]
US 20070239120A1 · Brock et al. · 2007 [cited by applicant]
US 20070249911A1 · Simon · 2007 [cited by applicant]
US 20080021322A1 · Stone et al. · 2008 [cited by applicant]
US 20080033293A1 · Beasley et al. · 2008 [cited by applicant]
US 20080033759A1 · Finlay · 2008 [cited by applicant]
US 20080051657A1 · Rold · 2008 [cited by applicant]
US 20080146915A1 · McMorrow · 2008 [cited by applicant]
US 20080177186A1 · Slater et al. · 2008 [cited by applicant]
US 20080221425A1 · Olson et al. · 2008 [cited by applicant]
US 20080294037A1 · Richter · 2008 [cited by applicant]
US 20080300491A1 · Bonde et al. · 2008 [cited by applicant]
US 20090012399A1 · Sunagawa et al. · 2009 [cited by applicant]
US 20090143672A1 · Harms et al. · 2009 [cited by applicant]
US 20090143684A1 · Cermak et al. · 2009 [cited by applicant]
US 20090156926A1 · Messerly et al. · 2009 [cited by applicant]
US 20090306509A1 · Pedersen et al. · 2009 [cited by applicant]
US 20100020926A1 · Boese et al. · 2010 [cited by applicant]
US 20100106015A1 · Norris · 2010 [cited by applicant]
US 20100179428A1 · Pedersen et al. · 2010 [cited by applicant]
US 20100211026A2 · Sheetz et al. · 2010 [cited by applicant]
US 20100277305A1 · Garner et al. · 2010 [cited by applicant]
US 20100286515A1 · Gravenstein et al. · 2010 [cited by applicant]
US 20100312121A1 · Guan · 2010 [cited by applicant]
US 20110002518A1 · Ziv-Ari et al. · 2011 [cited by applicant]
US 20110071404A1 · Schmitt et al. · 2011 [cited by applicant]
US 20110295108A1 · Cox et al. · 2011 [cited by applicant]
US 20110313293A1 · Lindekugel et al. · 2011 [cited by applicant]
US 20120179038A1 · Meurer et al. · 2012 [cited by applicant]
US 20120197132A1 · O'Connor · 2012 [cited by applicant]
US 20120209121A1 · Boudier · 2012 [cited by applicant]
US 20120220865A1 · Brown et al. · 2012 [cited by applicant]
US 20120238875A1 · Savitsky et al. · 2012 [cited by applicant]
US 20120277576A1 · Lui · 2012 [cited by applicant]
US 20130041250A1 · Pelissier et al. · 2013 [cited by applicant]
US 20130102889A1 · Southard et al. · 2013 [cited by applicant]
US 20130131499A1 · Chan et al. · 2013 [cited by applicant]
US 20130131502A1 · Blaivas et al. · 2013 [cited by applicant]
US 20130150724A1 · Blaivas et al. · 2013 [cited by applicant]
US 20130188832A1 · Ma et al. · 2013 [cited by applicant]
US 20130218024A1 · Boctor et al. · 2013 [cited by applicant]
US 20130324840A1 · Zhongping et al. · 2013 [cited by applicant]
US 20140005530A1 · Liu et al. · 2014 [cited by applicant]
US 20140031690A1 · Toji et al. · 2014 [cited by applicant]
US 20140036091A1 · Zalev et al. · 2014 [cited by applicant]
US 20140073976A1 · Fonte et al. · 2014 [cited by applicant]
US 20140100440A1 · Cheline et al. · 2014 [cited by applicant]
US 20140155737A1 · Manzke et al. · 2014 [cited by applicant]
US 20140180098A1 · Flaherty et al. · 2014 [cited by applicant]
US 20140188133A1 · Misener · 2014 [cited by applicant]
US 20140188440A1 · Donhowe et al. · 2014 [cited by applicant]
US 20140257104A1 · Dunbar · 2014 [cited by examiner]
US 20140276059A1 · Sheehan · 2014 [cited by applicant]
US 20140276081A1 · Tegels · 2014 [cited by applicant]
US 20140276085A1 · Miller · 2014 [cited by applicant]
US 20140276690A1 · Grace · 2014 [cited by applicant]
US 20140343431A1 · Vajinepalli et al. · 2014 [cited by applicant]
US 20150005738A1 · Blacker · 2015 [cited by applicant]
US 20150011887A1 · Ahn et al. · 2015 [cited by applicant]
US 20150065916A1 · Maguire et al. · 2015 [cited by applicant]
US 20150073279A1 · Cai et al. · 2015 [cited by applicant]
US 20150112200A1 · Oberg et al. · 2015 [cited by applicant]
US 20150209113A1 · Burkholz et al. · 2015 [cited by applicant]
US 20150209526A1 · Matsubara et al. · 2015 [cited by applicant]
US 20150294497A1 · Ng et al. · 2015 [cited by applicant]
US 20150297097A1 · Matsubara et al. · 2015 [cited by applicant]
US 20150327841A1 · Banjanin et al. · 2015 [cited by applicant]
US 20150359991A1 · Dunbar et al. · 2015 [cited by applicant]
US 20160029995A1 · Navratil et al. · 2016 [cited by applicant]
US 20160029998A1 · Brister et al. · 2016 [cited by applicant]
US 20160058420A1 · Cinthio · 2016 [cited by examiner]
US 20160100970A1 · Brister et al. · 2016 [cited by applicant]
US 20160101263A1 · Blumenkranz et al. · 2016 [cited by applicant]
US 20160113699A1 · Sverdlik et al. · 2016 [cited by applicant]
US 20160120607A1 · Sorotzkin et al. · 2016 [cited by applicant]
US 20160143622A1 · Xie et al. · 2016 [cited by applicant]
US 20160166232A1 · Merritt · 2016 [cited by applicant]
US 20160202053A1 · Walker et al. · 2016 [cited by applicant]
US 20160213398A1 · Liu · 2016 [cited by applicant]
US 20160278743A1 · Kawashima · 2016 [cited by applicant]
US 20160278869A1 · Grunwald · 2016 [cited by applicant]
US 20160296208A1 · Sethuraman et al. · 2016 [cited by applicant]
US 20160374644A1 · Mauldin, Jr. et al. · 2016 [cited by applicant]
US 20170079548A1 · Silverstein et al. · 2017 [cited by applicant]
US 20170086785A1 · Bjaerum · 2017 [cited by applicant]
US 20170100092A1 · Kruse · 2017 [cited by examiner]
US 20170164923A1 · Matsumoto · 2017 [cited by applicant]
US 20170172424A1 · Eggers et al. · 2017 [cited by applicant]
US 20170188839A1 · Tashiro · 2017 [cited by applicant]
US 20170196535A1 · Arai et al. · 2017 [cited by applicant]
US 20170215842A1 · Ryu et al. · 2017 [cited by applicant]
US 20170259013A1 · Boyden et al. · 2017 [cited by applicant]
US 20170265840A1 · Bharat et al. · 2017 [cited by applicant]
US 20170303894A1 · Scully · 2017 [cited by applicant]
US 20170367678A1 · Sirtori et al. · 2017 [cited by applicant]
US 20180015256A1 · Southard et al. · 2018 [cited by applicant]
US 20180116723A1 · Hettrick et al. · 2018 [cited by applicant]
US 20180125450A1 · Blackbourne et al. · 2018 [cited by applicant]
US 20180161502A1 · Nanan et al. · 2018 [cited by applicant]
US 20180199914A1 · Ramachandran et al. · 2018 [cited by applicant]
US 20180214119A1 · Mehrmohammadi et al. · 2018 [cited by applicant]
US 20180225993A1 · Buras et al. · 2018 [cited by applicant]
US 20180228465A1 · Southard et al. · 2018 [cited by applicant]
US 20180235576A1 · Brannan · 2018 [cited by applicant]
US 20180250078A1 · Shochat et al. · 2018 [cited by applicant]
US 20180272108A1 · Padilla et al. · 2018 [cited by applicant]
US 20180279996A1 · Cox et al. · 2018 [cited by applicant]
US 20180286287A1 · Razzaque · 2018 [cited by applicant]
US 20180310955A1 · Lindekugel et al. · 2018 [cited by applicant]
US 20180317881A1 · Astigarraga et al. · 2018 [cited by applicant]
US 20180366035A1 · Dunbar et al. · 2018 [cited by applicant]
US 20190060014A1 · Hazelton et al. · 2019 [cited by applicant]
US 20190069923A1 · Wang · 2019 [cited by applicant]
US 20190076121A1 · Southard et al. · 2019 [cited by applicant]
US 20190088019A1 · Prevrhal et al. · 2019 [cited by applicant]
US 20190105017A1 · Hastings · 2019 [cited by applicant]
US 20190117190A1 · Djajadiningrat et al. · 2019 [cited by applicant]
US 20190223757A1 · Durfee · 2019 [cited by applicant]
US 20190239850A1 · Dalvin et al. · 2019 [cited by applicant]
US 20190282324A1 · Freeman et al. · 2019 [cited by applicant]
US 20190298457A1 · Bharat · 2019 [cited by applicant]
US 20190307516A1 · Schotzko et al. · 2019 [cited by applicant]
US 20190339525A1 · Yanof et al. · 2019 [cited by applicant]
US 20190355278A1 · Sainsbury et al. · 2019 [cited by applicant]
US 20190365348A1 · Toume et al. · 2019 [cited by applicant]
US 20200041261A1 · Bernstein et al. · 2020 [cited by applicant]
US 20200069285A1 · Annangi et al. · 2020 [cited by applicant]
US 20200113540A1 · Gijsbers et al. · 2020 [cited by applicant]
US 20200129136A1 · Harding et al. · 2020 [cited by applicant]
US 20200188028A1 · Feiner et al. · 2020 [cited by applicant]
US 20200230391A1 · Burkholz et al. · 2020 [cited by applicant]
US 20210007710A1 · Douglas · 2021 [cited by applicant]
US 20210045716A1 · Shiran et al. · 2021 [cited by applicant]
US 20210166583A1 · Buras et al. · 2021 [cited by applicant]
US 20210307838A1 · Xia et al. · 2021 [cited by applicant]
US 20210353255A1 · Schneider et al. · 2021 [cited by applicant]
US 20210402144A1 · Messerly · 2021 [cited by applicant]
US 20220022969A1 · Misener · 2022 [cited by applicant]
US 20220031965A1 · Durfee · 2022 [cited by applicant]
US 20220039685A1 · Misener et al. · 2022 [cited by applicant]
US 20220039777A1 · Durfee · 2022 [cited by applicant]
US 20220096797A1 · Prince · 2022 [cited by applicant]
US 20220104886A1 · Blanchard et al. · 2022 [cited by applicant]
US 20220117582A1 · McLaughlin et al. · 2022 [cited by applicant]
US 20220160434A1 · Messerly et al. · 2022 [cited by applicant]
US 20220168050A1 · Sowards et al. · 2022 [cited by applicant]
US 20220172354A1 · Misener et al. · 2022 [cited by applicant]
US 20220211442A1 · McLaughlin et al. · 2022 [cited by applicant]
US 20220381630A1 · Sowards et al. · 2022 [cited by applicant]
US 20230113291A1 · de Wild et al. · 2023 [cited by applicant]
US 20230240643A1 · Cermak et al. · 2023 [cited by applicant]
US 20230389893A1 · Misener et al. · 2023 [cited by applicant]
US 20240008929A1 · Misener et al. · 2024 [cited by applicant]
US 20240050061A1 · McLaughlin et al. · 2024 [cited by applicant]
US 20240062678A1 · Sowards et al. · 2024 [cited by applicant]
AU 2006201646A1 · 2006 [cited by applicant]
CN 114129137B · 2022 [cited by applicant]
EP 0933063A1 · 1999 [cited by applicant]
EP 1504713A1 · 2005 [cited by applicant]
EP 1591074B1 · 2008 [cited by applicant]
EP 3181083A1 · 2017 [cited by applicant]
EP 3530221A1 · 2019 [cited by applicant]
JP 2000271136A · 2000 [cited by applicant]
JP 2014150928A · 2014 [cited by applicant]
JP 2018175547A · 2018 [cited by applicant]
KR 20180070878A · 2018 [cited by applicant]
KR 20190013133A · 2019 [cited by applicant]
WO 2013059714A1 · 2013 [cited by applicant]
WO 2014115150A1 · 2014 [cited by applicant]
WO 2014174305A2 · 2014 [cited by applicant]
WO 2015017270A1 · 2015 [cited by applicant]
WO 2017096487A1 · 2017 [cited by applicant]
WO 2017214428A1 · 2017 [cited by applicant]
WO 2018026878A1 · 2018 [cited by applicant]
WO 2018134726A1 · 2018 [cited by applicant]
WO 2018206473A1 · 2018 [cited by applicant]
WO 2019232451A1 · 2019 [cited by applicant]
WO 2020002620A1 · 2020 [cited by applicant]
WO 2020016018A1 · 2020 [cited by applicant]
WO 2019232454A9 · 2020 [cited by applicant]
WO 2020044769A1 · 2020 [cited by applicant]
WO 2020102665A1 · 2020 [cited by applicant]
WO 2020186198A1 · 2020 [cited by applicant]
WO 2022031762A1 · 2022 [cited by applicant]
WO 2022072727A2 · 2022 [cited by applicant]
WO 2022081904A1 · 2022 [cited by applicant]
WO 2022203713A2 · 2022 [cited by applicant]
WO 2022263763A1 · 2022 [cited by applicant]
WO 2023235435A1 · 2023 [cited by applicant]
WO 2024010940A1 · 2024 [cited by applicant]
WO 2024039608A1 · 2024 [cited by applicant]
WO 2024039719A1 · 2024 [cited by applicant]
PCT/US2023/030347 filed Aug. 16, 2023 International Search Report and Written Opinion dated Nov. 6, 2023. [cited by applicant]
U.S. Appl. No. 17/393,283, filed Aug. 3, 2021 Advisory Action dated Jan. 19, 2024. [cited by applicant]
U.S. Appl. No. 17/478,754, filed Sep. 17, 2021 Restriction Requirement dated Jan. 22, 2024. [cited by applicant]
U.S. Appl. No. 17/501,909, filed Oct. 14, 2021 Advisory Action dated Jan. 24, 2024. [cited by applicant]
U.S. Appl. No. 17/501,909, filed Oct. 14, 2021 Final Office Action dated Nov. 21, 2023. [cited by applicant]
U.S. Appl. No. 17/832,389, filed Jun. 3, 2022 Final Office Action dated Jan. 25, 2024. [cited by applicant]
U.S. Appl. No. 17/393,283, filed Aug. 3, 2021 Non-Final Office Action dated Feb. 29, 2024. [cited by applicant]
U.S. Appl. No. 17/397,486, filed Aug. 9, 2021 Non-Final Office Action dated Mar. 1, 2024. [cited by applicant]
U.S. Appl. No. 17/491,308, filed Sep. 30, 2021 Non-Final Office Action dated Mar. 22, 2024. [cited by applicant]
U.S. Appl. No. 17/501,909, filed Oct. 14, 2021 Non-Final Office Action dated Mar. 21, 2024. [cited by applicant]
U.S. Appl. No. 17/832,389, filed Jun. 3, 2022 Advisory Action dated Apr. 4, 2024. [cited by applicant]
U.S. Appl. No. 17/832,389, filed Jun. 3, 2022 Notice of Allowance dated May 15, 2024. [cited by applicant]
U.S. Appl. No. 17/861,031, filed Jul. 8, 2022 Final Office Action dated Mar. 15, 2024. [cited by applicant]
EZono, eZSimulator, https://www.ezono.com/en/ezsimulator/, last accessed Sep. 13, 2022. [cited by applicant]
Ikhsan Mohammad et al: “Assistive technology for ultrasound-guided central venous catheter placement”, Journal of Medical Ultrasonics, Japan Society of Ultrasonics in Medicine, Tokyo, JP, vol. 45, No. 1, Apr. 19, 2017, … [cited by applicant]
Lu Zhenyu et al “Recent advances in 5 robot-assisted echography combining perception control and cognition.” Cognitive Computation and Systems the Institution of Engineering and Technology, Michael Faraday House, Six Hi… [cited by applicant]
Pagoulatos, N. et al. “New spatial localizer based on fiber optics with applications in 3D ultrasound imaging” Proceeding of Spie, vol. 3976 (Apr. 18, 2000; Apr. 18, 2000). [cited by applicant]
PCT/US2021/042369 filed Jul. 20, 2021 International Search Report and Written Opinion dated Oct. 25, 2021. [cited by applicant]
PCT/US2021/044419 filed Aug. 3, 2021 International Search Report and Written Opinion dated Nov. 19, 2021. [cited by applicant]
PCT/US2021/045218 filed Aug. 9, 2021 International Search Report and Written Opinion dated Nov. 23, 2021. [cited by applicant]
PCT/US2021/050973 filed Sep. 17, 2021 International Search Report and Written Opinion dated Nov. 7, 2022. [cited by applicant]
PCT/US2021/053018 filed Sep. 30, 2021 International Search Report and Written Opinion dated May 3, 2022. [cited by applicant]
PCT/US2021/055076 filed Oct. 14, 2021 International Search Report and Written Opinion dated Mar. 25, 2022. [cited by applicant]
PCT/US2023/024067 filed May 31, 2023 International Search Report and Written Opinion dated Sep. 15, 2023. [cited by applicant]
PCT/US2023/027147 filed Jul. 7, 2023 International Search Report and Written Opinion dated Oct. 2, 2023. [cited by applicant]
PCT/US2023/030160 filed Aug. 14, 2023 International Search Report and Written Opinion dated Oct. 23, 2023. [cited by applicant]
Practical guide for safe central venous catheterization and management 2017 Journal of Anesthesia vol. 34 published online Nov. 30, 2019 pp. 167-186. [cited by applicant]
Sebastian Vogt: “Real-Time Augmented Reality for Image-Guided Interventions”, Oct. 5, 2009, XPO55354720, Retrieved from the Internet: URL: https://opus4.kobv.de/opus4-fau/frontdoor/deliver/index/docld/1235/file/Sebastia… [cited by applicant]
Sonosim, https://sonosim.com/ultrasound-simulation/? last accessed Sep. 13, 2022. [cited by applicant]
State, A., et al. (Aug. 1996). Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies. In Proceedings of the 23rd annual conference on computer graphics and interactive techniques (pp. 4… [cited by applicant]
Stolka, P.J., et al., (2014). Needle Guidance Using Handheld Stereo Vision and Projection for Ultrasound-Based Interventions. in: Galland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds) Medical Image Computin… [cited by applicant]
U.S. Appl. No. 17/380,767, filed Jul. 20, 2021 Non-Final Office Action dated Mar. 6, 2023. [cited by applicant]
U.S. Appl. No. 17/380,767, filed Jul. 20, 2021 Notice of Allowance dated Aug. 31, 2023. [cited by applicant]
U.S. Appl. No. 17/380,767 filed Jul. 20, 2021 Restriction Requirement dated Dec. 15, 2022. [cited by applicant]
U.S. Appl. No. 17/393,283 filed Aug. 3, 2021 Final Office Action dated Oct. 16, 2023. [cited by applicant]
U.S. Appl. No. 17/393,283 filed Aug. 3, 2021 Non-Final Office Action dated Mar. 31, 2023. [cited by applicant]
U.S. Appl. No. 17/393,283, filed Aug. 3, 2021 Restriction Requirement dated Jan. 12, 2023. [cited by applicant]