IP Library › Granted Patent US 12,186,070
Granted Patent B2
US 12,186,070 · App. 17/393,283 · Granted Jan 7, 2025

Systemized and method for optimized medical component insertion monitoring and imaging enhancement

Inventors: Anthony K. Misener (Bountiful, UT); Steffan Sowards (Salt Lake City, UT); Shayne Messerly (Kaysville, UT); William Robert McLaughlin (Bountiful, UT)
Assignee: Bard Access Systems, Inc.
A61B5/065A61B5/6848A61B5/7264A61B5/74A61B5/7405A61B8/0841
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,186,070
App. No.
17/393,283
Granted
Jan 7, 2025
Kind
B2
Abstract

According to one embodiment, a guidance system is described for assisting in an advancement of a medical component within a body of a patient. The guidance system features a probe and a console. The console is communicatively coupled to the probe and features AI-based visualization controls and AI-based guidance assistance logic. The AI-based visualization controls are configured to generate, position, and reposition a visualization area between the medical component and a targeted vasculature of the patient. The visualization area is a sub-region of a total imaging area rendered by the console. The AI-based guidance assistance logic is configured to monitor for a presence of the medical component within the visualization area, provide a feedback for generating a notification that the medical component is within the visualization area, and apply an imaging enhancement to at least a portion of imaged data within the visualization area to assist in the advancement.

Claims (56)

1. A guidance system, comprising:

a probe configured to obtain an ultrasound image; and

a console communicatively coupled to the probe, the console comprising a processor and non-transitory, computer-readable medium having stored thereon logic, that when executed by the processor, causes performance of operations including:

determining positioning of a visualization area within the ultrasound image, wherein the visualization area corresponds to a portion of a targeted vasculature at which a needle is expected to contact, wherein the needle is associated with a magnetic element from which a magnetic field is detected by the probe,

generating a display of the ultrasound image and the visualization area on a display screen, wherein a border is superimposed on the ultrasound image surrounding the visualization area,

monitoring for a presence of the needle within a patient body corresponding to the visualization area based on position and orientation information of the needle derived from the magnetic field, and

in response to detection of the presence of the needle within an area of the patient body corresponding to the visualization area, generating and applying an imaging enhancement visualization to at least a portion of imaged data within the visualization area being an alteration of a visual style of the border of the visualization area based on entry into the area of the patient body corresponding to the visualization area, wherein the imaging enhancement visualization is configured to assist in advancement of the needle toward the targeted vasculature, and wherein the visualization area is a sub-region of a total imaging area rendered by the console.

2. The guidance system as defined in claim 1 , wherein the operations further include:

monitoring for needle feedback from sound waves emitted and recovered by the probe.

3. The guidance system as defined in claim 1 , wherein the needle from which a needle reflection is detected when the probe is operating as a part of an ultrasound system.

4. The guidance system as defined in claim 1 , wherein the operations further include:

monitoring for needle feedback based on the magnetic field detected by the probe based on the magnetic element being deployed within the needle.

5. The guidance system as defined in claim 1 , wherein the operations further include:

generating feedback that visibly identifies the presence of the needle within the visualization area.

6. The guidance system as defined in claim 5 , wherein the operations further include:

generating signaling to illuminate a light element within the probe that identifies the needle is within the visualization area proximate to the targeted vasculature.

7. The guidance system as defined in claim 1 , wherein the operations further include:

generating feedback to an audio device for use in generating an audible notification to identify the presence of the needle within the visualization area proximate to the targeted vasculature.

8. The guidance system as defined in claim 1 , wherein the operations further include:

generating feedback to a haptic feedback device deployed within the probe for use in generating a haptic notification operating as a controlled of the probe.

9. The guidance system as defined in claim 1 , wherein the console further comprises artificial intelligence based (AI-based) visualization controls to generate the visualization area and AI-based guidance assistance logic to (i) monitor for the presence of the needle within the visualization area proximate to the targeted vasculature, (ii) provide feedback to a device for generating the notification of the presence of the needle within the visualization area, and (iii) generate and apply an imaging enhancement to at least the portion of the imaged data within the visualization area to assist in an advancement of the needle toward the targeted vasculature.

10. The guidance system as defined in claim 1 , wherein the imaging enhancement visualization includes a color overlay of at least a portion of an image of the needle to provide better clarity as to a position of the needle.

11. The guidance system as defined in claim 1 , wherein the imaging enhancement visualization includes a virtual representation of the visualization area with the needle and the targeted vasculature.

12. The guidance system as defined in claim 9 , wherein the notification includes an activation of a light on the probe or a light of the console to identify whether the needle is entering or exiting the targeted vasculature.

13. A guidance system for assisting in an advancement of a needle within a body of a patient, comprising:

a probe configured to obtain an ultrasound image; and

a console including a processor and memory, wherein the console is communicatively coupled to the probe, the memory having stored thereon logic that, when executed by the processor, is configured to cause performance of operations including:

determining positioning of a visualization area within the ultrasound image, wherein the visualization area corresponds to a subset of the ultrasound image and corresponds to a portion of a targeted vasculature at which the needle is expected to contact based on a position and an orientation of the needle, wherein the needle is associated with a magnetic element from which a magnetic field is detected by the probe;

generating a display of the ultrasound image and the visualization area on a display screen, wherein a border is superimposed on the ultrasound image surrounding the visualization area;

monitoring for a presence of the needle within the body of the patient corresponding to the visualization area based on position and orientation information of the needle derived from the magnetic field; and

in response to detection of the presence of the needle within an area of the body of the patient corresponding to the visualization area, generating and applying an imaging enhancement visualization to at least a portion of imaged data within the visualization area being an alteration of a visual style of the border of the visualization area based on entry into the area of the body of the patient corresponding to the visualization area, wherein the imaging enhancement visualization is configured to assist in the advancement of the needle toward the targeted vasculature, and wherein the visualization area is a sub-region of a total imaging area rendered by the console.

14. The guidance system as defined in claim 13 , wherein the operations further include:

generating the visualization area to overlay a portion of the total imaging area rendered by the guidance system; and

positioning and re-positioning the visualization area within the total imaging area along a path to intercept the visualization area.

15. The guidance system as defined in claim 13 , wherein the imaging enhancement visualization includes a color overlay of at least a portion of an image of the needle to provide better clarity as to the position of the needle.

16. The guidance system as defined in claim 13 , wherein the operations further include:

activating a light on the probe or a light of the console to identify whether the needle is entering or exiting the targeted vasculature.

17. The guidance system as defined in claim 13 , wherein a needle reflection is detected from return sound waves generated by the probe when the console is operating as a part of an ultrasound system.

18. The guidance system as defined in claim 13 , wherein the operations further include:

providing a feedback to a device for generating a notification of the presence of the needle within the visualization area.

19. The guidance system as defined in claim 13 , wherein the magnetic element is disposed within a hub coupled to the needle.

20. A method comprising:

obtaining an ultrasound image from an ultrasound probe;

determining a visualization area being a portion of the ultrasound image, wherein the visualization area corresponds to a subset of the ultrasound image and corresponds to a portion of a targeted vasculature at which a needle is expected to contact based on a position and an orientation of the needle, wherein the needle is associated with a magnetic element from which a magnetic field is detected by the ultrasound probe;

generating a display of the ultrasound image and the visualization area on a display screen, wherein a border is superimposed on the ultrasound image surrounding the visualization area;

monitoring for a presence of the needle within a patient body corresponding to the visualization area based on position and orientation information of the needle derived from the magnetic field; and

in response to detection of the presence of the needle within an area of the patient body corresponding to the visualization area, generating and applying an imaging enhancement visualization to at least a portion of imaged data within the visualization area being an alteration of a visual style of the border of the visualization area based on entry into the area of the patient body corresponding to the visualization area, wherein the imaging enhancement visualization is configured to assist in advancement of the needle toward the targeted vasculature, and wherein the visualization area is a sub-region of a total imaging area rendered by a console.

21. A guidance system for assisting in an advancement of a needle within a body of a patient, comprising:

a probe configured to obtain an ultrasound image; and

a console including a processor and memory, wherein the console is communicatively coupled to the probe, the memory having stored thereon logic that, when executed by the processor, is configured to cause performance of operations including:

determining positioning of a visualization area within the ultrasound image, wherein the visualization area corresponds to a subset of the ultrasound image and corresponds to a portion of a targeted vasculature at which the needle is expected to contact based on a position and an orientation of the needle;

activating a light on the probe or a light of the console that identifies whether the needle is entering or exiting the targeted vasculature;

generating a display of the ultrasound image and the visualization area on a display

screen, wherein a border is superimposed on the ultrasound image surrounding the visualization area;

monitoring for a presence of the needle within the body of the patient corresponding to the visualization area based on position and orientation information of the needle derived from a magnetic field; and

in response to detection of the presence of the needle within an area of the body of the patient corresponding to the visualization area, generating and applying an imaging enhancement visualization to at least a portion of imaged data within the visualization area being an alteration of a visual style of the border of the visualization area based on entry into the area of the body of the patient corresponding to the visualization area, wherein the imaging enhancement visualization is configured to assist in the advancement of the needle toward the targeted vasculature, and wherein the visualization area is a sub-region of a total imaging area rendered by the console.

Continuity (2)
Provisional Application 63061120 · Aug 4, 2020
Related Publication 20220039685A1 · Feb 10, 2022
References Cited (400)
US 4311138A · Sugarman · 1982 [cited by examiner]
US 4971068A · Sahi · 1990 [cited by examiner]
US 5148809A · Biegeleisen-Knight et al. · 1992 [cited by applicant]
US 5181513A · Touboul et al. · 1993 [cited by applicant]
US 5325293A · Dorne · 1994 [cited by applicant]
US 5441052A · Miyajima · 1995 [cited by applicant]
US 5549554A · Miraki · 1996 [cited by applicant]
US 5573529A · Haak et al. · 1996 [cited by applicant]
US 5775322A · Silverstein et al. · 1998 [cited by applicant]
US 5879297A · Haynor et al. · 1999 [cited by applicant]
US 5908387A · LeFree et al. · 1999 [cited by applicant]
US 5967984A · Chu et al. · 1999 [cited by applicant]
US 5970119A · Hofmann · 1999 [cited by applicant]
US 6004270A · Urbano et al. · 1999 [cited by applicant]
US 6019724A · Gronningsaeter et al. · 2000 [cited by applicant]
US 6068599A · Saito et al. · 2000 [cited by applicant]
US 6074367A · Hubbell · 2000 [cited by applicant]
US 6129668A · Haynor et al. · 2000 [cited by applicant]
US 6132379A · Patacsil et al. · 2000 [cited by applicant]
US 6216028B1 · Haynor et al. · 2001 [cited by applicant]
US 6233476B1 · Strommer et al. · 2001 [cited by applicant]
US 6245018B1 · Lee · 2001 [cited by applicant]
US 6263230B1 · Haynor et al. · 2001 [cited by applicant]
US 6375615B1 · Flaherty et al. · 2002 [cited by applicant]
US 6436043B2 · Bonnefous · 2002 [cited by applicant]
US 6498942B1 · Esenaliev et al. · 2002 [cited by applicant]
US 6503205B2 · Manor et al. · 2003 [cited by applicant]
US 6508769B2 · Bonnefous · 2003 [cited by applicant]
US 6511458B2 · Milo et al. · 2003 [cited by applicant]
US 6524249B2 · Moehring et al. · 2003 [cited by applicant]
US 6543642B1 · Milliorn · 2003 [cited by applicant]
US 6554771B1 · Buil et al. · 2003 [cited by applicant]
US 6592520B1 · Peszynski et al. · 2003 [cited by applicant]
US 6592565B2 · Twardowski · 2003 [cited by applicant]
US 6601705B2 · Molina et al. · 2003 [cited by applicant]
US 6612992B1 · Hossack et al. · 2003 [cited by applicant]
US 6613002B1 · Clark et al. · 2003 [cited by applicant]
US 6623431B1 · Sakuma et al. · 2003 [cited by applicant]
US 6641538B2 · Nakaya et al. · 2003 [cited by applicant]
US 6647135B2 · Bonnefous · 2003 [cited by applicant]
US 6687386B1 · Ito et al. · 2004 [cited by applicant]
US 6749569B1 · Pellegretti · 2004 [cited by applicant]
US 6754608B2 · Svanerudh et al. · 2004 [cited by applicant]
US 6755789B2 · Stringer et al. · 2004 [cited by applicant]
US 6840379B2 · Franks-Farah et al. · 2005 [cited by applicant]
US 6857196B2 · Dalrymple · 2005 [cited by applicant]
US 6979294B1 · Selzer et al. · 2005 [cited by applicant]
US 7074187B2 · Selzer et al. · 2006 [cited by applicant]
US 7244234B2 · Ridley et al. · 2007 [cited by applicant]
US 7359554B2 · Klingensmith et al. · 2008 [cited by applicant]
US 7534209B2 · Abend et al. · 2009 [cited by applicant]
US 7599730B2 · Hunter et al. · 2009 [cited by applicant]
US 7637870B2 · Flaherty et al. · 2009 [cited by applicant]
US 7681579B2 · Schwartz · 2010 [cited by applicant]
US 7691061B2 · Hirota · 2010 [cited by applicant]
US 7699779B2 · Sasaki et al. · 2010 [cited by applicant]
US 7720520B2 · Willis · 2010 [cited by applicant]
US 7727153B2 · Fritz et al. · 2010 [cited by applicant]
US 7734326B2 · Pedain et al. · 2010 [cited by applicant]
US 7831449B2 · Ying et al. · 2010 [cited by applicant]
US 7905837B2 · Suzuki · 2011 [cited by applicant]
US 7925327B2 · Weese · 2011 [cited by applicant]
US 7927278B2 · Selzer et al. · 2011 [cited by applicant]
US 8014848B2 · Birkenbach et al. · 2011 [cited by applicant]
US 8050523B2 · Younge et al. · 2011 [cited by applicant]
US 8060181B2 · Rodriguez Ponce et al. · 2011 [cited by applicant]
US 8068581B2 · Boese et al. · 2011 [cited by applicant]
US 8075488B2 · Burton · 2011 [cited by applicant]
US 8090427B2 · Eck et al. · 2012 [cited by applicant]
US 8105239B2 · Specht · 2012 [cited by applicant]
US 8172754B2 · Watanabe et al. · 2012 [cited by applicant]
US 8175368B2 · Sathyanarayana · 2012 [cited by applicant]
US 8200313B1 · Rambod et al. · 2012 [cited by applicant]
US 8211023B2 · Swan et al. · 2012 [cited by applicant]
US 8228347B2 · Beasley et al. · 2012 [cited by applicant]
US 8298147B2 · Huennekens et al. · 2012 [cited by applicant]
US 8303505B2 · Webler et al. · 2012 [cited by applicant]
US 8323202B2 · Roschak et al. · 2012 [cited by applicant]
US 8328727B2 · Miele et al. · 2012 [cited by applicant]
US 8388541B2 · Messerly et al. · 2013 [cited by applicant]
US 8409103B2 · Grunwald et al. · 2013 [cited by applicant]
US 8449465B2 · Nair et al. · 2013 [cited by applicant]
US 8553954B2 · Saikia · 2013 [cited by applicant]
US 8556815B2 · Pelissier et al. · 2013 [cited by applicant]
US 8585600B2 · Liu et al. · 2013 [cited by applicant]
US 8622913B2 · Dentinger et al. · 2014 [cited by applicant]
US 8706457B2 · Hart et al. · 2014 [cited by applicant]
US 8727988B2 · Flaherty et al. · 2014 [cited by applicant]
US 8734357B2 · Taylor · 2014 [cited by applicant]
US 8744211B2 · Owen · 2014 [cited by applicant]
US 8754865B2 · Merritt et al. · 2014 [cited by applicant]
US 8764663B2 · Smok et al. · 2014 [cited by applicant]
US 8781194B2 · Malek et al. · 2014 [cited by applicant]
US 8781555B2 · Burnside et al. · 2014 [cited by applicant]
US 8790263B2 · Randall et al. · 2014 [cited by applicant]
US 8849382B2 · Cox et al. · 2014 [cited by applicant]
US 8939908B2 · Suzuki et al. · 2015 [cited by applicant]
US 8961420B2 · Zhang · 2015 [cited by applicant]
US 9022940B2 · Meier · 2015 [cited by applicant]
US 9138290B2 · Hadjicostis · 2015 [cited by applicant]
US 9155517B2 · Dunbar et al. · 2015 [cited by applicant]
US 9204858B2 · Pelissier et al. · 2015 [cited by applicant]
US 9220477B2 · Urabe et al. · 2015 [cited by applicant]
US 9257220B2 · Nicholls et al. · 2016 [cited by applicant]
US 9295447B2 · Shah · 2016 [cited by applicant]
US 9320493B2 · Visveshwara · 2016 [cited by applicant]
US 9357980B2 · Toji et al. · 2016 [cited by applicant]
US 9364171B2 · Harris et al. · 2016 [cited by applicant]
US 9427207B2 · Sheldon et al. · 2016 [cited by applicant]
US 9445780B2 · Hossack et al. · 2016 [cited by applicant]
US 9456766B2 · Cox et al. · 2016 [cited by applicant]
US 9456804B2 · Tamada · 2016 [cited by applicant]
US 9459087B2 · Dunbar et al. · 2016 [cited by applicant]
US 9468413B2 · Hall et al. · 2016 [cited by applicant]
US 9492097B2 · Wilkes et al. · 2016 [cited by applicant]
US 9521961B2 · Silverstein et al. · 2016 [cited by applicant]
US 9554716B2 · Burnside et al. · 2017 [cited by applicant]
US 9582876B2 · Specht · 2017 [cited by applicant]
US 9597008B2 · Henkel et al. · 2017 [cited by applicant]
US 9610061B2 · Ebbini et al. · 2017 [cited by applicant]
US 9636031B2 · Cox · 2017 [cited by applicant]
US 9649037B2 · Lowe et al. · 2017 [cited by applicant]
US 9649048B2 · Cox et al. · 2017 [cited by applicant]
US 9702969B2 · Hope Simpson et al. · 2017 [cited by applicant]
US 9715757B2 · Ng et al. · 2017 [cited by applicant]
US 9717415B2 · Cohen et al. · 2017 [cited by applicant]
US 9731066B2 · Liu et al. · 2017 [cited by applicant]
US 9814433B2 · Benishti et al. · 2017 [cited by applicant]
US 9814531B2 · Yagi et al. · 2017 [cited by applicant]
US 9861337B2 · Patwardhan et al. · 2018 [cited by applicant]
US 9895138B2 · Sasaki · 2018 [cited by applicant]
US 9913605B2 · Harris et al. · 2018 [cited by applicant]
US 9949720B2 · Southard et al. · 2018 [cited by applicant]
US 10043272B2 · Forzoni et al. · 2018 [cited by applicant]
US 10380919B2 · Savitsky et al. · 2019 [cited by applicant]
US 10380920B2 · Savitsky et al. · 2019 [cited by applicant]
US 10424225B2 · Nataneli et al. · 2019 [cited by applicant]
US 10434278B2 · Dunbar et al. · 2019 [cited by applicant]
US 10449330B2 · Newman et al. · 2019 [cited by applicant]
US 10524691B2 · Newman et al. · 2020 [cited by applicant]
US 10674935B2 · Henkel et al. · 2020 [cited by applicant]
US 10751509B2 · Misener · 2020 [cited by applicant]
US 10758155B2 · Henkel et al. · 2020 [cited by applicant]
US 10765343B2 · Henkel et al. · 2020 [cited by applicant]
US 10896628B2 · Savitsky et al. · 2021 [cited by applicant]
US 11062624B2 · Savitsky et al. · 2021 [cited by applicant]
US 11120709B2 · Savitsky et al. · 2021 [cited by applicant]
US 11311269B2 · Dunbar et al. · 2022 [cited by applicant]
US 11315439B2 · Savitsky et al. · 2022 [cited by applicant]
US 11600201B1 · Savitsky et al. · 2023 [cited by applicant]
US 20020038088A1 · Imran et al. · 2002 [cited by applicant]
US 20020148277A1 · Umeda · 2002 [cited by applicant]
US 20030047126A1 · Tomaschko · 2003 [cited by applicant]
US 20030060714A1 · Henderson et al. · 2003 [cited by applicant]
US 20030073900A1 · Senarith et al. · 2003 [cited by applicant]
US 20030093001A1 · Martikainen · 2003 [cited by applicant]
US 20030106825A1 · Molina et al. · 2003 [cited by applicant]
US 20030120154A1 · Sauer et al. · 2003 [cited by applicant]
US 20040055925A1 · Franks-Farah et al. · 2004 [cited by applicant]
US 20050000975A1 · Carco et al. · 2005 [cited by applicant]
US 20050049504A1 · Lo et al. · 2005 [cited by applicant]
US 20050165299A1 · Kressy et al. · 2005 [cited by applicant]
US 20050251030A1 · Azar et al. · 2005 [cited by applicant]
US 20050267365A1 · Sokulin et al. · 2005 [cited by applicant]
US 20060013523A1 · Childlers et al. · 2006 [cited by applicant]
US 20060015039A1 · Cassidy et al. · 2006 [cited by applicant]
US 20060020204A1 · Serra · 2006 [cited by examiner]
US 20060079781A1 · Germond-Rouet et al. · 2006 [cited by applicant]
US 20060184029A1 · Haim et al. · 2006 [cited by applicant]
US 20060210130A1 · Germond-Rouet et al. · 2006 [cited by applicant]
US 20070043341A1 · Anderson et al. · 2007 [cited by applicant]
US 20070049822A1 · Bunce et al. · 2007 [cited by applicant]
US 20070073155A1 · Park et al. · 2007 [cited by applicant]
US 20070199848A1 · Ellswood et al. · 2007 [cited by applicant]
US 20070239120A1 · Brock et al. · 2007 [cited by applicant]
US 20070249911A1 · Simon · 2007 [cited by applicant]
US 20080021322A1 · Stone et al. · 2008 [cited by applicant]
US 20080033293A1 · Beasley et al. · 2008 [cited by applicant]
US 20080033759A1 · Finlay · 2008 [cited by applicant]
US 20080051657A1 · Rold · 2008 [cited by applicant]
US 20080146915A1 · McMorrow · 2008 [cited by applicant]
US 20080177186A1 · Slater et al. · 2008 [cited by applicant]
US 20080221425A1 · Olson et al. · 2008 [cited by applicant]
US 20080294037A1 · Richter · 2008 [cited by applicant]
US 20080300491A1 · Bonde et al. · 2008 [cited by applicant]
US 20090012399A1 · Sunagawa et al. · 2009 [cited by applicant]
US 20090143672A1 · Harms et al. · 2009 [cited by applicant]
US 20090143684A1 · Cermak et al. · 2009 [cited by applicant]
US 20090156926A1 · Messerly et al. · 2009 [cited by applicant]
US 20090306509A1 · Pedersen et al. · 2009 [cited by applicant]
US 20100020926A1 · Boese et al. · 2010 [cited by applicant]
US 20100106015A1 · Norris · 2010 [cited by applicant]
US 20100179428A1 · Pedersen et al. · 2010 [cited by applicant]
US 20100211026A2 · Sheetz et al. · 2010 [cited by applicant]
US 20100277305A1 · Garner et al. · 2010 [cited by applicant]
US 20100286515A1 · Gravenstein et al. · 2010 [cited by applicant]
US 20100312121A1 · Guan · 2010 [cited by applicant]
US 20110002518A1 · Ziv-Ari et al. · 2011 [cited by applicant]
US 20110071404A1 · Schmitt et al. · 2011 [cited by applicant]
US 20110166451A1 · Blaivas · 2011 [cited by examiner]
US 20110288405A1 · Razavi · 2011 [cited by examiner]
US 20110295108A1 · Cox et al. · 2011 [cited by applicant]
US 20110313293A1 · Lindekugel et al. · 2011 [cited by applicant]
US 20120136242A1 · Qi · 2012 [cited by examiner]
US 20120179038A1 · Meurer et al. · 2012 [cited by applicant]
US 20120197132A1 · O'Connor · 2012 [cited by applicant]
US 20120209121A1 · Boudier · 2012 [cited by applicant]
US 20120220865A1 · Brown et al. · 2012 [cited by applicant]
US 20120238875A1 · Savitsky et al. · 2012 [cited by applicant]
US 20120277576A1 · Lui · 2012 [cited by applicant]
US 20130041250A1 · Pelissier et al. · 2013 [cited by applicant]
US 20130102889A1 · Southard · 2013 [cited by examiner]
US 20130131499A1 · Chan et al. · 2013 [cited by applicant]
US 20130131502A1 · Blaivas et al. · 2013 [cited by applicant]
US 20130150724A1 · Blaivas et al. · 2013 [cited by applicant]
US 20130188832A1 · Ma et al. · 2013 [cited by applicant]
US 20130218024A1 · Boctor et al. · 2013 [cited by applicant]
US 20130324840A1 · Zhongping · 2013 [cited by examiner]
US 20140005530A1 · Liu et al. · 2014 [cited by applicant]
US 20140031690A1 · Toji et al. · 2014 [cited by applicant]
US 20140036091A1 · Zalev et al. · 2014 [cited by applicant]
US 20140073976A1 · Fonte et al. · 2014 [cited by applicant]
US 20140100440A1 · Cheline et al. · 2014 [cited by applicant]
US 20140155737A1 · Manzke et al. · 2014 [cited by applicant]
US 20140180098A1 · Flaherty et al. · 2014 [cited by applicant]
US 20140188133A1 · Misener · 2014 [cited by applicant]
US 20140188440A1 · Donhowe et al. · 2014 [cited by applicant]
US 20140257104A1 · Dunbar et al. · 2014 [cited by applicant]
US 20140276059A1 · Sheehan · 2014 [cited by applicant]
US 20140276081A1 · Tegels · 2014 [cited by applicant]
US 20140276085A1 · Miller · 2014 [cited by applicant]
US 20140276690A1 · Grace · 2014 [cited by applicant]
US 20140343431A1 · Vajinepalli et al. · 2014 [cited by applicant]
US 20150005738A1 · Blacker · 2015 [cited by applicant]
US 20150011887A1 · Ahn et al. · 2015 [cited by applicant]
US 20150065916A1 · Maguire et al. · 2015 [cited by applicant]
US 20150073279A1 · Cai et al. · 2015 [cited by applicant]
US 20150112200A1 · Oberg et al. · 2015 [cited by applicant]
US 20150209113A1 · Burkholz et al. · 2015 [cited by applicant]
US 20150209526A1 · Matsubara et al. · 2015 [cited by applicant]
US 20150294497A1 · Ng · 2015 [cited by examiner]
US 20150297097A1 · Matsubara et al. · 2015 [cited by applicant]
US 20150327841A1 · Banjanin et al. · 2015 [cited by applicant]
US 20150359991A1 · Dunbar · 2015 [cited by examiner]
US 20160029995A1 · Navratil et al. · 2016 [cited by applicant]
US 20160029998A1 · Brister et al. · 2016 [cited by applicant]
US 20160058420A1 · Cinthio et al. · 2016 [cited by applicant]
US 20160100970A1 · Brister · 2016 [cited by examiner]
US 20160101263A1 · Blumenkranz et al. · 2016 [cited by applicant]
US 20160113699A1 · Sverdlik et al. · 2016 [cited by applicant]
US 20160120607A1 · Sorotzkin et al. · 2016 [cited by applicant]
US 20160143622A1 · Xie et al. · 2016 [cited by applicant]
US 20160166232A1 · Merritt · 2016 [cited by applicant]
US 20160202053A1 · Walker et al. · 2016 [cited by applicant]
US 20160213398A1 · Liu · 2016 [cited by applicant]
US 20160278743A1 · Kawashima · 2016 [cited by applicant]
US 20160278869A1 · Grunwald · 2016 [cited by applicant]
US 20160296208A1 · Sethuraman et al. · 2016 [cited by applicant]
US 20160374644A1 · Mauldin, Jr. et al. · 2016 [cited by applicant]
US 20170079548A1 · Silverstein et al. · 2017 [cited by applicant]
US 20170086785A1 · Bjaerum · 2017 [cited by applicant]
US 20170100092A1 · Kruse et al. · 2017 [cited by applicant]
US 20170164923A1 · Matsumoto · 2017 [cited by applicant]
US 20170172424A1 · Eggers et al. · 2017 [cited by applicant]
US 20170188839A1 · Tashiro · 2017 [cited by examiner]
US 20170196535A1 · Arai et al. · 2017 [cited by applicant]
US 20170215842A1 · Ryu et al. · 2017 [cited by applicant]
US 20170259013A1 · Boyden et al. · 2017 [cited by applicant]
US 20170265840A1 · Bharat et al. · 2017 [cited by applicant]
US 20170303894A1 · Scully · 2017 [cited by applicant]
US 20170367678A1 · Sirtori et al. · 2017 [cited by applicant]
US 20180015256A1 · Southard et al. · 2018 [cited by applicant]
US 20180116723A1 · Hettrick et al. · 2018 [cited by applicant]
US 20180125450A1 · Blackbourne et al. · 2018 [cited by applicant]
US 20180161502A1 · Nanan et al. · 2018 [cited by applicant]
US 20180199914A1 · Ramachandran et al. · 2018 [cited by applicant]
US 20180214119A1 · Mehrmohammadi et al. · 2018 [cited by applicant]
US 20180225993A1 · Buras et al. · 2018 [cited by applicant]
US 20180228465A1 · Southard et al. · 2018 [cited by applicant]
US 20180235576A1 · Brannan · 2018 [cited by examiner]
US 20180250078A1 · Shochat · 2018 [cited by examiner]
US 20180272108A1 · Padilla et al. · 2018 [cited by applicant]
US 20180279996A1 · Cox et al. · 2018 [cited by applicant]
US 20180286287A1 · Razzaque · 2018 [cited by applicant]
US 20180310955A1 · Lindekugel · 2018 [cited by examiner]
US 20180317881A1 · Astigarraga et al. · 2018 [cited by applicant]
US 20180366035A1 · Dunbar et al. · 2018 [cited by applicant]
US 20190060014A1 · Hazelton et al. · 2019 [cited by applicant]
US 20190069923A1 · Wang · 2019 [cited by applicant]
US 20190076121A1 · Southard et al. · 2019 [cited by applicant]
US 20190088019A1 · Prevrhal et al. · 2019 [cited by applicant]
US 20190105017A1 · Hastings · 2019 [cited by applicant]
US 20190117190A1 · Djajadiningrat et al. · 2019 [cited by applicant]
US 20190223757A1 · Durfee · 2019 [cited by applicant]
US 20190239850A1 · Dalvin et al. · 2019 [cited by applicant]
US 20190282324A1 · Freeman et al. · 2019 [cited by applicant]
US 20190298457A1 · Bharat · 2019 [cited by applicant]
US 20190307516A1 · Schotzko et al. · 2019 [cited by applicant]
US 20190339525A1 · Yanof et al. · 2019 [cited by applicant]
US 20190355278A1 · Sainsbury et al. · 2019 [cited by applicant]
US 20190365348A1 · Toume et al. · 2019 [cited by applicant]
US 20200041261A1 · Bernstein et al. · 2020 [cited by applicant]
US 20200069285A1 · Annangi et al. · 2020 [cited by applicant]
US 20200069929A1 · Mason · 2020 [cited by examiner]
US 20200113540A1 · Gijsbers et al. · 2020 [cited by applicant]
US 20200129136A1 · Harding et al. · 2020 [cited by applicant]
US 20200188028A1 · Feiner et al. · 2020 [cited by applicant]
US 20200230391A1 · Burkholz et al. · 2020 [cited by applicant]
US 20210007710A1 · Douglas · 2021 [cited by applicant]
US 20210045716A1 · Shiran et al. · 2021 [cited by applicant]
US 20210166583A1 · Buras et al. · 2021 [cited by applicant]
US 20210307838A1 · Xia et al. · 2021 [cited by applicant]
US 20210353255A1 · Schneider et al. · 2021 [cited by applicant]
US 20210402144A1 · Messerly · 2021 [cited by applicant]
US 20220022969A1 · Misener · 2022 [cited by applicant]
US 20220031965A1 · Durfee · 2022 [cited by applicant]
US 20220039777A1 · Durfee · 2022 [cited by applicant]
US 20220096797A1 · Prince · 2022 [cited by applicant]
US 20220104886A1 · Blanchard et al. · 2022 [cited by applicant]
US 20220117582A1 · McLaughlin et al. · 2022 [cited by applicant]
US 20220160434A1 · Messerly et al. · 2022 [cited by applicant]
US 20220168050A1 · Sowards et al. · 2022 [cited by applicant]
US 20220172354A1 · Misener et al. · 2022 [cited by applicant]
US 20220211442A1 · McLaughlin et al. · 2022 [cited by applicant]
US 20220381630A1 · Sowards et al. · 2022 [cited by applicant]
US 20230113291A1 · de Wild et al. · 2023 [cited by applicant]
US 20230240643A1 · Cermak et al. · 2023 [cited by applicant]
US 20230389893A1 · Misener et al. · 2023 [cited by applicant]
US 20240008929A1 · Misener et al. · 2024 [cited by applicant]
US 20240050061A1 · McLaughlin et al. · 2024 [cited by applicant]
US 20240058074A1 · Misener · 2024 [cited by applicant]
US 20240062678A1 · Sowards et al. · 2024 [cited by applicant]
AU 2006201646A1 · 2006 [cited by applicant]
CN 114129137B · 2022 [cited by applicant]
EP 0933063A1 · 1999 [cited by applicant]
EP 1504713A1 · 2005 [cited by applicant]
EP 1591074B1 · 2008 [cited by applicant]
EP 3181083A1 · 2017 [cited by applicant]
EP 3530221A1 · 2019 [cited by applicant]
JP 2000271136A · 2000 [cited by applicant]
JP 2014150928A · 2014 [cited by applicant]
JP 2018175547A · 2018 [cited by applicant]
KR 20180070878A · 2018 [cited by applicant]
KR 20190013133A · 2019 [cited by applicant]
WO 2013059714A1 · 2013 [cited by applicant]
WO 2014115150A1 · 2014 [cited by applicant]
WO 2014174305A2 · 2014 [cited by applicant]
WO 2015017270A1 · 2015 [cited by applicant]
WO 2017096487A1 · 2017 [cited by applicant]
WO 2017214428A1 · 2017 [cited by applicant]
WO 2018026878A1 · 2018 [cited by applicant]
WO 2018134726A1 · 2018 [cited by applicant]
WO 2018206473A1 · 2018 [cited by applicant]
WO 2019232451A1 · 2019 [cited by applicant]
WO 2020002620A1 · 2020 [cited by applicant]
WO 2020016018A1 · 2020 [cited by applicant]
WO 2019232454A9 · 2020 [cited by applicant]
WO 2020044769A1 · 2020 [cited by applicant]
WO 2020102665A1 · 2020 [cited by applicant]
WO 2020186198A1 · 2020 [cited by applicant]
WO 2022031762A1 · 2022 [cited by applicant]
WO 2022072727A2 · 2022 [cited by applicant]
WO 2022081904A1 · 2022 [cited by applicant]
WO 2022203713A2 · 2022 [cited by applicant]
WO 2022263763A1 · 2022 [cited by applicant]
WO 2023235435A1 · 2023 [cited by applicant]
WO 2024010940A1 · 2024 [cited by applicant]
WO 2024039608A1 · 2024 [cited by applicant]
WO 2024039719A1 · 2024 [cited by applicant]
PCT/US2021/050973 filed Sep. 17, 2021 International Search Report and Written Opinion dated Nov. 7, 2022. [cited by applicant]
U.S. Appl. No. 17/380,767, filed Jul. 20, 2021 Restriction Requirement dated Dec. 15, 2022. [cited by applicant]
U.S. Appl. No. 17/397,486, filed Aug. 9, 2021 Non-Final Office Action dated Jan. 23, 2023. [cited by applicant]
U.S. Appl. No. 17/501,909, filed Oct. 14, 2021 Restriction Requirement dated Feb. 1, 2023. [cited by applicant]
Lu Zhenyu et al “Recent advances in 5 robot-assisted echography combining perception control and cognition.” Cognitive Computation and Systems the Institution of Engineering and Technology, Michael Faraday House, Six Hi… [cited by applicant]
Pagoulatos, N. et al. “New spatial localizer based on fiber optics with applications in 3D ultrasound imaging” Proceeding of Spie, vol. 3976 (Apr. 18, 2000; Apr. 18, 2000). [cited by applicant]
PCT/US2021/042369 filed Jul. 20, 2021 International Search Report and Written Opinion dated Oct. 25, 2021. [cited by applicant]
PCT/US2021/045218 filed Aug. 9, 2021 International Search Report and Written Opinion dated Nov. 23, 2021. [cited by applicant]
PCT/US2021/053018 filed Sep. 30, 2021 International Search Report and Written Opinion dated May 3, 2022. [cited by applicant]
PCT/US2021/055076 filed Oct. 14, 2021 International Search Report and Written Opinion dated Mar. 25, 2022. [cited by applicant]
Sebastian Vogt: “Real-Time Augmented Reality for Image-Guided Interventions”, Oct. 5, 2009, XPO55354720, Retrieved from the Internet: URL: https://opus4.kobv.de/opus4-fau/frontdoor/deliver/index/docId/1235/file/Sebastia… [cited by applicant]
William F Garrett et al: “Real-time incremental visualization of dynamic ultrasound volumes using parallel BSP trees”, Visualization '96. Proceedings, IEEE, NE, Oct. 27, 1996, pp. 235-ff, XPO58399771, ISBN: 978-0-89791-… [cited by applicant]
Ikhsan Mohammad et al: “Assistive technology for ultrasound-guided central venous catheter placement”, Journal of Medical Ultrasonics, Japan Society of Ultrasonics in Medicine, Tokyo, JP, vol. 45, No. 1, Apr. 19, 2017, … [cited by applicant]
PCT/US2021/044419 filed Aug. 3, 2021 International Search Report and Written Opinion dated Nov. 19, 2021. [cited by applicant]
EZono, eZSimulator, https://www.ezono.com/en/ezsimulator/, last accessed Sep. 13, 2022. [cited by applicant]
Sonosim, https://sonosim.com/ultrasound-simulation/? last accessed Sep. 13, 2022. [cited by applicant]
U.S. Appl. No. 17/397,486, filed Aug. 9, 2021 Restriction Requirement dated Aug. 12, 2022. [cited by applicant]
Stolka, P.J., et al., (2014). Needle Guidance Using Handheld Stereo Vision and Projection for Ultrasound-Based Interventions. In: Galland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds) Medical Image Computin… [cited by applicant]
U.S. Appl. No. 17/380,767, filed Jul. 20, 2021 Non-Final Office Action dated Mar. 6, 2023. [cited by applicant]
U.S. Appl. No. 17/491,308, filed Sep. 30, 2021 Non-Final Office Action dated Jun. 5, 2023. [cited by applicant]
U.S. Appl. No. 17/491,308, filed Sep. 30, 2021 Restriction Requirement dated Feb. 27, 2023. [cited by applicant]
U.S. Appl. No. 17/501,909, filed Oct. 14, 2021 Non-Final Office Action dated Jun. 6, 2023. [cited by applicant]
PCT/US2023/027147 filed Jul. 7, 2023 International Search Report and Written Opinion dated Oct. 2, 2023. [cited by applicant]
PCT/US2023/030160 filed Aug. 14, 2023 International Search Report and Written Opinion dated Oct. 23, 2023. [cited by applicant]
PCT/US2023/030347 filed Aug. 16, 2023 International Search Report and Written Opinion dated Nov. 6, 2023. [cited by applicant]
Practical guide for safe central venous catheterization and management 2017 Journal of Anesthesia vol. 34 published online Nov. 30, 2019 pp. 167-186. [cited by applicant]
U.S. Appl. No. 17/491,308, filed Sep. 30, 2021 Board Decison dated Oct. 25, 2023. [cited by applicant]
U.S. Appl. No. 17/501,909, filed Oct. 14, 2021 Final Office Action dated Nov. 21, 2023. [cited by applicant]
PCT/US2023/024067 filed May 31, 2023 International Search Report and Written Opinion dated Sep. 15, 2023. [cited by applicant]
State, A., et al. (Aug. 1996). Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies. In Proceedings of the 23rd annual conference on computer graphics and interactive techniques (pp. 4… [cited by applicant]
U.S. Appl. No. 17/380,767, filed Jul. 20, 2021 Notice of Allowance dated Aug. 31, 2023. [cited by applicant]