IP Library › Granted Patent US 11,896,425
Granted Patent B2
US 11,896,425 · App. 17/239,323 · Granted Feb 13, 2024

Guiding instrument insertion

Inventors: Davinder S. Dhatt (Bothell, WA); Christopher Aleksandr White (Bothell, WA); Adam Benjamin Pely (Bothell, WA); Thomas Michael Duffy (Bothell, WA); Paul Tomotaro Danset (Bothell, WA); Diku Pranav Mandavia (Bothell, WA)
Assignee: FUJIFILM SONOSITE, INC.
A61B8/085A61B8/0891A61B8/12A61B8/445A61B8/461A61B8/467A61B8/5207A61B8/5223G06N3/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,896,425
App. No.
17/239,323
Granted
Feb 13, 2024
Kind
B2
Abstract

A method and apparatus for identifying blood vessels in ultrasound images and displaying blood vessels in ultrasound images are described. In some embodiments, the method is implemented by a computing device and includes receiving an ultrasound image that includes one or more blood vessels, and determining, with a neural network implemented at least partially in hardware of the computing device, diameters of the one or more blood vessels in the ultrasound image. The method includes receiving a user selection of an instrument size, and indicating, in the ultrasound image, at least one blood vessel of the one or more blood vessels based on the instrument size and the diameters of the one or more blood vessels.

Claims (45)

1. A method implemented by a computing device for aiding a clinician in selecting an appropriate vein for catheterization, the method comprising:

receiving ultrasound echo signals that are reflected from an object in response to ultrasound signals that are sent to the object by an ultrasound probe;

receiving a time series of ultrasound images that include one or more blood vessels that are generated based on the ultrasound echo signals, the time series of ultrasound images including a current ultrasound image including a first blood vessel and one or more additional ultrasound images preceding the current ultrasound image;

determining, with a neural network implemented at least partially in hardware of the computing device, diameters of each of the one or more blood vessels in the time series of ultrasound images, wherein the first blood vessel in the current ultrasound image has a first diameter caused by a first probe pressure;

determining that the first blood vessel exists in the one or more additional ultrasound images preceding the current ultrasound image, wherein the first blood vessel in the one or more additional ultrasound images has a second diameter caused by a second probe pressure;

setting a maximum diameter of the first blood vessel based on the first diameter and the second diameter;

receiving a user selection of an instrument size; and

indicating, in the ultrasound image, the first blood vessel of the one or more blood vessels based on the instrument size and the maximum diameter of the first blood vessel, wherein the indicating includes displaying an outline of the first blood vessel;

assigning, with the neural network, one of a vein classification or an artery classification to the one or more blood vessels; and

determining a confidence level for the vein classification or the artery classification assigned to the one or more blood vessels, wherein the displaying the outline of the first blood vessel includes displaying the outline with an opacity based on the confidence level determined for the first blood vessel.

2. The method as described in claim 1 , further comprising:

determining ratios of the instrument size to the diameters of the one or more blood vessels; and

comparing the ratios to a threshold ratio;

wherein the indicating the first blood vessel is based on the comparing.

3. The method as described in claim 1 , wherein the displaying the outline of the first blood vessel includes displaying the outline in a color associated with the instrument size.

4. The method as described in claim 1 , wherein the displaying the outline of the first blood vessel includes displaying the outline with an opacity based on a distance of the first blood vessel to an edge of the ultrasound image.

5. The method as described in claim 1 , wherein the one or more additional ultrasound images in the time series include at least three ultrasound images.

6. The method as described in claim 1 , further comprising generating the one or more additional ultrasound images based on an imaging parameter that is set to a value that is different than the value of the imaging parameter used to generate the current ultrasound image.

7. The method as described in claim 5 , further comprising generating at least one of the one or more additional ultrasound images based on a beamform angle that is different than an additional beamform angle used to generate the current ultrasound image.

8. The method as described in claim 1 , wherein the one or more additional ultrasound images include an additional image that indicates locations corresponding to the one or more blood vessels; wherein the determining the diameters with the neural network is based on the current ultrasound image and the additional image.

9. The method as described in claim 8 , wherein the additional image indicates the locations corresponding to the one or more blood vessels with one or more bounding containers.

10. A system to aid a clinician in selecting an appropriate vein for catheterization, the system comprising:

a memory to store one or more ultrasound images;

a neural network implemented at least partially in hardware coupled to the memory; and

a processor coupled to the neural network and configured to:

receive ultrasound echo signals that are reflected from an object in response to ultrasound signals that are sent to the object by an ultrasound probe;

receive a time series of ultrasound images that includes one or more blood vessels that are generated based on the ultrasound echo signals, the time series of ultrasound images including a current ultrasound image including a first blood vessel and one or more additional ultrasound images preceding the current ultrasound image;

determine, using the neural network, diameters of each of the one or more blood vessels in the time series of ultrasound images, wherein the first blood vessel in the current ultrasound image has a first diameter caused by a first probe pressure;

determine that the first blood vessel exists in the one or more additional ultrasound images preceding the current ultrasound image, wherein the first blood vessel in the one or more additional ultrasound images has a second diameter caused by a second probe pressure;

set a maximum diameter of the first blood vessel based on the first diameter and the second diameter;

receive a user selection of an instrument size; and

indicate, in the ultrasound image, the first blood vessel of the one or more blood vessels based on the instrument size and the maximum diameter of the first blood vessel, wherein the indicating includes displaying an outline of the first blood vessel;

assign, using the neural network, one of a vein classification or an artery classification to the one or more blood vessels; and

determine a confidence level for the vein classification or the artery classification assigned to the one or more blood vessels, wherein the displaying the outline of the first blood vessel includes displaying the outline with an opacity based on the confidence level determined for the first blood vessel.

11. The system as described in claim 10 , wherein the processor is further configured to:

determine ratios of the instrument size to the diameters of the one or more blood vessels; and

compare the ratios to a threshold ratio;

wherein the indicating the first blood vessel is based on the comparing.

12. The system as described in claim 10 , wherein the outline of the first blood vessel is displayed in a color associated with the instrument size.

13. The system as described in claim 10 , wherein the displaying the outline of the first blood vessel includes displaying the outline with an opacity based on a distance of the first blood vessel to an edge of the ultrasound image.

14. The system as described in claim 10 , wherein the one or more additional ultrasound images are generated based on an imaging parameter that is set to a value that is different than the value of the imaging parameter used to generate the current ultrasound image.

15. The system as described in claim 10 , wherein at least one of the one or more additional ultrasound images is generated based on a beamform angle that is different than an additional beamform angle used to generate the ultrasound image.

16. The system as described in claim 10 , wherein one or more additional ultrasound images include

an additional image that indicates locations corresponding to the one or more blood vessels; wherein the determining the diameters with the neural network is based on the current ultrasound image and the additional image.

17. The system as described in claim 16 , wherein the additional image indicates the locations corresponding to the one or more blood vessels with one or more bounding containers.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: DHATT, DAVINDER S.; WHITE, CHRISTOPHER ALEKSANDR; PELY, ADAM BENJAMIN; DUFFY, THOMAS MICHAEL; DANSET, PAUL TOMOTARO; MANDAVIA, DIKU PRANAV
To: FUJIFILM SONOSITE, INC.
Reel/Frame 056313/0377 →
Continuity (1)
Related Publication 20220338833A1 · Oct 27, 2022
Cited By (5)
US 12,349,983 US 12,453,534 US 12,539,176 US 12,575,892 US 12,605,140