Ultrasound system with target and medical instrument awareness
Blood vessel recognition and needle guidance systems, components, and methods thereof are disclosed. A console can be configured to instantiate a target recognition process for recognizing an anatomical target, such as a blood vessel, of a patient and a needle guidance process for guiding insertion of a needle into the anatomical target using ultrasound-imaging data received by the console. The system can perform target identification based on artificial intelligence (AI), which can be trained to recognize targets based on the ultrasound image. The ultrasound probe can be configured to provide to the console electrical signals corresponding to the ultrasound-imaging data. The ultrasound probe can include an array of transducers and, optionally, an array of magnetic sensors respectively configured to convert reflected ultrasound signals from the patient and magnetic signals from the needle, when magnetized, into the electrical signals.
1. A target recognition and needle guidance system, comprising:
a console including a processor and non-transitory, computer-readable medium having stored thereon logic that, when executed by the processor, is configured to initiate:
a target recognition process configured to (1) receive user input indicating a desired target, and (ii) identify a blood vessel of a patient corresponding to the desired target by applying a machine learning model to features of candidate targets in ultrasound-imaging data, wherein the blood vessel identified as the desired target is associated with a highest confidence score determined by the machine learning model, and
a needle guidance process for guiding insertion of a needle into the blood vessel identified as the desired target by the machine learning model, wherein the machine learning model determines a proximity of a trajectory of the needle to the blood vessel identified as the desired target based on magnetic information about the needle, and wherein a catheter is implanted into the blood vessel identified as the desired target following the insertion of the needle; and
an ultrasound probe configured to provide to the console electrical signals corresponding to the ultrasound-imaging data, the ultrasound probe including:
an array of transducers configured to convert reflected ultrasound signals from the patient into an ultrasound-imaging portion of the electrical signals, and a magnetic sensor configured to provide to the console second electrical signals corresponding to the magnetic information about the needle.
2. The target recognition and needle guidance system of claim 1 , wherein the machine learning model includes a supervised learning model trained based on previously-identified training targets.
3. The target recognition and needle guidance system of claim 1 , wherein each of the candidate targets in the ultrasound-imaging data is associated with a confidence score determined by the machine learning model.
4. The target recognition and needle guidance system of claim 1 , wherein the machine learning model includes one or more of the following supervised learning models:
logistic regression,
other linear classifiers,
support vector machines,
quadratic classifiers,
kernel estimation,
decision trees,
neural networks, or
learning vector quantization.
5. The target recognition and needle guidance system of claim 4 , wherein the machine learning model includes the logistic regression, and wherein a confidence score of a first candidate target is determined as a weighted sum of the features of the candidate targets.
6. The target recognition and needle guidance system of claim 4 , wherein the machine learning model includes the neural networks, and wherein a confidence score of a first candidate target is determined based on one or more nonlinear activation functions of the features of the candidate targets.
7. The target recognition and needle guidance system of claim 2 , wherein the supervised learning model is trained by iteratively minimizing an error, for classifications predicted by a candidate model compared to actual classifications of the previously-identified training targets.
8. The target recognition and needle guidance system of claim 1 , wherein the blood vessel comprises a superior vena cava.
9. The target recognition and needle guidance system of claim 1 , wherein the ultrasound probe provides a first ultrasound image prior to insertion of the needle, and wherein the machine learning model is based in part on the trajectory of the needle.
10. The target recognition and needle guidance system of claim 1 , wherein the features of the candidate targets include one or more of the following features:
a shape of a candidate blood vessel of the candidate targets in the ultrasound-imaging data,
a size of the candidate blood vessel,
a number of branches of the candidate blood vessel, or
a complexity of branches of the candidate blood vessel.
11. The target recognition and needle guidance system of claim 1 , wherein:
recognizing the blood vessel identified as the desired target comprises providing identifying information characterizing one or more candidate targets to a user, wherein the identifying information comprises a predicted classification of one or more potential targets and a confidence level associated with the predicted classification.
12. The target recognition and needle guidance system of claim 1 , further comprising a display screen configured for graphically guiding the insertion of the needle into the blood vessel identified as the desired target.
13. The target recognition and needle guidance system of claim 1 , further comprising:
one or more electrocardiogramabes configured to provide to the console electrical signals corresponding to electrocardiogramnformation,
wherein the logic, when executed by the processor, is further configured to initiate a catheter tip placement confirmation process based on the electrocardiogramnformation.
14. The target recognition and needle guidance system of claim 1 , further comprising:
a needle magnetizer incorporated into the console configured to magnetize the needle.
15. The target recognition and needle guidance system of claim 14 , wherein the needle guidance process for guiding insertion of the magnetized needle into the blood vessel identified as the desired target uses a combination of the ultrasound-imaging data and magnetic-field data received by the console.
16. The target recognition and needle guidance system of claim 15 , wherein the ultrasound probe is configured to provide to the console the magnetic-field data, the ultrasound probe further including an array of magnetic sensors configured to convert magnetic signals from the magnetized needle into a magnetic-field portion of the electrical signals.
17. A target recognition and needle guidance system, comprising: a console including a processor and non-transitory, computer-readable medium having stored thereon logic that, when executed by the processor, is configured to initiate: a target recognition process configured to (1) receive user input indicating a desired target, and (ii) identify a blood vessel of a patient corresponding to the desired target by applying a machine learning model to features of candidate targets in ultrasound-imaging data, wherein the blood vessel identified as the desired target is associated with a highest confidence score determined by the machine learning model, and a needle guidance process for guiding insertion of a needle into the blood vessel identified as the desired target by the machine learning model, and wherein a catheter is implanted into the blood vessel identified as the desired target following the insertion of the needle, wherein the machine learning model determines a proximity of a trajectory of the needle to the blood vessel identified as the desired target based on optical information about the catheter; an ultrasound probe configured to provide to the console electrical signals corresponding to the ultrasound-imaging data, the ultrasound probe including: an array of transducers configured to convert reflected ultrasound signals from the patient into an ultrasound-imaging portion of the electrical signals; and a magnetic sensor configured to provide to the console second electrical signals corresponding to the optical information about the catheter.