IP Library › Granted Patent US 12,220,542
Granted Patent B2
US 12,220,542 · App. 17/809,636 · Granted Feb 11, 2025

System and method for visualizing placement of a medical tube or line

Inventors: Alec Joseph Baenen (Hartland, WI); Pal Tegzes (Budapest, HU); Levente Torok (Budapest, HU); Teri Lynn Fischer (Germantown, WI); Katelyn Rose Nye (Glendale, WI); Gireesha Chinthamani Rao (Pewaukee, WI)
Assignee: GE Precision Healthcare LLC
A61M25/0105G06T7/11G06T7/60G06T7/74G06T11/00G16H30/20A61M2025/0166G06T2207/20081G06T2207/20084G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,220,542
App. No.
17/809,636
Granted
Feb 11, 2025
Kind
B2
Abstract

An image processing system is provided. The image processing system includes a display, a processor, and a memory. The memory stores processor-executable code that when executed by the processor causes receiving an image of a region of interest of a patient with a medical tube or line disposed within the region of interest, detecting the medical tube or line within the image, generating a combined image by superimposing a first graphical marker on the image that indicates an end of the medical tube or line, and displaying the combined image on the display.

Claims (33)

1. A medical image processing system, comprising:

a display;

a processor; and

a memory storing processor-executable code that when executed by the processor causes:

receiving an image of a region of interest of a patient with a medical tube or line disposed within the region of interest;

detecting the medical tube or line within the image;

detecting a reference landmark within the region of interest within the image, wherein the reference landmark is an anatomical landmark internal to the patient; and

determining whether the medical tube or line is properly placed relative to the reference landmark.

2. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes providing a user-perceptible indication to a user when the medical tube or line is misplaced relative to the reference landmark.

3. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes calculating a measured position of the end of the medical tube or line relative to the reference landmark, generating a combined image by superimposing a graphical marker on the image that indicates the measured position, and displaying the combined image on the display.

4. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes calculating respective confidence scores for one or more of a calculated distance between the end of the medical tube or line and the reference landmark, a determination as to whether a medical tube or line is present within the image, an accuracy of a detection of the end of the medical tube or line, or an accuracy of a detection of the reference landmark.

5. The medical image processing system of claim 4 , wherein the processor-executable code when executed by the processor causes display of the respective confidence scores on the display.

6. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes calculating a confidence score for a calculated distance between the end of the medical tube or line and the reference landmark.

7. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes calculating a confidence score for a determination as to whether a medical tube or line is present within the image.

8. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes calculating a confidence score for an accuracy of a detection of the end of the medical tube or line.

9. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes calculating a confidence score for an accuracy of a detection of the reference landmark.

10. The medical image processing system of claim 1 , wherein the medical tube or line comprises a chest tube, a nasopharyngeal tube, a tracheostomy tube, a nasogastric tube, an endotracheal tube, a vascular line, electrocardiogram lines, pacemaker lines, a temperature probe, a peripherally inserted central catheter, or a catheter.

11. The medical image processing system of claim 1 , wherein the reference landmark comprises a carina, a chest cavity, cardiac silhouette, aorta, super vena cava, inferior vena cava, right heart border, a segmented lung, a diaphragm, a bowel, an esophagus, trachea, gastro-esophageal junction, epiglottis, or a stomach.

12. The medical image processing system of claim 1 , wherein detecting the medical tube or line within the image comprises utilizing one or more deep learning network models to detect the medical tube or line within the image.

13. The medical image processing system of claim 1 , wherein the processor-executable code when executed by the processor causes generating a combined image by superimposing on the image a graphical overlay over the medical tube or line to indicate the medical tube or line and displaying the combined image on the display.

14. The medical image processing system of claim 1 , wherein the image processing system is part of a mobile medical imaging system.

15. The medical image processing system of claim 1 , wherein the image processing system is part of a fixed medical imaging system.

16. A method for medical image processing, comprising:

receiving, via a processor, an image of a region of interest of a patient with a medical tube or line disposed within the region of interest;

detecting, via the processor, the medical tube or line within the image;

detecting, via the processor, a reference landmark within the region of interest within the image, wherein the reference landmark is an anatomical landmark internal to the patient; and

determining, via the processor, whether the medical tube or line is properly placed relative to the reference landmark.

17. The method of claim 16 , comprising providing, via the processor, a user-perceptible indication to a user when the medical tube or line is misplaced relative to the reference landmark.

18. A non-transitory, computer-readable medium, the computer-readable medium comprising processor-executable code that when executed by a processor, causes the processor to:

receive an image of a region of interest of a patient with a medical tube or line disposed within the region of interest;

detect the medical tube or line within the image and a reference landmark within the region of interest within the image, wherein the reference landmark is an anatomical landmark internal to the patient; and

determine whether the medical tube or line is properly placed relative to the reference landmark.

19. The non-transitory, computer-readable medium of claim 18 , wherein the processor-executable code when executed by the processor, causes the processor to provide a user-perceptible indication to a user when the medical tube or line is misplaced relative to the reference landmark.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2022
From: BAENEN, ALEC JOSEPH; TEGZES, PAL; TOROK, LEVENTE; FISCHER, TERI LYNN; NYE, KATELYN ROSE; RAO, GIREESHA CHINTHAMANI
To: GE PRECISION HEALTHCARE LLC
Reel/Frame 060352/0232 →
Continuity (2)
Continuation In Part 16953517 · Nov 20, 2020
Related Publication 20220331556A1 · Oct 20, 2022
References Cited (10)
US 6442203B1 · Demos · 2002 [cited by examiner]
US 20090297441A1 · Canham · 2009 [cited by examiner]
US 20170215762A1 · Burnside · 2017 [cited by examiner]
US 20200211694A1 · Nye et al. · 2020 [cited by applicant]
Huo, Zhimin et al.; “Computer-aided detection of malpositioned endotracheal tubes in portable chest radiographs”, Progress in Biomedical Optics and Imaging, SPIE, vol. 9035, Mar. 2014; pp. 1-6. [cited by applicant]
Lakhani, Paras; “Deep Convolutional Neural Networks for Endotracheal Tube Position and X-ray Image Classification: Challenges and Opportunities”, Journal of Digital Imaging, vol. 30, No. 4, Jun. 2017; pp. 460-468. [cited by applicant]
Yi, Xin, et al.; “Automatic Catheter Detection in Pediatric X-Ray Images Using a Scale-Recurrent Network and Synthetic”; 1st Conference on Medical Imaging with Deep Learning (MIDL, 2018); 10 pages. [cited by applicant]
Frid-Adard, Maayan, et al.; “Endotracheal Tube Detection and Segmentation in Chest Radiographs Using Synthetic Data”, RADLogics Ltd., Department of Biomedical Engineering, Tel Aviv University, 2019; 9 pages. [cited by applicant]
Yi, Xin, et al.; “Computer-Aided Assessment of Catheters and Tubes on Radiographs: How Godo is Artificial Intelligence for Assessment?”, Cornell University Ithaca, NY, Feb. 2020; pp. 1-12. [cited by applicant]
Extended EP Search Report; Application No. 21207544.4-1210; mailed Apr. 2022; pp. 1-11. [cited by applicant]