IP Library › Granted Patent US 11,540,718
Granted Patent B2
US 11,540,718 · App. 15/103,053 · Granted Jan 3, 2023

Imaging view steering using model-based segmentation

Inventors: Irina Waechter-Stehle (Hamburg, DE); Sabine Mollus (Aachen, DE); Christian Buerger (Hamburg, DE); Emil George Radulescu (Ossining, NY); Sheng-Wen Huang (Ossining, NY); Juergen Weese (Norderstedt, DE)
Assignee: KONINKLIJKE PHILIPS N.V.
A61B5/0044A61B8/0883A61B8/429A61B8/4218A61B8/4245A61B8/461A61B8/5215A61B34/30G06T7/73A61B8/065A61B8/4427A61B8/4488A61B8/483A61B8/5207A61B8/5223A61B8/54A61B2576/023G06T2207/10132G06T2207/30048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,540,718
App. No.
15/103,053
Granted
Jan 3, 2023
Kind
B2
Abstract

An imaging steering apparatus includes sensors and an imaging processor configured for: acquiring, via multiple ones of the sensors and from a current position ( 322 ), and current orientation ( 324 ), an image of an object of interest; based on a model, segmenting the acquired image; and determining, based on a result of the segmenting, a target position ( 318 ), and target orientation ( 320 ), with the target position and/or target orientation differing correspondingly from the current position and/or current orientation. An electronic steering parameter effective toward improving the current field of view may be computed, and a user may be provided instructional feedback ( 144 ) in navigating an imaging probe toward the improving. A robot can be configured for, automatically and without need for user intervention, imparting force ( 142 ) to the probe to move it responsive to the determination.

Claims (49)

1. A medical-imaging view steering apparatus comprising:

an imaging probe having an orientation, and an image space;

a user-guidance processor configured for presenting user instructions to propose user action toward improving a field of view of an object of interest, the user instructions including an instruction to pause movement of the imaging probe and a directional indicator indicating a direction in which to shift the imaging probe orientation; and

an imaging processor configured for:

acquiring, utilizing said imaging probe, an ultrasound image of the object of interest, when said object of interest is at least partially located in said image space;

using an anatomical model, segmenting the acquired ultrasound image to identify the object of interest when the object of interest is at least partially located in said image space; and

determining for said imaging probe, based on said segmenting of the acquired ultrasound image, and a desired target orientation of the object of interest in the image space, appropriate user instructions to be presented so as to achieve the desired target orientation,

wherein said appropriate user instructions are determined taking into account rib curvature in a longitudinal direction.

2. A medical-imaging view steering apparatus comprising:

an imaging probe having an orientation, and an image space;

a user-guidance processor configured for presenting user instructions to propose user action toward improving a field of view of an object of interest, the user instructions including an instruction to pause movement of the imaging probe and a directional indicator indicating a direction in which to shift the imaging probe orientation; and

an imaging processor configured for:

acquiring, utilizing said imaging probe, an ultrasound image of the object of interest, when said object of interest is at least partially located in said image space;

using an anatomical model, segmenting the acquired ultrasound image to identify the object of interest when the object of interest is at least partially located in said image space; and

determining for said imaging probe, based on said segmenting of the acquired ultrasound image, and a desired target orientation of the object of interest in the image space, appropriate user instructions to be presented so as to achieve the desired target orientation,

wherein the user instructions further comprise visual instructions, and

wherein the user-guidance processor is further configured to present user instructions by means of lights located on the imaging probe.

3. The apparatus of claim 2 , wherein the user-guidance processor is further configured to indicate a proposed imaging probe movement direction by the color of the lights.

4. A medical-imaging view steering apparatus comprising:

an imaging probe having an orientation, and an image space;

a user-guidance processor configured for presenting user instructions to propose user action toward improving a field of view of an object of interest, the user instructions including an instruction to pause movement of the imaging probe and a directional indicator indicating a direction in which to shift the imaging probe orientation; and

an imaging processor configured for:

acquiring, utilizing said imaging probe, an ultrasound image of the object of interest, when said object of interest is at least partially located in said image space;

using an anatomical model, segmenting the acquired ultrasound image to identify the object of interest when the object of interest is at least partially located in said image space; and

determining for said imaging probe, based on said segmenting of the acquired ultrasound image, and a desired target orientation of the object of interest in the image space, appropriate user instructions to be presented so as to achieve the desired target orientation,

wherein the user instruction to pause movement of the imaging probe further comprises a pause/go indicator light.

5. The apparatus of claim 4 , wherein the pause/go indicator light is one color when instructing to move the imaging probe, and another color when instructing to pause movement of the imaging probe.

6. The apparatus of claim 5 , wherein the pause/go indicator light is located on the imaging probe.

7. The apparatus of claim 5 , wherein the pause/go indicator light further comprises a user instruction to look for further user instructions on proposed probe movement.

8. The apparatus of claim 4 , wherein the user guidance processor is further configured for presenting a progress indicator indicating progress toward achieving the desired target orientation.

9. The apparatus of claim 4 , wherein the user-guidance processor and the imaging processor are further configured to be operable during a clinical ultrasound procedure in a first stage during which the imaging probe is moved until at least a portion of the object of interest is detected in the image space, and in a second stage during which movement of the imaging probe is frequently paused for the presentation of further user instructions.

10. The apparatus of claim 4 , wherein said target orientation is in an axial direction of said probe, and

wherein said model-provided segmentation is with respect to said axial direction.

11. The apparatus of claim 4 , further configured for deciding, based on image segmentation, that it has detected, in the acquired ultrasound image, at least part of said object of interest.

12. The apparatus of claim 4 , said apparatus being further configured for presenting said user instructions to propose user action toward achieving the desired target orientation.

13. The apparatus of claim 4 , said user instructions relating to either translating, or tilting, said imaging probe in order to achieve said desired target orientation.

14. The apparatus of claim 4 , said apparatus being further configured for computing an electronic steering parameter for steering the imaging probe image space, said apparatus being configured for electronically steering using the computed electronic steering parameter.

15. The apparatus of claim 4 , wherein the user instructions further comprise visual instructions.

16. The apparatus of claim 4 , wherein the user-guidance processor is further configured to present user instructions as textual instructions on a display screen.

17. The apparatus of claim 4 , wherein the user-guidance processor is further configured to present user instructions as auditory instructions.

18. The apparatus of claim 17 , wherein the auditory instructions further comprise artificial speech.

19. A medical-imaging view steering apparatus comprising:

an imaging probe having an orientation, and an image space;

a user-guidance processor configured for presenting user instructions to propose user action toward improving a field of view of an object of interest, the user instructions including an instruction to pause movement of the imaging probe and a directional indicator indicating a direction in which to shift the imaging probe orientation; and

an imaging processor configured for:

acquiring, utilizing said imaging probe, an ultrasound image of the object of interest, when said object of interest is at least partially located in said image space;

using an anatomical model, segmenting the acquired ultrasound image to identify the object of interest when the object of interest is at least partially located in said image space; and

determining for said imaging probe, based on said segmenting of the acquired ultrasound image, and a desired target orientation of the object of interest in the image space, appropriate user instructions to be presented so as to achieve the desired target orientation,

wherein the user guidance processor is further configured to present the user instruction to pause movement of the imaging probe during the segmenting of an acquired image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2016
From: WAECHTER-STEHLE, IRINA; MOLLUS, SABINE; BUERGER, CHRISTIAN; RADULESCU, EMIL GEORGE; HUANG, SHENG-WEN; WEESE, JUERGEN
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 038862/0798 →
Continuity (2)
Provisional Application 61913477 · Dec 9, 2013
Related Publication 20180132724A1 · May 17, 2018