IP Library › Granted Patent US 11,344,371
Granted Patent B2
US 11,344,371 · App. 16/591,332 · Granted May 31, 2022

Visualization of three-dimensional image data on a two-dimensional image

Inventors: Hitoshi Nakamura (Boston, MA); Barret Daniels (Cambridge, MA); Antonio Bonillas Vaca (Boston, MA); Christopher Wayne Thurrott (Townsend, MA); Morgan Carlson Rudolph (Saint Joseph, MI)
Assignee: Canon U.S.A., Inc.
A61B34/10A61B34/20A61B34/25G06T7/0014A61B2034/104A61B2034/107A61B2034/2051A61B2034/2065G06T2207/10081G06T2207/10088G06T2207/10132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,344,371
App. No.
16/591,332
Granted
May 31, 2022
Kind
B2
Abstract

The present disclosure relates generally to medical imaging and, more particularly to systems, methods, and devices for planning and carrying out minimally invasive procedures using external devices for needle guidance and the display and manipulation of the image set when planning and performing the procedure.

Claims (48)

1. An image processing apparatus comprising a processor that operates to:

acquire a three-dimensional image set comprising a stack of two-dimensional image slices;

acquire the location of at least one region of interest or at least one target point in the three-dimensional image set;

acquire the location of at least one insertion point in the three-dimensional image set;

cause a display to display a first two-dimensional image slice from the three-dimensional image set; and

cause the display to display, concurrent with the first two-dimensional image slice, an indicator bar, wherein the indicator bar indicates:

the location of the first two-dimensional image slice within the three-dimensional image set,

the location of the at least one region of interest or at least one target point within the three-dimensional image set, and

the location of the insertion point within the three-dimensional image set.

2. The image processing apparatus of claim 1 , wherein the processor generates and displays on the first two-dimensional image slice at least one of:

a reference trajectory connecting the target point and the insertion point,

a reachable zone presenting a volume reachable by a tool from the insertion point, and

the location of one or more fiducial markers on the first two-dimensional image slice.

3. The image processing apparatus of claim 1 , wherein the at least one region of interest or at least one target point in the image and the at least one insertion point are determined in response to receiving a user input for selecting a position in the displayed first two-dimensional image slice.

4. The image processing apparatus of claim 1 , wherein the three-dimensional image set is an ultrasound image set, a computer tomography (CT) image set, or a magnetic resonance (MR) image set.

5. The image processing apparatus of claim 1 , where a digital representation of a needle guide device is overlaid on the first two-dimensional image slice.

6. The image processing apparatus of claim 1 , wherein the processor acquires the location of the at least one region of interest or at least one target point and the at least one insertion point in the three-dimensional image set from one or more user input device.

7. The image processing apparatus of claim 1 , wherein the processor displays the region of interest and the insertion point superimposed on the displayed first two-dimensional image slice.

8. The image processing apparatus of claim 1 , further comprising an input means for inputting a desired viewing location that includes a second two-dimensional image slice within the three dimensional image set, and wherein the processor further causes the display to display the second two-dimensional image slice from the three-dimensional image set.

9. An image processing apparatus for supporting a needle placement process, planning, or assessment comprising:

a processor that operates to:

acquire a three-dimensional image set comprising a stack of two-dimensional image slices;

acquire the location of at least one region of interest or at least one target point in the three-dimensional image set;

acquire the location of at least one insertion point in the three-dimensional image set;

cause a display to display a first two-dimensional image slice from the three-dimensional image set; and

cause the display to display, concurrent with the first two-dimensional image slice, an indicator bar, wherein the indicator bar indicates:

the location of the first two-dimensional image slice within the three-dimensional image set,

the location of the at least one region of interest or at least one target point within the three-dimensional image set, and

the location of the insertion point within the three-dimensional image set, and wherein the processor causes the display to display a second two-dimensional image from the three-dimensional image set.

10. A method of performing planning or treatment for a percutaneous probe treatment, comprising:

acquiring a three-dimensional image set comprising a stack of two-dimensional image slices;

acquiring the location of at least one region of interest or at least one target point in the three-dimensional image set;

acquiring the location of at least one insertion point in the three-dimensional image set;

causing a display to display a first two-dimensional image slice from the three-dimensional image set; and

causing the display to display, concurrent with the first two-dimensional image slice, an indicator bar, wherein the indicator bar indicates:

the location of the first two-dimensional image slice within the three-dimensional image set,

the location of the at least one region of interest or at least one target point within the three-dimensional image set, and

the location of the insertion point within the three-dimensional image set.

11. The method of claim 10 , further comprising causing the processor to display, on the first two-dimensional image slice, when applicable, at least one of:

a reference trajectory connecting the target point and the insertion point,

a reachable zone presenting a volume reachable by a tool from the insertion point, and

the location of one or more fiducial markers on the first two-dimensional image slice.

12. The method of claim 10 , further comprising receiving at least one user input to acquire the location of at least one region of interest or at least one target point in the three-dimensional image set and the at least one insertion point.

13. The method of claim 10 , wherein acquiring the three-dimensional image set comprises acquiring at least one of an ultrasound image set, a computer tomography (CT) image set, and a magnetic resonance (MR) image set of the object to be treated.

14. The method of claim 10 , further comprising overlaying a digital representation of a needle guide device on the first two-dimensional image slice.

15. The method of claim 10 , further comprising changing the display of the first two-dimensional image slice to correspond to a position defined by an input device on the indicator bar.

16. An imaging server storing an imaging application having instructions that, when executed by a processor, cause the imaging server to perform the method according to claim 10 .

17. A non-transitory computer-readable storage medium storing an imaging application to cause an imaging server to perform the method according to claim 10 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2022
From: THURROTT, CHRISTOPHER WAYNE
To: CANON USA, INC.
Reel/Frame 059577/0824 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2019
From: NAKAMURA, HITOSHI; DANIELS, BARRET; BONILLAS VACA, ANTONIO; RUDOLPH, MORGAN CARLSON
To: CANON USA, INC.
Reel/Frame 050607/0394 →
Continuity (2)
Provisional Application 62748168 · Oct 19, 2018
Related Publication 20200121393A1 · Apr 23, 2020