IP Library Granted Patent US 7,561,725
Granted Patent B2
US 7,561,725 · App. 10/796,864 · Granted Jul 14, 2009

Image segmentation in a three-dimensional environment

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,561,725
App. No.
10/796,864
Granted
Jul 14, 2009
Kind
B2
Abstract

A method ( 100 ) for image segmentation in a three-dimensional environment includes receiving scan data ( 112 ), selecting a viewing vector relative to the scan data ( 114 ), rendering the scan data as a 3D image about the viewing vector ( 116 ), displaying the rendered 3D image ( 118 ), selecting a range of 2D image slices within the 3D image ( 122 ), performing 2D segmentation on the selected slices relative to the viewing vector to obtain a segmented 3D object ( 124 ), and displaying the segmented 3D object ( 128 ).

Claims (89)

1. A method for image segmentation in a three-dimensional environment, the method comprising:

a computer performing the following:

receiving scan data as a plurality of original two-dimensional (2D) scans disposed with a scanning vector normal thereto;

selecting an arbitrary viewing vector disposed non-parallel to the scanning vector;

rendering the scan data as a 3D image about the viewing vector;

displaying the rendered 3D image in an octant view on an output device;

selecting a range of new 2D image slices with the arbitrary viewing vector disposed normal thereto from within the octant view of the 3D image;

performing 2D segmentation on the selected slices to obtain a segmented 3D object; and

displaying the segmented 3D object on the output device.

2. A method as defined in claim 1 , further comprising performing in-scene control of slices within the 3D image by grabbing tabs on the 2D slice images within a rendered 3D image.

3. A method as defined in claim 2 , further comprising providing sliding bars movable along restricted directions to guide the selection of slice ranges.

4. A method as defined in claim 1 , the step of selecting a range of slices within the 3D image comprising selecting 2D image planes along different axis to be displayed within the rendered 3D scene.

5. A method as defined in claim 1 , the step of performing 2D segmentation comprising determining the correspondence between a mouse point and the data within a 2D image in the 3D rendered image.

6. A method as defined in claim 5 , the step of determining the correspondence comprising determining the intersection of the mouse point and the 2D slice image within the 3D scene by:

receiving a mouse point in window coordinates;

inverse transforming the mouse point to get its corresponding first point in object coordinates of the scan data;

computing a second point along a straight vector from the first mouse point; and

determining the intersection point as a function of the first point, a distance from the first point to the intersection point, and a vector obtained by subtracting the first point from the second point.

7. A method as defined in claim 1 , the step of performing 2D segmentation comprising drawing the segmentation contours in a plurality of different planes in the rendered 3D image within a single drawing session.

8. A method as defined in claim 7 , further comprising back-projecting the point coordinates of the segmentation contours within each 2D image plane to the 3D coordinate space.

9. A method as defined in claim 1 , further comprising:

selecting a second viewing vector relative to the rendered 3D image; and

re-rendering the scan data as a 3D image about the second viewing vector.

10. A method as defined in claim 1 , the step of performing 2D segmentation comprising:

selecting an anchor point;

transforming the anchor point from object coordinates into window coordinates; and

determining an intersection of the anchor point with an image plane.

11. A method as defined in claim 1 wherein the scan data is produced by a medical imaging device.

12. A method as defined in claim 11 wherein the segmented 3D object is indicative of an organ.

13. A method as defined in claim 1 , further comprising manually overriding a section of 2D segmentation disposed contiguously between two sections of automatic 2D segmentation.

14. An apparatus for image segmentation in a three-dimensional environment, the apparatus comprising:

input means for receiving scan data as a plurality of original two-dimensional (2D) scans disposed with a scanning vector normal thereto;

selection means coupled with the input means for selecting an arbitrary viewing vector disposed non-parallel to the scanning vector;

rendering means coupled with the selection means for rendering the scan data as a 3D image about the viewing vector;

first display means coupled with the rendering means for displaying the rendered 3D image in an octant view;

ranging means coupled with the display means for selecting a range of new 2D image slices with the arbitrary viewing vector disposed normal thereto from within the octant view of the 3D image;

segmenting means coupled with the ranging means for performing 2D segmentation on the selected slices to obtain a segmented 3D object; and

second display means coupled with the segmenting means for displaying the segmented 3D object.

15. An apparatus as defined in claim 14 , further comprising control means for performing in-scene control of slices within the 3D image by grabbing tabs on the 2D slice images within a rendered 3D image.

16. An apparatus as defined in claim 15 , further comprising guiding means for providing sliding bars movable along restricted directions to guide the selection of slice ranges.

17. An apparatus as defined in claim 14 , the ranging means comprising selecting means for selecting 2D image planes along different axis to be displayed within the rendered 3D scene.

18. An apparatus as defined in claim 14 , the segmenting means comprising mouse means for determining the correspondence between a mouse point and the data within a 2D image in the 3D rendered image.

19. An apparatus as defined in claim 18 , the mouse means comprising intersecting means for determining the intersection of the mouse point and the 2D slice image within the 3D scene, including:

window means for receiving a mouse point in window coordinates;

inverse transforming means for inverse transforming the mouse point to get its corresponding first point in object coordinates of the scan data;

vectoring means for computing a second point along a straight vector from the first mouse point; and

function means for determining the intersection point as a function of the first point, a distance from the first point to the intersection point, and a vector obtained by subtracting the first point from the second point.

20. An apparatus as defined in claim 14 , the segmenting means comprising drawing means for drawing the segmentation contours in a plurality of different planes in the rendered 3D image within a single drawing session.

21. An apparatus as defined in claim 20 , further comprising back-projecting means for back-projecting the point coordinates of the segmentation contours within each 2D image plane to the 3D coordinate space.

22. An apparatus as defined in claim 14 , further comprising:

second selection means coupled with at least one of the first and second display means for selecting a second viewing vector relative to the rendered 3D image; and

second rendering means coupled with the second selection means for re-rendering the scan data as a 3D image about the second viewing vector.

23. An apparatus as defined in claim 14 , the segmenting means for performing 2D segmentation comprising:

anchoring means coupled with segmentation means to detect feature contours within the 2D image in the 3D scene

intersection means for determining the mouse coordinate correspondence with the 2D image plane

transforming means for converting the detected feature contour to windows coordinates for display in the 3D scene.

24. An apparatus as defined in claim 14 , further comprising a medical imaging device for producing the scan data.

25. An apparatus as defined in claim 24 wherein the segmented 3D object is indicative of an organ.

26. An apparatus as defined in claim 14 , further comprising manual override means performing coupled with the segmenting means for providing manually overridden 2D segmentation disposed contiguously between two sections of automatic 2D segmentation.

27. A computer-readable medium tangibly embodying a program of instructions executable by a machine to perform program steps for image segmentation in a three-dimensional environment, the program steps comprising:

receiving scan data as a plurality of original two-dimensional (2D) scans disposed with a scanning vector normal thereto;

selecting an arbitrary viewing vector disposed non-parallel to the scanning vector;

rendering the scan data as a 3D image about the viewing vector;

displaying the rendered 3D image in an octant view;

selecting a range of new 2D image slices with the arbitrary viewing vector disposed normal thereto from within the octant view of the 3D image;

performing 2D segmentation on the selected slices to obtain a segmented 3D object; and

displaying the segmented 3D object.

28. A computer-readable medium as defined in claim 27 , the program steps further comprising performing in-scene control of slices within the 3D image by grabbing tabs on the 2D slice images within a rendered 3D image.

29. A computer-readable medium as defined in claim 28 , the program steps further comprising providing sliding bars movable along restricted directions to guide the selection of slice ranges.

30. A computer-readable medium as defined in claim 27 , the program step of selecting a range of slices within the 3D image comprising selecting 2D image planes along different axis to be displayed within the rendered 3D scene.

31. A computer-readable medium as defined in claim 27 , the program step of performing 2D segmentation comprising determining the correspondence between a mouse point and the data within a 2D image in the 3D rendered image.

32. A computer-readable medium as defined in claim 31 , the program step of determining the correspondence comprising determining the intersection of the mouse point and the 2D slice image within the 3D scene by the program steps of:

receiving a mouse point in window coordinates;

inverse transforming the mouse point to get its corresponding first point in object coordinates of the scan data;

computing a second point along a straight vector from the first mouse point; and

determining the intersection point as a function of the first point, a distance from the first point to the intersection point, and a vector obtained by subtracting the first point from the second point.

33. A computer-readable medium as defined in claim 27 , the program step of performing 2D segmentation comprising drawing the segmentation contours in a plurality of different planes in the rendered 3D image within a single drawing session.

34. A computer-readable medium as defined in claim 33 , further comprising the program step of back-projecting the point coordinates of the segmentation contours within each 2D image plane to the 3D coordinate space.

35. A computer-readable medium as defined in claim 27 , the program steps further comprising:

selecting a second viewing vector relative to the rendered 3D image; and

re-rendering the scan data as a 3D image about the second viewing vector.

36. A computer-readable medium as defined in claim 27 , the program step of performing 2D segmentation comprising:

selecting an anchor point;

transforming the anchor point from object coordinates into window coordinates; and

determining an intersection of the anchor point with an image plane.

37. A computer-readable medium as defined in claim 27 wherein the scan data is produced by a medical imaging device.

38. A computer-readable medium as defined in claim 37 wherein the segmented 3D object is indicative of an organ.

39. A computer-readable medium as defined in claim 27 , the program steps further comprising the step of performing manually overridden 2D segmentation disposed contiguously between two sections of automatic 2D segmentation.

40. A method as defined in claim 1 wherein the selected arbitrary viewing vector is disposed non-normal and non-coincident relative to the original 2D scans.

Assignments (8)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 066088 FRAME: 0256. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2024
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 071178/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066088/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2018
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 044933/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2018
From: SIEMENS CORPORATION
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 044877/0714 →
MERGER AND CHANGE OF NAME Recorded Jan 26, 2018
From: SIEMENS CORPORATE RESEARCH, INC.; SIEMENS CORPORATION
To: SIEMENS CORPORATION
Reel/Frame 044734/0883 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2005
From: SIEMENS CORPORATE RESEARCH, INC.
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 016860/0484 →
DOCUMENT RE-RECORDED TO CORRECT AN ERROR CONTAINED IN PROPERTY NUMBER 10/796,854 AND TO CORRECT THE EXECUTION DATE. DOCUMENT PREVIOUSLY RECORDED AT REEL 015144, FRAME 0025. Recorded Nov 26, 2004
From: LIANG, CHENG-CHUNG
To: SIEMENS CORPORATE RESEARCH INC.
Reel/Frame 016022/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2004
From: LIANG, CHENG-CHUNG
To: SIEMENS CORPORATE RESEARCH INC.
Reel/Frame 015144/0025 →