IP Library Granted Patent US 11,049,289
Granted Patent B2
US 11,049,289 · App. 16/244,821 · Granted Jun 29, 2021

Systems and methods to semi-automatically segment a 3D medical image using a real-time edge-aware brush

Inventors: Vincent Morard (Buc, FR); Terry Gallico (Buc, FR); Nicolas Gogin (Buc, FR)
Assignee: General Electric Company
G06T11/001G06T5/003G06T5/005G06T11/60H04N1/62G06F3/04845G06K9/40G06T5/002G06T5/20G06T2207/20192G09G5/026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,049,289
App. No.
16/244,821
Filed
Jan 10, 2019
Granted
Jun 29, 2021
Kind
B2
Examiner
ALAVI, AMIR
Art Unit
2668
USPC
382/260
Abstract

Apparatus, systems, and methods to generate an edge aware brush for navigation and segmentation of images via a user interface are disclosed. An example processor is to at least: construct a brush for segmentation of image data; provide an interactive representation of the brush with respect to the image data via a user interface, the interactive representation to be displayed and made available for interaction in each of a plurality of viewports provided for display of views of the image data in the user interface; enable update of the viewports based on manipulation of the representation; facilitate display of a preview of a segmentation of the image data corresponding to a location of the representation; and, when the segmentation is confirmed, facilitate generation of an output based on the segmentation.

Claims (35)

1. At least one non-transitory computer readable storage medium including instructions which, when executed, cause at least one processor to at least:

construct a brush for segmentation of image data;

provide an interactive representation of the brush with respect to the image data via a user interface, the interactive representation to be displayed and made available for interaction in each of a plurality of viewports provided for display of views of the image data in the user interface;

enable update of the viewports based on manipulation of the representation;

facilitate display of a preview of a segmentation of the image data corresponding to a location of the representation; and

when the segmentation is confirmed, facilitate generation of an output based on the segmentation.

2. The at least one non-transitory computer readable storage medium of claim 1 , wherein the brush is to be constructed according to a radius and a gradient, wherein the radius defines a default size of the representation and the gradient defines a sensitivity to at least one of boundaries or contours in the image data, the representation to adapt to the at least one of boundaries or contours in the image data according to a value of the gradient defined for the brush.

3. The at least one non-transitory computer readable storage medium of claim 2 , wherein the at least one of boundaries or contours in the image data are associated with a predefined segmentation.

4. The at least one non-transitory computer readable storage medium of claim 1 , wherein the representation of the brush is to be displayed in at least one of two dimensions or three dimensions.

5. The at least one non-transitory computer readable storage medium of claim 1 , wherein the location of the representation is to be determined using a three-dimensional propagation from a pointing device used to manipulate the representation with an Amoebas distance.

6. The at least one non-transitory computer readable storage medium of claim 1 , wherein the preview of the segmentation is to be generated by adaptive subsampling and cropping of the image data, edge aware filtering of the representation of the brush, propagation to determine a shape and location of the representation with respect to a pointing device used to manipulate the representation, and upsampling of the representation.

7. The at least one non-transitory computer readable storage medium of claim 1 , wherein the plurality of viewports includes a plurality of two-dimensional viewers and a three-dimensional viewer.

8. An apparatus comprising:

at least one processor; and

at least one computer readable storage medium including instructions which, when executed, cause the at least one processor to at least:

construct a brush for segmentation of image data;

provide an interactive representation of the brush with respect to the image data via a user interface, the interactive representation to be displayed and made available for interaction in each of a plurality of viewports provided for display of views of the image data in the user interface;

enable update of the viewports based on manipulation of the representation;

facilitate display of a preview of a segmentation of the image data corresponding to a location of the representation; and

when the segmentation is confirmed, facilitate generation of an output based on the segmentation.

9. The apparatus of claim 8 , wherein the brush is to be constructed according to a radius and a gradient, wherein the radius defines a default size of the representation and the gradient defines a sensitivity to at least one of boundaries or contours in the image data, the representation to adapt to the at least one of boundaries or contours in the image data according to a value of the gradient defined for the brush.

10. The apparatus of claim 9 , wherein the at least one of boundaries or contours in the image data are associated with a predefined segmentation.

11. The apparatus of claim 8 , wherein the representation of the brush is to be displayed in at least one of two dimensions or three dimensions.

12. The apparatus of claim 8 , wherein the location of the representation is to be determined using a three-dimensional propagation from a pointing device used to manipulate the representation with an Amoebas distance.

13. The apparatus of claim 8 , wherein the preview of the segmentation is to be generated by adaptive subsampling and cropping of the image data, edge aware filtering of the representation of the brush, propagation to determine a shape and location of the representation with respect to a pointing device used to manipulate the representation, and upsampling of the representation.

14. The apparatus of claim 8 , wherein the plurality of viewports includes a plurality of two-dimensional viewers and a three-dimensional viewer.

15. At least one non-transitory computer readable storage medium including processor-executable instructions and a data structure, the data structure including:

a brush construct, the brush construct specifying an interactive representation to be displayed with respect to image data via a user interface, the interactive representation to be displayed and made available for interaction in each of a plurality of viewports provided for display of views of the image data in the user interface for segmentation of the image data, the brush construct defined by:

a shape including a radius and a gradient, wherein a value of the radius defines a default size of the representation and a value of the gradient defines a sensitivity to at least one of boundaries or contours in the image data, the representation to adapt to the at least one of boundaries or contours in the image data according to the value of the gradient defined for the brush; and

coordinates including first coordinates to store a position of the representation with respect to a first viewport of the user interface and second coordinates to store the position of the representation with respect to a second viewport of the user interface.

16. The at least one non-transitory computer readable storage medium of claim 15 , wherein the at least one of boundaries or contours in the image data are associated with a predefined segmentation.

17. The at least one non-transitory computer readable storage medium of claim 15 , wherein the representation of the brush is to be displayed in at least one of two dimensions or three dimensions.

18. The at least one non-transitory computer readable storage medium of claim 15 , wherein the coordinates are to be determined using a three-dimensional propagation from a pointing device used to manipulate the representation with an Amoebas distance.

19. The at least one non-transitory computer readable storage medium of claim 15 , wherein the first viewport includes a two-dimensional viewer and the second viewport includes a three-dimensional viewer.

20. The at least one non-transitory computer readable storage medium of claim 15 , wherein the data structure is to enable generation of a preview of segmentation of the image data with respect to the representation by adaptive subsampling and cropping of the image data, edge aware filtering of the representation according to the data structure, propagation to determine a shape and location of the representation with respect to a pointing device used to manipulate the representation, and upsampling of the representation according to the data structure.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded May 8, 2025
From: GENERAL ELECTRIC COMPANY
To: GE PRECISION HEALTHCARE LLC
Reel/Frame 071225/0218 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2019
From: MORARD, VINCENT; GALLICO, TERRY; GOGIN, NICOLAS
To: GENERAL ELECTRIC COMPANY
Reel/Frame 047958/0310 →
Continuity (1)
Related Publication 20200226798A1 · Jul 16, 2020
Cited By (4)
US 12,198,349 US 12,307,674 US 12,308,111 US 12,315,167