IP Library › Granted Patent US 11,683,438
Granted Patent B2
US 11,683,438 · App. 17/360,764 · Granted Jun 20, 2023

Systems and methods to semi-automatically segment a 3D medical image using a real-time edge-aware brush

Inventors: Vincent Morard (Buc, FR); Terry Gallico (Buc, FR); Nicolas Gogin (Buc, FR)
Assignee: General Electric Company
G06T11/001G06T5/003G06T5/005G06T11/60H04N1/62G06F3/04845G06T5/002G06T5/20G06T2207/20192G06V10/30G09G5/026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,683,438
App. No.
17/360,764
Granted
Jun 20, 2023
Kind
B2
Abstract

Apparatus, systems, and methods to generate an edge aware brush for navigation and segmentation of images via a user interface are disclosed. An example processor is to at least: construct a brush for segmentation of image data; provide an interactive representation of the brush with respect to the image data via a user interface, the interactive representation to be displayed and made available for interaction in each of a plurality of viewports provided for display of views of the image data in the user interface; enable update of the viewports based on manipulation of the representation; facilitate display of a preview of a segmentation of the image data corresponding to a location of the representation; and, when the segmentation is confirmed, facilitate generation of an output based on the segmentation.

Claims (39)

1. An apparatus including:

a touchscreen interface;

memory; and

a processor to:

generate an interactive brush representation manipulatable via the touchscreen interface with respect to a first image to segment the first image;

display a preview of the brush representation via the touchscreen interface;

activate, by selecting via the touchscreen interface, the brush representation to segment the first image; and

generate a second image, the second image segmented based on a position of the brush representation with respect to the first image.

2. The apparatus of claim 1 , wherein the processor is to update one or more viewports based on manipulation of the first image.

3. The apparatus of claim 1 , wherein the preview is a first preview, and wherein the processor is to:

facilitate display of a second preview of the second image; and

when segmentation of the first image is confirmed via the second preview, facilitate generation of the second image.

4. The apparatus of claim 3 , wherein the second preview is to be generated by adaptive subsampling and cropping of the first image, edge aware filtering of the brush representation, propagation to determine a shape and location of the brush representation with respect to a pointing device used to manipulate the representation, and upsampling of the brush representation.

5. The apparatus of claim 1 , wherein the brush representation is to be constructed according to a radius and a gradient, wherein the radius defines a default size of the brush representation and the gradient defines a sensitivity to at least one of boundaries or contours in the first image, the representation to adapt to the at least one of boundaries or contours in the first image according to the value of the gradient defined for the brush representation.

6. The apparatus of claim 5 , wherein the at least one of boundaries or contours in the first image are associated with a predefined segmentation.

7. The apparatus of claim 1 , wherein the brush representation is to be displayed in at least one of two dimensions or three dimensions.

8. The apparatus of claim 1 , wherein a location of the brush representation is to be determined using a three-dimensional propagation from a pointing device used to manipulate the representation with an Amoebas distance.

9. At least one non-transitory computer readable storage medium including instructions which, when executed, cause at least one processor to at least:

generate an interactive brush representation manipulatable via a touchscreen interface with respect to a first image to segment the first image;

display a preview of the brush representation via the touchscreen interface;

activate, by selecting via the touchscreen interface, the brush representation to segment the first image; and

generate a second image, the second image segmented based on a position of the brush representation with respect to the first image.

10. The at least one non-transitory computer readable storage medium of claim 9 , wherein the preview is a first preview, and wherein the processor is to:

facilitate display of a second preview of the second image; and

when segmentation of the first image is confirmed via the second preview, facilitate generation of the second image.

11. The at least one non-transitory computer readable storage medium of claim 10 , wherein the second preview is to be generated by adaptive subsampling and cropping of the first image, edge aware filtering of the brush representation, propagation to determine a shape and location of the brush representation with respect to a pointing device used to manipulate the representation, and upsampling of the brush representation.

12. The at least one non-transitory computer readable storage medium of claim 9 , wherein the brush representation is to be constructed according to a radius and a gradient, wherein the radius defines a default size of the brush representation and the gradient defines a sensitivity to at least one of boundaries or contours in the first image, the representation to adapt to the at least one of boundaries or contours in the first image according to the value of the gradient defined for the brush representation.

13. The at least one non-transitory computer readable storage medium of claim 12 , wherein the at least one of boundaries or contours in the first image are associated with a predefined segmentation.

14. The at least one non-transitory computer readable storage medium of claim 9 , wherein the brush representation is to be displayed in at least one of two dimensions or three dimensions.

15. The at least one non-transitory computer readable storage medium of claim 9 , wherein a location of the brush representation is to be determined using a three-dimensional propagation from a pointing device used to manipulate the representation with an Amoebas distance.

16. A computer-implemented method comprising:

generating, by executing an instruction using at least one processor, an interactive brush representation manipulatable via a touchscreen interface with respect to a first image to segment the first image;

displaying, by executing an instruction using the at least one processor, a preview of the brush representation via the touchscreen interface

activating, by executing an instruction using the at least one processor based on a selection via the touchscreen interface, the brush representation to segment the first image; and

generating, by executing an instruction using the at least one processor, a second image, the second image segmented based on a position of the brush representation with respect to the first image.

17. The method of claim 16 , wherein the preview is a first preview, and wherein the method further includes: facilitating display of a second preview of the second image, wherein, when segmentation of the first image is confirmed via the second preview, the second image is generated.

18. The method of claim 17 , further including generating the second preview by adaptive subsampling and cropping of the first image, edge aware filtering of the brush representation, propagation to determine a shape and location of the brush representation with respect to a pointing device used to manipulate the representation, and upsampling of the brush representation.

19. The method of claim 16 , wherein the brush representation is to be constructed according to a radius and a gradient, wherein the radius defines a default size of the brush representation and the gradient defines a sensitivity to at least one of boundaries or contours in the first image, the representation to adapt to the at least one of boundaries or contours in the first image according to the value of the gradient defined for the brush representation.

20. The method of claim 16 , further including determining a location of the brush representation using a three-dimensional propagation from a pointing device used to manipulate the representation with an Amoebas distance.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2021
From: MORARD, VINCENT; GALLICO, TERRY; GOGIN, NICOLAS
To: GENERAL ELECTRIC COMPANY
Reel/Frame 056691/0805 →
Continuity (2)
Continuation 16244821 · Jan 10, 2019
Related Publication 20210327105A1 · Oct 21, 2021