IP Library Granted Patent US 10,621,724
Granted Patent B2
US 10,621,724 · App. 15/721,779 · Granted Apr 14, 2020

System and method for image segmentation

Inventor: Ce Wang (Shanghai, CN)
Assignee: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
G06T7/0014G06K9/2054G06K9/6202G06K9/6259G06K9/6267G06T7/11G06T7/143G06T7/187G06T7/74G06T2207/10028G06T2207/20076G06T2207/20156G06T2207/30008G06T2207/30012G06T2207/30061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,621,724
App. No.
15/721,779
Granted
Apr 14, 2020
Kind
B2
Abstract

Methods and systems for image segmentation are provided. Image data may be acquired, wherein the image data may include a plurality of ribs. A rib region containing at least a portion of the plurality of ribs may be determined. At least one rib of the plurality of ribs may be selected as a target rib based on the rib region. At least one rib-probability-map relating to the target rib may be generated based on an artificial intelligence algorithm. A starting point of the target rib may be determined based on the image data, wherein the starting point may indicate a starting position for tracking the target rib. At least one portion of the target rib may be tracked based on the starting point and the at least one rib-probability-map. A segmented rib may be obtained by segmenting the at least one portion of the target rib.

Claims (80)

1. An image processing method implemented on at least one machine each of which has at least one processor and storage, the method comprising:

acquiring image data, the image data including a plurality of ribs;

determining a rib region containing at least a portion of the plurality of ribs;

selecting, based on the rib region, at least one rib of the plurality of ribs as a target rib;

generating, based on an artificial intelligence algorithm, at least one rib-probability-map relating to the target rib;

determining, based on the image data, a starting point of the target rib, wherein determining the starting point of the target rib comprises:

determining a histogram based on a plurality of image layers of the target rib in a coronal plane; and

designating, based on the histogram, a characteristic point of the target rib as the starting point, wherein the characteristic point is determined based on a position in the histogram and a point at the position has a minimum value in the histogram;

tracking, based on the starting point and the at least one rib-probability-map, at least one portion of the target rib; and

obtaining a segmented rib by segmenting the at least one portion of the target rib.

2. The method of claim 1 , wherein the selecting at least one rib of the plurality of ribs as a target rib comprises:

determining a seed point for the at least one rib of the plurality of ribs;

performing pre-segmentation based on the image data and the seed point to obtain a preliminary rib; and

designating, based on a determination that the preliminary rib is adhesive to a vertebra, the preliminary rib as the target rib for further segmentation, or

designating, based on a determination that the preliminary rib is not adhesive to a vertebra, the preliminary rib as the segmented rib.

3. The method of claim 1 , wherein the determining a histogram comprises:

superimposing a plurality of rib pixels or voxels of the plurality of image layers along an anterior-posterior direction to obtain a diagram, each element at a position of the diagram representing a total number of pixels or voxels that are located at a corresponding position in one or more of the plurality of image layers and belong to a portion of the plurality of rib pixels or voxels, wherein each pixel or voxel of the portion of the plurality of rib pixels or voxels has a gray value larger than a first threshold; and

superimposing a plurality of elements of the diagram along a superior-inferior direction to obtain the histogram, each element of the histogram representing a sum of elements belonging to a portion of the plurality of elements, wherein all of the portion of the plurality of elements have a same position in a left-right direction.

4. The method of claim 1 , wherein the generating at least one rib-probability-map relating to the target rib comprises:

generating, based on a classifier, the at least one rib-probability-map, wherein the classifier is trained based on the artificial intelligence algorithm and a plurality of images relating to at least one sample rib.

5. The method of claim 1 , wherein the tracking at least one portion of the target rib comprises:

determining, based on the image data, a trace direction range; and

determining, based on the trace direction range and the at least one rib-probability-map, a predicted rib segment to obtain the at least one portion of the target rib.

6. The method of claim 5 , wherein the determining a predicted rib segment comprises:

determining, within the trace direction range, at least one portion of the at least one rib-probability-map;

determining, based on the at least one portion of the at least one rib-probability-map, a trace direction; and

obtaining, based on the trace direction, the predicted rib segment.

7. The method of claim 5 , wherein the tracking at least one portion of the target rib further comprises:

matching the predicted rib segment with at least one rib model.

8. The method of claim 7 , further comprising:

terminating tracking the at least one portion of the target rib, based on a determination that the predicted rib segment does not match with the at least one rib model.

9. The method of claim 8 , further comprising:

based on a determination that the predicted rib segment does not match with the at least one rib model,

performing, based on a plurality of matched rib segments, model reconstruction to obtain a reconstructed model; and

extracting, based on the plurality of matched rib segments, the at least one portion of the target rib.

10. The method of claim 7 , further comprising:

based on a determination that the predicted rib segment matches with the at least one rib model,

designating the predicted rib segment as a matched rib segment of the target rib; and

tracking, based on the matched rib segment of the target rib and the at least one rib-probability-map, a next rib segment of the target rib.

11. The method of claim 1 , wherein the target rib has a first end and a second end, wherein the first end of the target rib is spaced from a vertebra by a first distance, and the second end of the target rib is spaced from the vertebra by a second distance, and the first distance is larger than the second distance.

12. The method of claim 11 , wherein the determining a starting point of the target rib comprises:

designating a point of the target rib closer to the second end than to the first end of the target rib as the starting point.

13. The method of claim 11 , wherein the tracking at least one portion of the target rib comprises:

tracking the at least one portion of the target rib from the starting point to the second end of the target rib.

14. The method of claim 13 , wherein the obtaining a segmented rib by segmenting the at least one portion of the target rib comprises:

segmenting a first portion of the target rib using a segmentation algorithm, wherein the first portion of the target rib includes a region between the starting point and the first end of the target rib;

segmenting the at least one portion of the target rib to obtain a second portion of the target rib, wherein the second portion includes a region between the starting point and the second end of the target rib; and

combining the first portion of the target rib and the second portion of the target rib to obtain the segmented rib related to the target rib.

15. The method of claim 14 , wherein the segmentation algorithm is a region growing algorithm.

16. The method of claim 1 , further comprising:

labelling the segmented rib.

17. A non-transitory computer readable medium storing instructions, the instructions, when executed by at least one processor, causing the at least one processor to implement a method comprising:

acquiring image data, the image data including a plurality of ribs;

determining a rib region containing at least a portion of the plurality of ribs;

selecting, based on the rib region, at least one rib of the plurality of ribs as a target rib;

generating, based on an artificial intelligence algorithm, at least one rib-probability-map relating to the target rib;

determining, based on the image data, a starting point of the target rib, the starting point indicating a starting position for tracking the target rib, wherein determining the starting point of the target rib comprises:

determining a histogram based on a plurality of image layers of the target rib in a coronal plane; and

designating, based on the histogram, a characteristic point of the target rib as the starting point, wherein the characteristic point is determined based on a position in the histogram and a point at the position has a minimum value in the histogram

tracking, based on the starting point and the at least one rib-probability-map, at least one portion of the target rib; and

obtaining a segmented rib by segmenting the at least one portion of the target rib.

18. A system comprising:

at least one processor, and

a storage configured to store instructions, the instructions, when executed by the at least one processor, causing the system to effectuate a method comprising:

acquiring image data, the image data including a plurality of ribs;

determining a rib region containing at least a portion of the plurality of ribs;

selecting, based on the rib region, at least one rib of the plurality of ribs as a target rib;

generating, based on an artificial intelligence algorithm, at least one rib-probability-map relating to the target rib;

determining, based on the image data, a starting point of the target rib, the starting point indicating a starting position for tracking the target rib, wherein determining the starting point of the target rib comprises:

determining a histogram based on a plurality of image layers of the target rib in a coronal plane; and

designating, based on the histogram, a characteristic point of the target rib as the starting point, wherein the characteristic point is determined based on a position in the histogram and a point at the position has a minimum value in the histogram;

tracking, based on the starting point and the at least one rib-probability-map, at least one portion of the target rib; and

obtaining a segmented rib by segmenting the at least one portion of the target rib.

19. The system of claim 18 , wherein the selecting at least one rib of the plurality of ribs as a target rib comprises:

determining a seed point for the at least one rib of the plurality of ribs;

performing pre-segmentation based on the image data and the seed point to obtain a preliminary rib; and

designating, based on a determination that the preliminary rib is adhesive to a vertebra, the preliminary rib as the target rib for further segmentation, or designating, based on a determination that the preliminary rib is not adhesive to a vertebra, the preliminary rib as the segmented rib.

20. The system of claim 18 , wherein the tracking at least one portion of the target rib comprises:

determining, based on the image data, a trace direction range; and

determining, based on the trace direction range and the at least one rib-probability-map, a predicted rib segment to obtain the at least one portion of the target rib.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2020
From: SHENZHEN UNITED IMAGING HEALTHCARE CO., LTD.
To: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
Reel/Frame 052027/0839 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2020
From: WANG, CE
To: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
Reel/Frame 051896/0312 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2020
From: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
To: SHENZHEN UNITED IMAGING HEALTHCARE CO., LTD.
Reel/Frame 051896/0320 →
Priority Claims (2)
CN 2017 1 0939388 · Sep 30, 2017 · national
CN 2017 1 0944072 · Sep 30, 2017 · national
Continuity (2)
Continuation PCTCN2017100024 · Aug 31, 2017
Related Publication 20190066293A1 · Feb 28, 2019
Cited By (1)
US 12,511,745