IP Library Granted Patent US 11,748,877
Granted Patent B2
US 11,748,877 · App. 16/605,404 · Granted Sep 5, 2023

System and method associated with predicting segmentation quality of objects in analysis of copious image data

Inventors: Joel Haskin Saltz (Manhasset, NY); Tahsin M. Kurc (Coram, NY); Yi Gao (Stony Brook, NY); Wei Zhu (Setauket, NY); Si Wen (East Setauket, NY); Tianhao Zhao (Coram, NY); Sampurna Shrestha (Stony Brook, NY)
Assignee: The Research Foundation for The State University of New York
G06T7/0012G06F18/214G06F18/217G06F18/2431G06T7/0002G06T7/11G06T7/136G06T7/41G06V10/774G06V20/695G06T2207/20021G06T2207/20081G06T2207/30024G06T2207/30168G06T2207/30181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,748,877
App. No.
16/605,404
Granted
Sep 5, 2023
Kind
B2
Abstract

A system associated with predicting segmentation quality of segmented objects implemented in the analysis of copious image data is disclosed. The system receives a collection of image data related to a particular type of data. The image data is segmented into segmented data portions based on an object associated with the collection of image data. Regions of interest associated with the segmented data portions are determined. The quality of segmentation of the segmented data portions is determined for respective classification of the regions of interest. A classification label is assigned to the regions of interest. Regions of interest are partitioned into sub-regions. Features associated with the sub-regions of the segmented data portions are determined. A training dataset is generated based on the determined features associated with the sub-regions in order to train a classification model based on a predetermined threshold value. Test images are received to iteratively classify segmented data portions based on an object associated with the test images, using the trained classification model. The segmentation quality of segmented objects in the test images is predicted based on the trained classification model. A corresponding method and computer-readable device are also disclosed.

Claims (49)

1. A system for predicting segmentation quality of segmented objects implemented in the analysis of copious image data, the system comprising:

a quality assessment engine including a computing device configured to train the system during a training phase by performing operations comprising:

receiving a collection of image data related to a particular type of data;

partitioning the image data into segmented data portions based on an object associated with the collection of image data;

determining regions of interest associated with the segmented data portions;

determining quality of segmentation of the segmented data portions for respective classification of the regions of interest, the quality of segmentation being determined based on patch-level intensity and texture features associated with the image data;

assigning a classification label to the regions of interest, the classification label describing a quality of segmentation of the objects associated with the segmented data portions;

partitioning regions of interest into sub-regions;

computing a set of intensity and texture features for each of the sub-regions of the segmented data portions; and

generating a training dataset based on the computed intensity and texture features for the sub-regions in order to train a classification model based on a predetermined threshold value; and

the computing device in the quality assessment engine being configured to predict segmentation quality during a prediction phase by performing operations comprising:

receiving test images to iteratively classify segmented data portions based on an object associated with the test images, using the trained classification model; and

predicting the segmentation quality of segmented objects in the test images based on the trained classification model.

2. The system as recited in claim 1 , wherein the classification label includes at least one of: bad segmentation, under-segmented, over-segmented and good segmentation of the objects associated with the segmented data portions.

3. The system as recited in claim 1 , wherein regions of interest are segmented into sub-regions of equal-sized areas.

4. The system as recited in claim 1 , which further comprises adjusting the predetermined threshold value to achieve more refined segmentation quality.

5. The system as recited in claim 4 , which further comprises the predetermined threshold value comprising a gain value being adjusted in the range of a 0.0 and 2.0, in order to adjust respective intensity differences.

6. The system as recited in claim 1 , which further comprises the objects being one of: a biological object, a cellular object, an artificial structure associated with a map, a natural structure associated with a map, a miscellaneous object located on earth, and a miscellaneous object surrounding the atmosphere above earth.

7. A method for predicting segmentation quality of segmented objects implemented in the analysis of copious image data, the method comprising:

a quality assessment engine including a computing device configured to train the system during a training phase by performing operations comprising:

receiving a collection of image data related to a particular type of data;

partitioning the image data into segmented data portions based on an object associated with the collection of image data;

determining regions of interest associated with the segmented data portions;

determining quality of segmentation of the segmented data portions for respective classification of the regions of interest, the quality of segmentation being determined based on patch-level intensity and texture features associated with the image data;

assigning a classification label to the regions of interest, the classification label describing a quality of segmentation of the objects associated with the segmented data portions;

partitioning regions of interest into sub-regions;

computing a set of intensity and texture features for each of the sub-regions of the segmented data portions; and

generating a training dataset based on the computed intensity and texture features for the sub-regions in order to train a classification model based on a predetermined threshold value; and

the computing device in the quality assessment engine being configured to predict segmentation quality during a prediction phase by performing operations comprising:

receiving test images to iteratively classify segmented data portions based on an object associated with the test images, using the trained classification model; and

predicting the segmentation quality of segmented objects in the test images based on the trained classification model.

8. The method as recited in claim 7 , wherein the classification label includes at least one of: bad segmentation, under-segmented, over-segmented and good segmentation of the objects associated with the segmented data portions.

9. The method as recited in claim 7 , wherein regions of interest are segmented into sub-regions of equal-sized areas.

10. The method as recited in claim 7 , which further comprises adjusting the predetermined threshold value to achieve more refined segmentation quality.

11. The method as recited in claim 10 , which further comprises the predetermined threshold value being a gain value being adjusted in the range of a 0.0 and 2.0, in order to adjust respective intensity differences.

12. The method as recited in claim 7 , which further comprises the objects being one of: a biological object, a cellular object, an artificial structure associated with a map, a natural structure associated with a map, a miscellaneous object located on earth, and a miscellaneous object surrounding the atmosphere above earth.

13. A computer-readable device storing instructions for predicting segmentation quality of segmented objects implemented in an analysis of copious image data that, when executed by a processing device, are configured to train a system for predicting segmentation quality of segmented objects during a training phase by performing operations comprising:

receiving a collection of image data related to a particular type of data;

partitioning the image data into segmented data portions based on an object associated with the collection of image data;

determining regions of interest associated with the segmented data portions;

determining quality of segmentation of the segmented data portions for respective classification of the regions of interest, the quality of segmentation being determined based on patch-level intensity and texture features associated with the image data;

assigning a classification label to the regions of interest;

partitioning regions of interest into sub-regions;

computing a set of intensity and texture features for each of the sub-regions of the segmented data portions; and

generating a training dataset based on the computed intensity and texture features for the sub-regions in order to train a classification model based on a predetermined threshold value; and

the instructions stored by the computer-readable device further configured to predict segmentation quality during a prediction phase by performing operations comprising:

receiving test images to iteratively classify segmented data portions based on an object associated with the test images, using the trained classification model; and

predicting the segmentation quality of segmented objects in the test images based on the trained classification model.

14. The computer-readable device as recited in claim 13 , wherein the objects are one of: a biological object, a cellular object, an artificial structure associated with a map, a natural structure associated with a map, a miscellaneous object located on earth, and a miscellaneous object surrounding the atmosphere above earth.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2022
From: SALTZ, JOEL HASKIN; KURC, TAHSIN M.; GAO, YI; ZHU, WEI; WEN, SI; ZHAO, TIANHAO; SHRESTHA, SAMPURNA
To: THE RESEARCH FOUNDATION FOR THE STATE UNIVERSITY OF NEW YORK
Reel/Frame 061028/0406 →
Continuity (2)
Provisional Application 62504819 · May 11, 2017
Related Publication 20200126207A1 · Apr 23, 2020