IP Library Granted Patent US 11,195,062
Granted Patent B2
US 11,195,062 · App. 16/685,191 · Granted Dec 7, 2021

Classification based on characterization analysis methods and systems

Inventors: Mustafa Jaber (Los Angeles, CA); Liudmila A Beziaeva (Culver City, CA); Christopher W Szeto (Scotts Valley, CA); Bing Song (La Canada, CA)
Assignees: NantOmics, LLC; NantHealth, Inc.
G06K9/628G06N3/04G06T7/0012G06T7/10G16H30/20G16H30/40G16H50/20G06T2207/20084G06T2207/30024G06T2207/30096
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,195,062
App. No.
16/685,191
Granted
Dec 7, 2021
Kind
B2
Abstract

A method at a computing device for classifying elements within an input, the method including breaking the input into a plurality of patches; for each patch: creating a vector output; applying a characterization map to select a classification bin from a plurality of classification bins; and utilizing the selected classification bin to classify the vector output to create a classified output; and compiling the classified output from each patch.

Claims (42)

1. A method at a computing device for classifying elements within an input, the method comprising:

breaking the input into a plurality of patches;

for each patch:

creating a vector output;

applying a characterization map to select a classification bin from a plurality of classification bins; and

utilizing the selected classification bin to classify the vector output to create a classified output; and

compiling the classified output from each patch;

wherein each classification bin from the plurality of classification bins contains at least one of a linear and a non-linear classifier.

2. The method of claim 1 , further comprising applying a mask to the input prior to creating the vector input.

3. The method of claim 1 , wherein the creating the vector output is performed using a convolutional neural network.

4. The method of claim 1 , wherein the linear and non-linear classifiers in each classification bin are optimized based on the characterization map.

5. The method of claim 4 , wherein the characterization map is a density map of an element within the input, and wherein each of the plurality of classification bins corresponds to a different density range for the element.

6. The method of claim 1 , wherein the input is a whole slide image of a tumor and the characterization map is a cell density map.

7. The method of claim 6 , wherein each classification bin contains linear and non-linear classifiers to identify between different types of cancer cells at a cell density level associated with the classification bin.

8. The method of claim 7 , wherein the tumor is a non-small cell lung cancer and the different types of cancer cells include adenocarcinoma and squamous cell carcinoma cells.

9. The method of claim 8 , further comprising applying a tumor mask to the whole slide image.

10. The method of claim 7 , wherein the tumor is a breast cancer and the different types of cancer cells can be divided into two or more of: Luminal A, Luminal B, Triple-negative/basal-like, and HER2-enriched cells.

11. A computing device for classifying elements within an input, the computing device comprising a processor configured to execute instructions to:

break the input into a plurality of patches;

for each patch:

create a vector output;

apply a characterization map to select a classification bin from a plurality of classification bins; and

utilize the selected classification bin to classify the vector output to create a classified output; and

compile the classified output from each patch;

wherein each classification bin from the plurality of classification bins contains at least one of a linear and a non-linear classifier.

12. The computing device of claim 11 , wherein the computing device is further configured to utilize a mask for the input prior to creating the vector input.

13. The computing device of claim 11 , wherein the vector output is created using a convolutional neural network.

14. The computing device of claim 11 , wherein the linear and non-linear classifiers in each classification bin are optimized based on the characterization map.

15. The computing device of claim 14 , wherein the characterization map is a density map of an element within the input, and wherein each of the plurality of classification bins corresponds to a different density range for the element.

16. The computing device of claim 11 , wherein the input is a whole slide image of a tumor and the characterization map is a cell density map.

17. The computing device of claim 16 , wherein each classification bin contains a support vector machine to identify between different types of cancer cells at a cell density level associated with the classification bin.

18. The computing device of claim 17 , wherein the tumor is a non-small cell lung cancer and the different types of cancer cells include adenocarcinoma and squamous cell carcinoma cells.

19. The computing device of claim 18 , wherein the processor is further configured to execute instructions to apply a tumor mask to the whole slide image.

20. The computing device of claim 17 , wherein the tumor is a breast cancer and the different types of cancer cells can be divided into two or more of: Luminal A, Luminal B, Triple-negative/basal-like, and HER2-enriched cells.

21. A non-transitory computer readable medium for storing instruction code for classifying elements within an input, which, when executed by a processor of a computing device cause the computing device to:

break the input into a plurality of patches;

for each patch:

create a vector output;

apply a characterization map to select a classification bin from a plurality of classification bins; and

utilize the selected classification bin to classify the vector output to create a classified output; and

compile the classified output from each patch;

wherein each classification bin from the plurality of classification bins contains at least one of a linear and a non-linear classifier.

Assignments (5)
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 22, 2023
From: NANTHEALTH, INC.; NAVINET, INC.; THE OPENNMS GROUP, INC.
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION
Reel/Frame 063717/0813 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF CONVEYING PARTY PREVIOUSLY RECORDED AT REEL: 062948 FRAME: 0935. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY SECURITY AGREEMENT. Recorded Mar 31, 2023
From: NANTHEALTH, INC. (F/K/A - ALL ABOUT ADVANCED HEALTH LLC); NAVINET, INC.; THE OPENNMS GROUP, INC. (F/K/A - BLAST CONSULTING COMPANY)
To: GLAS AMERICAS LLC, AS COLLATERAL AGENT
Reel/Frame 063211/0195 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 3, 2023
From: NANTHEALTH, INC. F/K/A ALL ABOUT ADVANCED HEALTH LLC; THEOPENNMS GROUP, INC. F/K/A BLAST CONSULTING COMPANY; NAVINET, INC.
To: GLAS AMERICAS LLC, AS COLLATERAL AGENT
Reel/Frame 062948/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2021
From: BEZIAEVA, LIUDMILA
To: NANTHEALTH, INC.
Reel/Frame 054944/0780 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2021
From: JABER, MUSTAFA; SZETO, CHRISTOPHER W.; SONG, BING
To: NANTOMICS, LLC.
Reel/Frame 054944/0825 →