IP Library Granted Patent US 11,544,552
Granted Patent B1
US 11,544,552 · App. 16/369,310 · Granted Jan 3, 2023

Method and apparatus for refining an automated coding model

Inventors: Alex Londeree (San Francisco, CA); Nick Giannasi (Truckee, CA); Adrian Lam (Emeryville, CA); Adam Sullivan (Walnut Creek, CA)
Assignee: CHANGE HEALTHCARE HOLDINGS, LLC
G06N3/08G06N7/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,544,552
App. No.
16/369,310
Granted
Jan 3, 2023
Kind
B1
Abstract

A method, apparatus and computer program product refine an automated coding model, such as for a medical chart. For each respective candidate code from a set of candidate codes, the method predicts a probability of the respective code being contained in a medical chart. The method also selects one of the candidate codes as being contained in the medical chart based upon the probability and removes the selected candidate code from the set of candidate codes. The method then repeatedly predicts the probability of a respective code being contained in the medical chart, selects one of the candidate codes based upon the predicted probability and removes the selected candidate code from the set of candidate codes. The method further determines a categorical crossentropy loss as to permit adjustment of one or more parameters of the automated coding model.

Claims (48)

1. A method for refining an automated coding model for secondary diagnosis prediction, the method comprising:

operating a deep learning model including an artificial neural network to perform operations as follows:

for each respective candidate secondary diagnosis from a set of candidate secondary diagnoses, predicting a probability of the respective secondary diagnosis being contained in a medical chart;

selecting one of the candidate secondary diagnoses as being contained in the medical chart based upon the probability that is predicted and removing the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses;

following removal of the candidate secondary diagnosis that has been selected from the set of secondary diagnoses, repeatedly predicting the probability of a respective secondary diagnosis being contained in the medical chart, selecting one of the candidate secondary diagnoses as being contained in the medical chart based upon the probability that is predicted and removing the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses; and

determining a categorical crossentropy loss based upon the probabilities that are predicted for the candidate secondary diagnoses that are selected;

adjusting one or more parameters of the artificial neural network, which implements the automated coding model, based upon the categorical crossentropy loss,

wherein the set of candidate secondary diagnoses also includes a null element, and wherein repeatedly predicting, selecting and removing is concluded upon selecting the null element based upon the probability of the null element that is predicted.

2. A method according to claim 1 wherein selecting one of the candidate secondary diagnoses comprises selecting the candidate secondary diagnosis having the greatest probability of being contained in the medical chart.

3. A method according to claim 1 wherein predicting the probability of a respective secondary diagnosis being contained in a medical chart comprises predicting the probability such that a cumulative probability of the plurality of candidate secondary diagnoses from the set of candidate secondary diagnoses equals 1.

4. A method according to claim 1 wherein determining the categorical crossentropy loss comprises:

for each of the candidate secondary diagnoses that are selected, determining a product of a label representative of a respective candidate secondary diagnosis that is selected and the probability of the respective candidate secondary diagnosis; and

summing the products for each of the candidate secondary diagnoses that are selected to determine the categorical crossentropy loss.

5. A method according to claim 1 further comprising adjusting the one or more parameters of the automated coding model based upon the categorical crossentropy loss to reduce the categorical crossentropy loss.

6. A method according to claim 1 wherein removing the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses comprises removing the candidate secondary diagnosis that has been selected and one or more additional candidate secondary diagnoses that have a defined relationship to the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses.

7. An apparatus for refining an automated coding model for secondary diagnosis prediction, the apparatus comprising:

a processor; and

a memory coupled to the processor and comprising computer readable program code embodied in the memory that is executable by the processor to operate a deep learning model including an artificial neural network to perform operations comprising:

predicting, for each respective candidate secondary diagnosis from a set of candidate secondary diagnoses, a probability of the respective secondary diagnosis being contained in a medical chart;

selecting one of the candidate secondary diagnoses as being contained in the medical chart based upon the probability that is predicted and remove the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses; and

following removal of the candidate secondary diagnosis that has been selected from the set of secondary diagnoses, repeatedly predicting the probability of a respective secondary diagnosis being contained in the medical chart, select one of the candidate secondary diagnoses as being contained in the medical chart based upon the probability that is predicted and remove the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses; and

determining a categorical crossentropy loss based upon the probabilities that are predicted for the candidate secondary diagnoses that are selected;

adjusting one or more parameters of the artificial neural network, which implements the automated coding model, based upon the categorical crossentropy loss,

wherein the set of candidate secondary diagnoses includes a null element, and wherein repeatedly predicting, selecting and removing is concluded upon selecting the null element based upon the probability of the null element that is predicted.

8. An apparatus according to claim 7 wherein selecting one of the candidate secondary diagnoses comprises selecting the candidate secondary diagnosis having the greatest probability of being contained in the medical chart.

9. An apparatus according to claim 7 wherein predicting the probability of a respective secondary diagnosis being contained in a medical chart comprises predicting the probability such that a cumulative probability of the plurality of candidate secondary diagnoses from the set of candidate secondary diagnoses equals 1.

10. An apparatus according to claim 7 wherein determining the categorical crossentropy loss comprises:

for each of the candidate secondary diagnoses that are selected, determining a product of a label representative of a respective candidate secondary diagnosis that is selected and the probability of the respective candidate secondary diagnosis; and

summing the products for each of the candidate secondary diagnoses that are selected to determine the categorical crossentropy loss.

11. An apparatus according to claim 7 wherein the operations further comprise:

adjusting the one or more parameters of the automated coding model based upon the categorical crossentropy loss to reduce the categorical crossentropy loss.

12. An apparatus according to claim 7 wherein removing the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses comprises removing the candidate secondary diagnosis that has been selected and one or more additional candidate secondary diagnoses that have a defined relationship to the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses.

13. A computer program product, comprising:

a non-transitory computer readable storage medium comprising computer readable program code embodied in the medium that is executable by a processor to perform operations comprising:

operating a deep learning model including an artificial neural network to perform operations as follows:

for each respective candidate secondary diagnosis from a set of candidate secondary diagnoses, predicting a probability of the respective secondary diagnosis being contained in a medical chart;

selecting one of the candidate secondary diagnoses as being contained in the medical chart based upon the probability that is predicted and removing the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses;

following removal of the candidate secondary diagnosis that has been selected from the set of secondary diagnoses, repeatedly predicting the probability of a respective secondary diagnosis being contained in the medical chart, selecting one of the candidate secondary diagnoses as being contained in the medical chart based upon the probability that is predicted and removing the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses; and

determining a categorical crossentropy loss based upon the probabilities that are predicted for the candidate secondary diagnoses that are selected;

adjusting one or more parameters of the artificial neural network, which implements the automated coding model, based upon the categorical crossentropy loss,

wherein the set of candidate secondary diagnoses also includes a null element, and wherein repeatedly predicting, selecting and removing is concluded upon selecting the null element based upon the probability of the null element that is predicted.

14. A computer program product according to claim 13 wherein selecting one of the candidate secondary diagnoses comprises selecting the candidate secondary diagnosis having the greatest probability of being contained in the medical chart.

15. A computer program product according to claim 13 wherein predicting the probability of a respective code being contained in the medical chart comprises predicting the probability such that a cumulative probability of the plurality of candidate secondary diagnoses from the set of candidate secondary diagnoses equals 1.

16. A computer program product according to claim 13 wherein determining the categorical crossentropy loss comprises:

for each of the candidate secondary diagnoses that are selected, determining a product of a label representative of a respective candidate secondary diagnosis that is selected and the probability of the respective candidate secondary diagnosis; and

summing the products for each of the candidate secondary diagnoses that are selected to determine the categorical crossentropy loss.

17. A computer program product according to claim 13 wherein the operations further comprise adjusting the one or more parameters of the automated coding model based upon the categorical crossentropy loss to reduce the categorical crossentropy loss.

18. A computer program product according to claim 13 wherein removing the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses comprises removing the candidate secondary diagnosis that has been selected and one or more additional candidate secondary diagnoses that have a defined relationship to the candidate secondary diagnosis that has been selected from the set of candidate secondary diagnoses.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Oct 5, 2022
From: BANK OF AMERICA, N.A.
To: CHANGE HEALTHCARE HOLDINGS, LLC
Reel/Frame 061620/0032 →
SECURITY INTEREST Recorded Dec 12, 2019
From: CHANGE HEALTHCARE HOLDINGS, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 051279/0614 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2019
From: LONDEREE, ALEX; GIANNASI, NICK; LAM, ADRIAN; SULLIVAN, ADAM
To: CHANGE HEALTHCARE HOLDINGS LLC
Reel/Frame 048739/0370 →
Cited By (2)
US 12,216,981 US 12,277,379