IP Library Granted Patent US 12,367,262
Granted Patent B2
US 12,367,262 · App. 17/548,987 · Granted Jul 22, 2025

Feature selection based at least in part on temporally static feature selection criteria and temporally dynamic feature selection criteria

Inventors: Ciarán McKenna (Dublin, IE); Eugene E. Farrell (County Galway, IE); Kaj K. Poulsen (Corcoran, MN)
Assignee: Optum Services (Ireland) Limited
G06F18/22G06F18/211G06F18/2431G06Q30/0282
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,262
App. No.
17/548,987
Granted
Jul 22, 2025
Kind
B2
Abstract

There is a need to accurate and efficient feature selection. In one example, embodiments comprise, determining refined statically eligible feature category combinations and refined dynamically eligible feature category combinations. One or more refined eligible feature category combinations and a plurality of eligible feature combinations may be determined based at least in part on the refined statically eligible feature category combinations and the refined dynamically eligible feature category combinations. For each eligible feature combination, an aggregate distance score is determined. A refined feature combination is then determined based at least in part on each aggregate distance score. One or more action are performed based at least in part on the refined feature combination.

Claims (57)

1. A computer-implemented method for feature selection based at least in part on both temporally static feature selection criteria and temporally dynamic feature selection criteria, the computer-implemented method comprising:

identifying a plurality of features, wherein: (i) each feature of the plurality of features is associated with a feature category of a plurality of feature categories, (ii) each feature category of the plurality of feature categories is associated with a feature category weight of a plurality of feature category weights, and (iii) each feature of the plurality of features is associated with a current distance measure and a historical distance measure;

determining a plurality of statically eligible feature category combinations, wherein: (i) each statically eligible feature category combination of the plurality of statically eligible feature category combinations is characterized by a plurality of static feature category counts for the plurality of feature categories, (ii) each statically eligible feature category combination of the plurality of statically eligible feature category combinations is associated with a static cumulative weight of one or more static cumulative weights that satisfies a static cumulative weight threshold, and (iii) each static cumulative weight of the one or more corresponding static cumulative weights for a particular statically eligible feature category combination of the plurality of statically eligible feature category combinations is determined based at least in part on the plurality of static feature category counts for the particular statically eligible feature category combination and the plurality of feature category weights;

determining one or more refined statically eligible feature category combinations by filtering the plurality of statically eligible feature category combinations based at least in part on one or more static refinement constraints;

determining a plurality of dynamically eligible feature category combinations, wherein: (i) each dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is characterized by a plurality of dynamic feature category counts for the plurality of feature categories, (ii) each dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is associated with a dynamic cumulative weight of one or more dynamic cumulative weights that satisfies a dynamic cumulative weight threshold, and (iii) each dynamic cumulative weight of the one or more dynamic cumulative weights for a particular dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is determined based at least in part on the plurality of dynamic feature category counts for the particular dynamically eligible feature category combination and the plurality of feature category weights;

determining one or more refined dynamically eligible feature category combinations by filtering the plurality of dynamically eligible feature category combinations based at least in part on one or more dynamic refinement constraints;

determining one or more refined eligible feature category combinations by filtering the one or more refined statically eligible feature category combinations based at least in part on the one or more refined dynamically eligible feature category combinations;

determining a plurality of eligible feature combinations from the plurality of features, wherein the plurality of eligible feature combinations comprises, for each refined eligible feature category combination of the one or more refined eligible feature category combinations, a plurality of conforming feature combinations;

for each eligible feature combination of the plurality of eligible feature combinations, determining an aggregate distance measure based at least in part on at least one of each current distance measure for each feature of the eligible feature combination or each historical distance measure for each feature of the eligible feature combination;

selecting a refined eligible feature category combination of the one or more refined eligible feature category combinations based at least in part on the aggregate distance measure for each of the plurality of eligible feature combinations; and

performing one or more actions based at least in part on the selected refined eligible feature category combination.

2. The computer-implemented method of claim 1 , wherein the plurality of feature categories comprises a cross-temporal improvement feature category, and wherein the plurality of features comprises a cross-temporal improvement feature that is associated with the cross-temporal improvement feature category.

3. The computer-implemented method of claim 2 , wherein:

for each particular eligible feature combination of the plurality of eligible feature combinations that is associated with an affirmative value for the cross-temporal improvement feature category, determining the aggregate distance measure based at least in part on both each current distance measure for each feature of the particular eligible feature combination and each historical distance measure for each feature of the particular eligible feature combination.

4. The computer-implemented method of claim 1 , wherein the plurality of feature categories comprises a reward factor feature category and wherein the plurality of features comprises one or more reward factor features that are associated with the reward factor feature category.

5. The computer-implemented method of claim 4 , wherein:

for each particular eligible feature combination of the plurality of eligible feature combinations that is associated with an affirmative value for at least one reward factor feature of the one or more reward factor features, excluding the particular eligible feature combination from the plurality of eligible feature combinations when the particular eligible feature combination fails to satisfy one or more reward factor criteria.

6. The computer-implemented method of claim 1 , wherein determining the refined eligible feature category combination comprises:

determining the refined eligible feature category combination based at least in part on a selected eligible feature combination whose respective aggregate distance measure is lowest among respective aggregate distance measures of the one or more refined eligible feature category combinations.

7. The computer-implemented method of claim 1 , wherein the one or more static refinement constraints comprise, for each feature category in a selected subset of the plurality of feature categories, a static count threshold.

8. The computer-implemented method of claim 1 , wherein the one or more dynamic refinement constraints comprise, for each feature category in a selected subset of the plurality of feature categories, a dynamic count threshold.

9. A system for feature selection based at least in part on both temporally static feature selection criteria and temporally dynamic feature selection criteria, the system comprising one or more processors and memory including program code, the memory and the program code configured to, with the one or more processors, cause the system to at least:

identify a plurality of features, wherein: (i) each feature of the plurality of features is associated with a feature category of a plurality of feature categories, (ii) each feature category of the plurality of feature categories is associated with a feature category weight of a plurality of feature category weights, and (iii) each feature of the plurality of features is associated with a current distance measure and a historical distance measure;

determine a plurality of statically eligible feature category combinations, wherein: (i) each statically eligible feature category combination of the plurality of statically eligible feature category combinations is characterized by a plurality of static feature category counts for the plurality of feature categories, (ii) each statically eligible feature category combination of the plurality of statically eligible feature category combinations is associated with a static cumulative weight of one or more static cumulative weights that satisfies a static cumulative weight threshold, and (iii) each static cumulative weight of the one or more corresponding static cumulative weights for a particular statically eligible feature category combination of the plurality of statically eligible feature category combinations is determined based at least in part on the plurality of static feature category counts for the particular statically eligible feature category combination and the plurality of feature category weights;

determine one or more refined statically eligible feature category combinations by filtering the plurality of statically eligible feature category combinations based at least in part on one or more static refinement constraints;

determine a plurality of dynamically eligible feature category combinations, wherein: (i) each dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is characterized by a plurality of dynamic feature category counts for the plurality of feature categories, (ii) each dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is associated with a dynamic cumulative weight of one or more dynamic cumulative weights that satisfies a dynamic cumulative weight threshold, and (iii) each dynamic cumulative weight of the one or more dynamic cumulative weights for a particular dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is determined based at least in part on the plurality of dynamic feature category counts for the particular dynamically eligible feature category combination and the plurality of feature category weights;

determine one or more refined dynamically eligible feature category combinations by filtering the plurality of dynamically eligible feature category combinations based at least in part on one or more dynamic refinement constraints;

determine one or more refined eligible feature category combinations by filtering the one or more refined statically eligible feature category combinations based at least in part on the one or more refined dynamically eligible feature category combinations;

determine a plurality of eligible feature combinations from the plurality of features, wherein the plurality of eligible feature combinations comprises, for each refined eligible feature category combination of the one or more refined eligible feature category combinations, a plurality of conforming feature combinations;

for each eligible feature combination of the plurality of eligible feature combinations, determine an aggregate distance measure based at least in part on at least one of each current distance measure for each feature of the eligible feature combination or each historical distance measure for each feature of the eligible feature combination;

select a refined eligible feature category combination of the one or more refined eligible feature category combinations based at least in part on the aggregate distance measure for each of the plurality of eligible feature combinations; and

perform one or more actions based at least in part on the selected refined eligible feature category combination.

10. The system of claim 9 , wherein the plurality of feature categories comprises a cross-temporal improvement feature category, and wherein the plurality of features comprises a cross-temporal improvement feature that is associated with the cross-temporal improvement feature category.

11. The system of claim 10 , wherein the memory and the program code are further configured to, with the one or more processors, cause the system to:

for each particular eligible feature combination of the plurality of eligible feature combinations that is associated with an affirmative value for the cross-temporal improvement feature category, determine the aggregate distance measure based at least in part on both each current distance measure for each feature of the particular eligible feature combination and each historical distance measure for each feature of the particular eligible feature combination.

12. The system of claim 9 , wherein the plurality of feature categories comprises a reward factor feature category, and wherein the plurality of features comprises one or more reward factor features that are associated with the reward factor feature category.

13. The system of claim 12 , wherein the memory and the program code are further configured to, with the one or more processors, cause the system to:

for each particular eligible feature combination of the plurality of eligible feature combinations that is associated with an affirmative value for at least one reward factor feature of the one or more reward factor features, exclude the particular eligible feature combination from the plurality of eligible feature combinations when the particular eligible feature combination fails to satisfy one or more reward factor criteria.

14. The system of claim 9 , wherein to determine the refined eligible feature category combination, the memory and the program code are further configured to, with the one or more processors, cause the system to:

determine the refined eligible feature category combination based at least in part on a selected eligible feature combination whose respective aggregate distance measure is lowest among respective aggregate distance measures of the one or more refined eligible feature category combinations.

15. The system of claim 9 , wherein the one or more static refinement constraints comprise, for each feature category in a selected subset of the plurality of feature categories, a static count threshold.

16. The system of claim 9 , wherein the one or more dynamic refinement constraints comprise, for each feature category in a selected subset of the plurality of feature categories, a dynamic count threshold.

17. A computer program product for feature selection based at least in part on both temporally static feature selection criteria and temporally dynamic feature selection criteria, the computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions configured to:

identify a plurality of features, wherein: (i) each feature of the plurality of features is associated with a feature category of a plurality of feature categories, (ii) each feature category of the plurality of feature categories is associated with a feature category weight of a plurality of feature category weights, and (iii) each feature of the plurality of features is associated with a current distance measure and a historical distance measure;

determine a plurality of statically eligible feature category combinations, wherein: (i) each statically eligible feature category combination of the plurality of statically eligible feature category combinations is characterized by a plurality of static feature category counts for the plurality of feature categories, (ii) each statically eligible feature category combination of the plurality of statically eligible feature category combinations is associated with a static cumulative weight of one or more static cumulative weights that satisfies a static cumulative weight threshold, and (iii) each static cumulative weight of the one or more corresponding static cumulative weights for a particular statically eligible feature category combination of the plurality of statically eligible feature category combinations is determined based at least in part on the plurality of static feature category counts for the particular statically eligible feature category combination and the plurality of feature category weights;

determine one or more refined statically eligible feature category combinations by filtering the plurality of statically eligible feature category combinations based at least in part on one or more static refinement constraints;

determine a plurality of dynamically eligible feature category combinations, wherein: (i) each dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is characterized by a plurality of dynamic feature category counts for the plurality of feature categories, (ii) each dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is associated with a dynamic cumulative weight of one or more dynamic cumulative weights that satisfies a dynamic cumulative weight threshold, and (iii) each dynamic cumulative weight of the one or more dynamic cumulative weights for a particular dynamically eligible feature category combination of the plurality of dynamically eligible feature category combinations is determined based at least in part on the plurality of dynamic feature category counts for the particular dynamically eligible feature category combination and the plurality of feature category weights;

determine one or more refined dynamically eligible feature category combinations by filtering the plurality of dynamically eligible feature category combinations based at least in part on one or more dynamic refinement constraints;

determine one or more refined eligible feature category combinations by filtering the one or more refined statically eligible feature category combinations based at least in part on the one or more refined dynamically eligible feature category combinations;

determine a plurality of eligible feature combinations from the plurality of features, wherein the plurality of eligible feature combinations comprises, for each refined eligible feature category combination of the one or more refined eligible feature category combinations, a plurality of conforming feature combinations;

for each eligible feature combination of the plurality of eligible feature combinations, determine an aggregate distance measure based at least in part on at least one of each current distance measure for each feature of the eligible feature combination or each historical distance measure for each feature of the eligible feature combination;

select a refined eligible feature category combination of the one or more refined eligible feature category combinations based at least in part on the aggregate distance measure for each of the plurality of eligible feature combinations; and

perform one or more actions based at least in part on the selected refined eligible feature category combination.

18. The computer program product of claim 17 , wherein the plurality of feature categories comprises a cross-temporal improvement feature category, and wherein the plurality of features comprises a cross-temporal improvement feature that is associated with the cross-temporal improvement feature category.

19. The computer program product of claim 17 , wherein the plurality of feature categories comprises a reward factor feature category, and wherein the plurality of features comprises one or more reward factor features that are associated with the reward factor feature category.

20. The computer program product of claim 17 , wherein the computer-readable program code portions are further configured to:

for each particular eligible feature combination of the plurality of eligible feature combinations that is associated with an affirmative value for at least one reward factor feature of the one or more reward factor features, exclude the particular eligible feature combination from the plurality of eligible feature combinations when the particular eligible feature combination fails to satisfy one or more reward factor criteria.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2021
From: MCKENNA, CIARAN; FARRELL, EUGENE E.; POULSEN, KAJ K.
To: OPTUM SERVICES (IRELAND) LIMITED
Reel/Frame 058371/0594 →
Continuity (1)
Related Publication 20230186354A1 · Jun 15, 2023
References Cited (33)
US 5638465A · Sano · 1997 [cited by examiner]
US 10606983B2 · Thesman · 2020 [cited by applicant]
US 11010716B2 · Thesman · 2021 [cited by applicant]
US 11941502B2 · MacManus · 2024 [cited by examiner]
US 12008441B2 · MacManus · 2024 [cited by examiner]
US 12033087B2 · MacManus · 2024 [cited by examiner]
US 12131264B2 · MacManus · 2024 [cited by examiner]
US 12182670B1 · Beauchesne · 2024 [cited by examiner]
US 20030195883A1 · Mojsilovic · 2003 [cited by examiner]
US 20050097435A1 · Prakash · 2005 [cited by examiner]
US 20060212142A1 · Madani · 2006 [cited by examiner]
US 20120033863A1 · Wojton · 2012 [cited by examiner]
US 20120283574A1 · Park · 2012 [cited by examiner]
US 20120303378A1 · Lieberman · 2012 [cited by applicant]
US 20130315477A1 · Murray · 2013 [cited by examiner]
US 20140330621A1 · Nichols et al. · 2014 [cited by applicant]
US 20160063516A1 · Terrazas · 2016 [cited by examiner]
US 20160232321A1 · Silverman · 2016 [cited by examiner]
US 20170213108A1 · Bergsma · 2017 [cited by examiner]
US 20180121820A1 · Manasse · 2018 [cited by examiner]
US 20180342060A1 · Yao · 2018 [cited by examiner]
US 20210097220A1 · Bhunia · 2021 [cited by examiner]
US 20210342652A1 · Glassman · 2021 [cited by examiner]
US 20220095871A1 · Jakhotia · 2022 [cited by examiner]
US 20220292856A1 · Stonehouse · 2022 [cited by examiner]
US 20240193462A1 · O'Hara · 2024 [cited by examiner]
“Building a Robust Star Improvement Strategy,” CitiusTech—CMS Star Improvement, (Year 2021), (6 pages), (Online), [Retrieved from the Internet Aug. 23, 2021] <URL: https://web.citiustech.com/healthtech/cms-star-improvem… [cited by applicant]
“Standard Error of the Proportion,” Chegg, (Online), (8 pages), [Retrieved from the Internet Apr. 8, 2022] <https://www.chegg.com/homework-help/definitions/standard-error-of-the-proportion-31>. [cited by applicant]
“Stars Planner for Medicare Advantage,” Baltimore Health Analytics LLC, (Year 2017), (7 pages), Available online: https://baltimorehealthanalytics.com/assets/webapps/help_docs/stars_planner_v1.pdf. [cited by applicant]
Budhiraja, Puneet et al. “Improving Medicare Advantage Star Ratings: An Analytical Framework,” Health Watch, Issue 87, Oct. 2018, pp. 21-24. [cited by applicant]
Johnson, Joe. “Quality in the Healthcare Marketplace: Becoming a Rising ‘Star’,” L.E.K. Consulting/Executive Insights, vol. XIV, Issue 14, (Year: 2012), (5 pages). [cited by applicant]
Smyth, Danielle. “How to Calculate Sampling Error for Percentages,” Sapling, Oct. 29, 2021, (10 pages), [Retrieved from the Internet Apr. 8, 2022] <https://www.sapling.com/6183888/calculate-sampling-error-percentages>. [cited by applicant]
Suh, Joon Won. “Evaluating the Relationship Between Health Plan Characteristics and CMS Quality Scores,” Thesis, (Year: 2021), (42 pages), University of California, Los Angeles. [cited by applicant]