IP Library › Granted Patent US 12,412,071
Granted Patent B2
US 12,412,071 · App. 17/646,088 · Granted Sep 9, 2025

Creating satisficing planners with deep learning

Inventors: Michael Katz (Goldens Bridge, NY); Patrick Christoph Ferber (Au, DE)
Assignee: International Business Machines Corporation
G06N3/042G06N3/08H04L41/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,412,071
App. No.
17/646,088
Filed
Dec 27, 2021
Granted
Sep 9, 2025
Kind
B2
Examiner
HO, RUAY L
Art Unit
2142
USPC
706/12
Abstract

Some embodiments of the present invention are directed to a method of choosing the components for a satisficing planner using machine learning (ML) (for example, deep learning (DL)). Some embodiments of the present invention are directed to choosing search algorithm component(s) for a satisficing planner using ML (for example, DL). Some embodiments of the present invention are directed to choosing search refinement components (that is, search boosting component(s) and/or search pruning component(s)) for a satisficing planner using ML (for example, DL).

Claims (33)

1. A computer-implemented method comprising:

receiving a planner application data set that includes information indicative of contexts in which a newly-designed satisficing planner is expected to be applied;

receiving a machine learning algorithm that has been trained to design satisficing planners; and

applying the machine learning algorithm to the planner application data set to obtain a newly-designed satisficing planner design, with the newly-designed satisficing planner design including the information indicative of a plurality of satisficing planner components to be included in the newly-designed satisficing planner design and an order in which the satisficing components are to be run, wherein the applying of the machine learning algorithm includes the following operations:

for each given satisficing planner component of the plurality of satisficing planner components, determining a component type from a plurality of component types for the given satisficing planner component, wherein the plurality of component types are selected from a list consisting of heuristic function types, search algorithm types, and refinement algorithm types, and wherein the refinement algorithm types comprise a search boosting component subtype and a search pruning component; and

for each given satisficing planner component of the plurality of satisficing planner components, determining a component candidate, from among a plurality of component candidates, of the determined component type of the given satisficing planner component.

2. The method of claim 1 , wherein the machine learning algorithm is a deep learning algorithm that includes a plurality of layers.

3. The method of claim 2 , wherein the plurality of layers includes a plurality of hidden layers.

4. The method of claim 1 , wherein:

the planner application data set includes a previously used satisficing planner design; and

the application of the machine learning algorithm uses the previously used satisficing planner as a basis for the newly-designed satisficing planner design.

5. The method of claim 1 , wherein the newly-designed satisficing planner design includes:

at least one satisficing planner component of the heuristic function type;

at least one satisficing planner component of the search algorithm type; and

at least one satisficing planner component of the search refinement type.

6. A computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:

receiving a planner application data set that includes information indicative of contexts in which a newly-designed satisficing planner is expected to be applied;

receiving a machine learning algorithm that has been trained to design satisficing planners; and

applying the machine learning algorithm to the planner application data set to obtain a newly-designed satisficing planner design, with the newly-designed satisficing planner design including the information indicative of a plurality of satisficing planner components to be included in the newly-designed satisficing planner design and an order in which the satisficing components are to be run, wherein the applying of the machine learning algorithm includes the following operations:

for each given satisficing planner component of the plurality of satisficing planner components, determining a component type from a plurality of component types for the given satisficing planner component, wherein the plurality of component types are selected from a list consisting of heuristic function types, search algorithm types, and refinement algorithm types, and wherein the refinement algorithm types comprise a search boosting component subtype and a search pruning component; and

for each given satisficing planner component of the plurality of satisficing planner components, determining a component candidate, from among a plurality of component candidates, of the determined component type of the given satisficing planner component.

7. The computer system of claim 6 wherein the machine learning algorithm is a deep learning algorithm that includes a plurality of layers.

8. The computer system of claim 7 where the plurality of layers includes a plurality of hidden layers.

9. A computer program product comprising:

one or more computer-readable tangible storage media and program instructions stored on at least one of the one or more tangible storage media, the program instructions executable by a processor to cause the processor to perform a method comprising:

receiving a planner application data set that includes information indicative of contexts in which a newly-designed satisficing planner is expected to be applied;

receiving a machine learning algorithm that has been trained to design satisficing planners; and

applying the machine learning algorithm to the planner application data set to obtain a newly-designed satisficing planner design, with the newly-designed satisficing planner design including the information indicative of a plurality of satisficing planner components to be included in the newly-designed satisficing planner design and an order in which the satisficing components are to be run, wherein the applying of the machine learning algorithm includes the following operations:

for each given satisficing planner component of the plurality of satisficing planner components, determining a component type from a plurality of component types for the given satisficing planner component, wherein the plurality of component types are selected from a list consisting of heuristic function types, search algorithm types, and refinement algorithm types, and wherein the refinement algorithm types comprise a search boosting component subtype and a search pruning component; and

for each given satisficing planner component of the plurality of satisficing planner components, determining a component candidate, from among a plurality of component candidates, of the determined component type of the given satisficing planner component.

10. The computer program product of claim 9 wherein the machine learning algorithm is a deep learning algorithm that includes a plurality of layers.

11. The computer program product of claim 10 , wherein the plurality of layers includes a plurality of hidden layers.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2021
From: KATZ, MICHAEL; FERBER, PATRICK CHRISTOPH
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 058484/0229 →
Continuity (1)
Related Publication 20230206027A1 · Jun 29, 2023
References Cited (35)
US 9201426B1 · Bonawitz · 2015 [cited by applicant]
US 10296862B1 · Oddo · 2019 [cited by applicant]
US 10373092B2 · De · 2019 [cited by applicant]
US 10726368B2 · Bunkheila · 2020 [cited by applicant]
US 10762457B2 · Grant · 2020 [cited by applicant]
US 10783441B2 · Riabov · 2020 [cited by applicant]
US 10878505B1 · Blair · 2020 [cited by examiner]
US 20180296281A1 · Yeung · 2018 [cited by examiner]
US 20180314935A1 · Lewis · 2018 [cited by examiner]
US 20190108912A1 · Spurlock, III · 2019 [cited by examiner]
US 20190184561A1 · Yip · 2019 [cited by applicant]
US 20200074315A1 · Katz · 2020 [cited by applicant]
US 20200097920A1 · Doctor · 2020 [cited by applicant]
US 20200103523A1 · Liu · 2020 [cited by examiner]
US 20200122039A1 · Meuleau · 2020 [cited by applicant]
US 20200183653A1 · Subbiah · 2020 [cited by applicant]
US 20200226464A1 · Warren · 2020 [cited by applicant]
US 20210104294A1 · Hacohen · 2021 [cited by examiner]
US 20210216879A1 · Katz · 2021 [cited by applicant]
US 20230146390A1 · Sadaka · 2023 [cited by examiner]
CN 113642082A · 2021 [cited by examiner]
WO WO2018175585A2 · 2018 [cited by examiner]
Baier, et al., “A Heuristic Search Approach to Planning With Temporally Extended Preferences”, Artificial Intelligence 173 (2009), Nov. 28, 2008, 26 pgs., http://dx.doi.org/10.1016/j.artint.2008.11.011. [cited by applicant]
Cenamor, et al., The IBaCoP Planning System: Instance-Based Configured Portfolios, Journal of Artificial Intelligence Research 56 (2016) 657-691, Submitted on Jan. 2016, Published on Aug. 2016, 35 pgs., <https://doi.org… [cited by applicant]
Gehring, et al., “Reinforcement Learning for Classical Planning: Viewing Heuristics as Dense Reward Generators”, arXiv:2109.14830v1 [cs.AI] Sep. 30, 2021, 15 pgs., <https://arxiv.org/abs/2109.14830>. [cited by applicant]
Helmert, M., “The Fast Downward Planning System”, Journal of Artificial Intelligence Research 26 (2006), Jul. 2006, 56 pgs. [cited by applicant]
Katz, et al., “Delfi: Online Planner Selection for Cost-Optimal Planning”, 2018, 12 pgs. [cited by applicant]
Rivlin, et al., “Generalized Planning With Deep Reinforcement Learning”, arXiv: 2005.02305v1 [cs.AI], May 5, 2020, 13 pgs. [cited by applicant]
Scala, et al., “Subgoaling Techniques for Satisficing and Optimal Numeric Planning”, Journal of Artificial Intelligence Research, 68, 691-752, Aug. 2020, 62 pgs. [cited by applicant]
Shleyfman, et al., “Heuristics and Symmetries in Classical Planning”, Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015, 7 pgs. [cited by applicant]
Sievers, et al., “Deep Learning for Cost-Optimal Planning: Task-Dependent Planner Selection”, The Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-19), vol. 33 No. 01: AAAI-19, IAAI-19, EAAI-20, Jul. 17, 20… [cited by applicant]
Sievers, et al., “Structural Symmetries of the Lifted Representation of Classical Planning Tasks”, 2017, 8 pgs. [cited by applicant]
Speck, et al., “Learning Heuristic Selection With Dynamic Algorithm Configuration”, arXiv: 2006.08246v1 [cs.AI], Jun. 15, 2020, 10 pgs. [cited by applicant]
Speck, et al., “Learning Heuristic Selection With Dynamic Algorithm Configuration”, Proceedings of the Thirty-First International Conference on Automated Planning and Scheduling (ICAPS2021), May 17, 2021, 9 pgs. [cited by applicant]
Torralba, A., et al., “Completeness-Preserving Dominance Techniques for Satisficing Planning”, Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI-18), 2018, 8 pgs. [cited by applicant]