EVOLVING COMPUTER-BASED REASONING SYSTEMS

1 . A non-transitory computer readable medium storing instructions which, when executed by one or more computing devices, cause the one or more computing devices to perform a process of:

receiving a first training context-action pair, wherein the first training context-action pair comprises first one or more context elements, first one or more action elements representing actions taken in a first training context represented by the first one or more context elements, and at least one first executable context element;

receiving a second training context-action pair, wherein the second training context-action pair comprises second one or more context elements, and second one or more action elements representing actions taken in a second training context represented by the one or more context elements;

evolving a candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair by:

evolving the first one or more context elements and the second one or more context elements to produce candidate one or more context elements;

evolving the first one or more action elements and the second one or more action elements to produce candidate one or more action elements;

creating the candidate context-action pair based on the candidate one or more context elements and the candidate one or more action elements;

testing whether a set of candidate context-action pairs meets exit criteria, wherein the set of candidate context-action pairs includes the candidate context-action pair;

in response to determining that the set of candidate context-action pairs meets the exit criteria, selecting the set of candidate context-action pairs as an evolved set of candidate context-action pairs.

2 . The non-transitory computer readable medium of claim 1 , wherein determining the candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair comprises mutating a portion of the candidate context-action pair.

3 . The non-transitory computer readable medium of claim 2 , wherein mutating the portion of the candidate context-action pair comprises replacing the portion of the candidate context-action pair with a function.

4 . The non-transitory computer readable medium of claim 3 , wherein the function is calculated based on a second portion of the candidate context-action pair different from said portion of the candidate context-action pair.

5 . The non-transitory computer readable medium of claim 1 , wherein the candidate context-action pair comprises at least one candidate executable context element and the process further comprises determining the at least one candidate executable context element of the candidate context-action pair based at least in part on the at least one first executable context element.

6 . The non-transitory computer readable medium of claim 1 , wherein the process further comprises receiving a third training context-action pair and wherein evolving the candidate context-action pair comprises evolving the candidate context-action pair based at least in part on the first training context-action pair, the second training context-action pair, and the third training context-action pair.

7 . The non-transitory computer readable medium of claim 1 , wherein determining the candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair comprises selecting randomly between the first training context-action pair and the second training context-action pair.

8 . The non-transitory computer readable medium of claim 1 , wherein determining the candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair comprises performing a resampling based at least in part on a context element of the first training context-action pair and a context element of the second training context-action pair.

9 . The non-transitory computer readable medium of claim 1 , wherein determining the candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair comprises comparing modifiers associated with on the first training context-action pair and the second training context-action pair.

10 . The non-transitory computer readable medium of claim 1 , wherein testing whether the set of candidate context-action pairs meets the exit criteria comprises determining a fitness score for the set of candidate context-action pairs.

11 . The non-transitory computer readable medium of claim 1 , wherein when the exit criteria are not met, the set of candidate context-action pairs is used as a training set, and is further evolved.

12 . The non-transitory computer readable medium of claim 1 , wherein the first training context-action pair and the second training context-action pair are part of one or more sets of training context-action pairs, and the process performed by the one or more computing devices further comprises:

comparing two or more training context-action pairs in the one or more sets of training context-action pairs; and

selecting the first training context-action pair and the second training context-action pair based at least in part on the comparison of the two or more training context-action pairs in the one or more sets of training context-action pairs.

13 . A method comprising:

receiving a first training context-action pair, wherein the first training context-action pair comprises first one or more context elements, first one or more action elements representing actions taken in a first training context represented by the first one or more context elements, and at least one first executable context element;

receiving a second training context-action pair, wherein the second training context-action pair comprises second one or more context elements, and second one or more action elements representing actions taken in a second training context represented by the one or more context elements;

evolving a candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair by:

evolving the first one or more context elements and the second one or more context elements to produce candidate one or more context elements;

evolving the first one or more action elements and the second one or more action elements to produce candidate one or more action elements;

creating the candidate context-action pair based on the candidate one or more context elements and the candidate one or more action elements;

testing whether a set of candidate context-action pairs meets exit criteria, wherein the set of candidate context-action pairs includes the candidate context-action pair; and

in response to determining that the set of candidate context-action pairs meets the exit criteria, selecting the set of candidate context-action pairs as an evolved set of candidate-action pairs,

wherein the method is performed by one or more computing devices.

14 . The method of claim 13 , wherein determining the candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair comprises mutating a portion of the candidate context-action pair.

15 . The method of claim 14 , wherein mutating the portion of the candidate context-action pair comprises replacing the portion of the candidate context-action pair with a function.

16 . The method of claim 15 , wherein the function is calculated based on a second portion of the candidate context-action pair different from said portion of the candidate context-action pair.

17 . The method of claim 13 , wherein the second training context-action pair comprises at least one second executable context element.

18 . The method of claim 17 , wherein an executable element of the candidate context-action pair is determined based at least in part on the at least one second executable context element.

19 . A system for performing a machine-executed operation involving instructions, wherein said instructions are instructions which, when executed by one or more computing devices, cause performance of a process including:

receiving a first training context-action pair, wherein the first training context-action pair comprises first one or more context elements, first one or more action elements representing actions taken in a first training context represented by the first one or more context elements, and at least one first executable context element;

receiving a second training context-action pair, wherein the second training context-action pair comprises second one or more context elements, and second one or more action elements representing actions taken in a second training context represented by the one or more context elements;

evolving a candidate context-action pair based at least in part on the first training context-action pair and the second training context-action pair by:

evolving the first one or more context elements and the second one or more context elements to produce candidate one or more context elements;

evolving the first one or more action elements and the second one or more action elements to produce candidate one or more action elements;

creating the candidate context-action pair based on the candidate one or more context elements and the candidate one or more action elements;

testing whether a set of candidate context-action pairs meets exit criteria, wherein the set of candidate context-action pairs includes the candidate context-action pair; and

in response to determining that the set of candidate context-action pairs meets the exit criteria, selecting the set of candidate context-action pairs as an evolved set of candidate-action pairs.

20 . The system of claim 19 , wherein when the exit criteria are not met, the set of candidate context-action pairs is used as a training set, and is further evolved.

21 . The non-transitory computer readable medium of claim 1 , wherein the process further comprises:

receiving an input context for a controlled system;

determining one or more suggested context-action pairs from among the evolved set of candidate context-action pairs by comparing the set of candidate context-action pairs to the input context;

causing control of the controlled system based on the one or more suggested context-action pairs.

22 . The method of claim 13 , further comprising:

receiving an input context for a controlled system;

determining one or more suggested context-action pairs from among the evolved set of candidate context-action pairs by comparing the set of candidate context-action pairs to the input context;

causing control of the controlled system based on the one or more suggested context-action pairs.

23 . The system of claim 19 , wherein the process further comprises:

receiving an input context for a controlled system;

determining one or more suggested context-action pairs from among the evolved set of candidate context-action pairs by comparing the set of candidate context-action pairs to the input context;

causing control of the controlled system based on the one or more suggested context-action pairs.