IP Library Granted Patent US 11,714,413
Granted Patent B2
US 11,714,413 · App. 17/114,393 · Granted Aug 1, 2023

Planning autonomous motion

Inventors: Andrea Censi (Somerville, MA); Emilio Frazzoli (Newton, MA); Hsun-Hsien Chang (Brookline, MA); Kostyantyn Slutskyy (Singapore, SG); Scott D. Pendleton (Singapore, SG)
Assignee: Motional AD LLC
G05D1/0088B60W40/10G05D1/0005G05D1/0212G05D1/0214G05D1/0221G05D1/0255G05D1/0257G05D1/0268G06N5/04G06N20/00B60W2710/18B60W2710/20G01C21/34G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,714,413
App. No.
17/114,393
Granted
Aug 1, 2023
Kind
B2
Abstract

Among other things, planning a motion of a machine having moving capabilities is based on strategic guidelines derived from various basic principles, such as laws, ethics, preferences, driving experiences, and road environments.

Claims (74)

1. An apparatus comprising:

a storage for instructions;

a network interface in communication with a machine having one or more autonomous motion capabilities; and

a processor to operate according to the instructions stored in the storage to analyze data associated with basic principles applicable to one or more motion actions of the machine to generate logical expressions to plan motion actions for the machine, wherein generating the logical expressions comprise:

determining one or more conditions associated with an environment of the machine;

identifying candidate trajectories for the machine to traverse through the environment based on the one or more conditions;

evaluating individual costs of each of a plurality of the candidate trajectories for the machine using the basic principles;

selecting a candidate trajectory of the plurality of the candidate trajectories based on evaluating the individual costs; and

planning the motion actions for the machine in accordance with a sequence of motion actions of the selected candidate trajectory.

2. The apparatus of claim 1 , in which a basic principle comprises a law, a regulation, a principle of ethics, a motion environment, an operation experience, a previously inferred logical expression, or a preference, or a combination of two or more of them.

3. The apparatus of claim 1 , in which analyzing the data comprises tracking one or more objects in sensor data and inferring a logical relation between two objects, or between two events, or between two times, or combinations of them.

4. The apparatus of claim 1 , in which a logical expression corresponds to at least one condition of the one or more conditions and at least one motion action of the machine, wherein generating logical expressions associated with the basic principles comprises classifying the logical expressions into priority groups.

5. The apparatus of claim 4 , in which generating logical expressions associated with the basic principles comprises organizing the priority groups into a hierarchy, the hierarchy comprising information about prioritization between at least two priority groups.

6. The apparatus of claim 1 , in which a logical expression corresponds to at least one condition of the one or more conditions and at least one motion action of the machine, wherein generating logical expressions associated with the basic principles comprises organizing the logical expressions into a hierarchy, the hierarchy comprising information about prioritization between at least two logical expressions.

7. The apparatus of claim 1 , in which evaluating individual costs of each of the plurality of the candidate trajectories using the basic principles comprises:

identifying one or more factors associated with the logical expressions; and

comparing motion actions corresponding to each of the plurality of the candidate trajectories with the one or more factors.

8. The apparatus of claim 7 , in which identifying the one or more factors associated with the logical expressions comprises at least one of

determining values of the one or more factors,

identifying missing factors using a linking process,

linking two logical expressions based on a common factor,

linking two logical expressions based on a common condition of the one or more conditions, or

linking two logical expressions based on a common motion action.

9. The apparatus of claim 7 , in which comparing the motion actions corresponding to each of the plurality of the candidate trajectories with the one or more factors comprises:

for each candidate trajectory of the plurality of the candidate trajectories:

determining deviations of one or more motions action in a sequence of motion actions corresponding to the candidate trajectory from the one or more factors associated with the logical expressions;

computing a numerical score corresponding to the determined deviations; and

evaluating the individual cost of the candidate trajectory using the numerical score.

10. The apparatus of claim 9 , in which the numerical score is computed based on one or more deviation metrics, the one or more deviation metrics comprising at least one of an energy consumption by the machine, a financial loss by the machine, a time wastage, or a combination of energy consumption, financial cost and time wastage.

11. The apparatus of claim 1 , in which generating logical expressions associated with the basic principles comprises:

statistically evaluating occurrences of the one or more conditions, proper motion actions of the machine to move through the environment, and deviations from the proper motion actions based on the one or more conditions; and

adjusting one or more logical expressions based on evaluating the occurrences.

12. The apparatus of claim 1 , in which in the logical expressions are classified into priority groups, and wherein evaluating individual costs of each of the plurality of the candidate trajectories comprises using a cost function that includes an indicator indicating whether one or more motion actions corresponding to a candidate trajectory satisfies a particular logical expression or all logical expressions in a priority group.

13. The apparatus of claim 1 , in which the logical expressions are derived using at least one of:

natural language analysis that parses and analyzes one or more texts describing at least one of traffic laws in the environment, one or more characteristics of the environment, or one or more past motion actions of the machine in the environment, or

inferring the one or more conditions associated with the environment and one or more preferred motion actions of the machine in response to the one or more conditions.

14. A method comprising:

analyzing, by at least one processor, data associated with basic principles applicable to one or more motion actions of a vehicle;

determining, by the at least one processor, one or more conditions associated with an environment of the vehicle;

identifying, by the at least one processor, candidate trajectories for the vehicle to traverse through the environment based on the one or more conditions;

evaluating, by the at least one processor, individual costs of each of a plurality of the candidate trajectories for the vehicle using the basic principles;

selecting, by the at least one processor, a candidate trajectory of the plurality of the candidate trajectories based on evaluating the individual costs; and

planning, by the at least one processor, motion actions for the vehicle to traverse through the environment in accordance with a sequence of motion actions of the selected candidate trajectory.

15. The method of claim 14 , in which a basic principle comprises a law, a regulation, a principle of ethics, a motion environment, an operation experience, a previously inferred logical expression, or a preference, or a combination of two or more of them, and

in which analyzing the data associated with basic principles comprises tracking one or more objects in sensor data obtained corresponding to the vehicle, and inferring a logical relation between two objects, or between two events, or between two times, or combinations of them.

16. The method of claim 14 , in which planning motion actions for the vehicle comprises generating logical expressions corresponding to the planned motion actions for the vehicle,

wherein a logical expression corresponds to at least one condition of the one or more conditions and at least one motion action of the vehicle, and

wherein generating the logical expressions comprises classifying the logical expressions into priority groups.

17. The method of claim 16 , in which comprises classifying the logical expressions into priority groups comprises organizing the priority groups into a hierarchy, the hierarchy comprising information about prioritization between at least two priority groups.

18. The method of claim 14 , in which evaluating individual costs of each of the plurality of the candidate trajectories using the basic principles comprises:

identifying one or more factors associated with the basic principles; and

comparing motion actions corresponding to each of the plurality of the candidate trajectories with the one or more factors.

19. The method of claim 18 , in which identifying the one or more factors associated with the basic principles comprises at least one of

determining values of the one or more factors,

identifying missing factors using a linking process,

linking two logical expressions based on a common factor,

linking two logical expressions based on a common condition of the one or more conditions, or

linking two logical expressions based on a common motion action.

20. The method of claim 18 , in which comparing the motion actions corresponding to each of the plurality of the candidate trajectories with the one or more factors comprises:

for each candidate trajectory of the plurality of the candidate trajectories:

determining deviations of one or more motions action in a sequence of motion actions corresponding to the candidate trajectory from the one or more factors associated with the basic principles;

computing a numerical score corresponding to the determined deviations; and

evaluating the individual cost of the candidate trajectory using the numerical score.

21. The method of claim 20 , in which the numerical score is computed based on one or more deviation metrics, the one or more deviation metrics comprising at least one of an energy consumption by the vehicle, a financial loss by the vehicle, a time wastage, or a combination of energy consumption, financial cost and time wastage.

22. The method of claim 14 , in which planning motion actions for the vehicle comprises generating logical expressions corresponding to the planned motion actions for the vehicle, wherein a logical expression corresponds to at least one condition of the one or more conditions and at least one motion action of the vehicle, the method further comprising:

classifying the logical expressions into priority groups,

wherein evaluating individual costs of each of the plurality of the candidate trajectories comprises using a cost function that includes an indicator indicating whether one or more motion actions corresponding to a candidate trajectory satisfies a particular logical expression or all logical expressions in a priority group.

23. The method of claim 14 , in which planning motion actions for the vehicle comprises generating logical expressions corresponding to the planned motion actions for the vehicle, wherein a logical expression corresponds to at least one condition of the one or more conditions and at least one motion action of the vehicle, the method further comprising:

deriving the logical expressions using at least one of:

natural language analysis that parses and analyzes one or more texts describing at least one of traffic laws in the environment, one or more characteristics of the environment, or one or more past motion actions of the vehicle in the environment, or

inferring the one or more conditions associated with the environment and one or more preferred motion actions of the vehicle in response to the one or more conditions.

24. The method of claim 14 , in which identifying candidate trajectories for the vehicle comprises:

statistically evaluating occurrences of the one or more conditions, proper motion actions of the vehicle to move through the environment, and deviations from the proper motion actions based on the one or more conditions; and

adjusting one or more candidate trajectories based on evaluating the occurrences.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2021
From: CENSI, ANDREA; FRAZZOLI, EMILIO; CHANG, HSUN-HSIEN; SLUTSKYY, KOSTYANTYN; PENDLETON, SCOTT D.
To: NUTONOMY INC.
Reel/Frame 058056/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2021
From: MOTIONAL AD INC.
To: MOTIONAL AD LLC
Reel/Frame 058056/0839 →
CHANGE OF NAME Recorded Nov 9, 2021
From: NUTONOMY INC.
To: MOTIONAL AD INC.
Reel/Frame 058057/0889 →
Continuity (3)
Continuation 15872614 · Jan 16, 2018
Provisional Application 62555685 · Sep 8, 2017
Related Publication 20210356962A1 · Nov 18, 2021
Cited By (1)
US 12,276,983