IP Library Granted Patent US 12,487,597
Granted Patent B2
US 12,487,597 · App. 18/181,350 · Granted Dec 2, 2025

System and method for autonomous decision making, corrective action, and navigation in a dynamically changing world

Inventors: John J. O'Brien (Farmington, AR); Donald R. High (Noel, MO); Brian Mchale (Oldham, GB); David Winkle (Bentonville, AR)
Assignee: Walmart Apollo, LLc
G05D1/0088B64C23/00G05D1/0202G05D1/101G08G5/21G08G5/25G08G5/26G08G5/53G08G5/55G08G5/57G08G5/723G08G5/76B64U2101/64B64U2201/10G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,487,597
App. No.
18/181,350
Granted
Dec 2, 2025
Kind
B2
Abstract

An autonomous vehicle system includes a body and a plurality of sensors coupled to the body and configured to generate a plurality of sensor measurements corresponding to the plurality of sensors. The system also includes a control unit configured to: receive inputs from a plurality of sources wherein the plurality sources comprise the plurality of sensors, the inputs comprise the plurality of sensor measurements; determine a confidence level of each input based on other inputs; prioritize, based on the confidence level associated with each input, the inputs; generate, based on the prioritization of the inputs and the confidence level, a combined input with a combined confidence level; and determine, based on the combined input and the combined confidence level, a mission task to be performed.

Claims (72)

1 . An autonomous vehicle system for controlling an autonomous vehicle, comprising:

a plurality of sensors configured to generate a plurality of sensor measurements corresponding to the plurality of sensors; and

a control unit configured to:

receive inputs from the plurality of sensors, wherein the inputs comprise the plurality of sensor measurements;

receive logical information indicating situations in which the plurality of sensors are operating;

determine a mission requirement associated with a mission task to be performed by the autonomous vehicle;

for each respective sensor of the plurality of sensors,

determine, based on the logical information, a risk level associated with a situation in which the respective sensor is operating,

determine, based on the logical information, a precision level associated with the respective sensor,

determine, based on the logical information, an operational condition associated with the situation in which the respective sensor is operating,

select one of the risk level, the precision level or the operational condition as a ranking criterion for the plurality of sensors based on the mission requirement, and

generate a confidence level of each input received from the respective sensor based on the ranking criterion;

prioritize, based on the confidence level associated with each input, the inputs;

generate, based on the prioritization of the inputs and respective confidence levels, a combined input; and

control the autonomous vehicle to perform the mission task based on the combined input and the situations.

2 . The system of claim 1 , wherein the autonomous vehicle is an automatic guided vehicle or an unmanned aerial vehicle.

3 . The system of claim 1 , wherein the plurality of sensors include at least one of: a laser altimeter, a global positioning system (GPS), a light detection and ranging (LIDAR) system, a radio detecting and ranging (RADAR) system, a transponder, an optic sensor, or an automatic dependent surveillance broadcast (ADSB) sensor.

4 . The system of claim 1 , wherein the logical information is received from at least one of: a flight controller, a flight system, a real time kinematic (RTK) satellite navigation, unmanned traffic management (UTM), an air traffic controller (ATC), command and Control (C2), geofence, a weather monitor, aircraft capabilities and limitations, accelerometer, magnetometer, gyroscope, faulty equipment, waypoints and routes, delivery destinations, user inputs, Internet connectivity, satellite connectivity, invalidated communications, or communication with other autonomous vehicles.

5 . The system of claim 1 , wherein the inputs further comprise historical data stored in a database.

6 . The system of claim 1 , wherein the control unit is further configured to group, based on a measurement type, the inputs.

7 . The system of claim 1 , wherein the mission task to be performed comprises at least one of: forced landing of the autonomous vehicle, disabling one or more of the plurality of sensors, changing a route of the autonomous vehicle, beaconing an emergency status, or performing a desired flight maneuver of the autonomous vehicle.

8 . The system of claim 1 , wherein the control unit is further configured to:

identify a primary input received from a primary sensor of the plurality of sensors; and

replace, based on the situation in which the primary sensor is operating, the primary input with a secondary input received from another autonomous vehicle.

9 . The system of claim 8 , wherein:

the primary input is replaced with the secondary input based on confidence levels of the primary input and the secondary input.

10 . The system of claim 1 , wherein:

the control unit is further configured to validate each input by checking for a trusted certificate associated with the input; and

the trusted certificate is received from at least one of: a flight controller, a flight system, a laser altimeter, GPS, differential GPS, RTK, optic sensors, LIDAR, RADAR, ADSB sensors and transponders, unmanned traffic management (UTM), air traffic controller (ATC), command and control (C2), geofence, weather monitor, or aircraft capabilities and limitations.

11 . The system of claim 1 , wherein the confidence level comprises a binary code that includes a matrix of binary code entries.

12 . A method for controlling an autonomous vehicle, comprising:

receiving inputs from a plurality of sensors, wherein the inputs comprise a plurality of sensor measurements;

receiving logical information indicating situations in which the plurality of sensors are operating;

determining a mission requirement associated with a mission task to be performed by the autonomous vehicle;

for each respective sensor of the plurality of sensors,

determining, based on the logical information, a risk level associated with a situation in which the respective sensor is operating,

determining, based on the logical information, a precision level associated with the respective sensor,

determining, based on the logical information, an operational condition associated with the situation in which the respective sensor is operating,

selecting one of the risk level, the precision level or the operational condition as a ranking criterion for the plurality of sensors based on the mission requirement, and

generating a confidence level of each input received from the respective sensor based on the ranking criterion;

prioritizing, based on the confidence level associated with each input, the inputs;

generating, based on the prioritization of the inputs and respective confidence levels, a combined input; and

controlling the autonomous vehicle to perform the mission task based on the combined input and the situations.

13 . The method of claim 12 , wherein the mission task to be performed comprises at least one of: forced landing of the autonomous vehicle, disabling one or more of the plurality of sensors, changing a route of the autonomous vehicle, beaconing an emergency status, or performing a desired flight maneuver of the autonomous vehicle.

14 . The method of claim 12 , further comprising:

identifying a primary input received from a primary sensor of the plurality of sensors; and

replacing, based on the situation in which the primary sensor is operating, the primary input with a secondary input received from another autonomous vehicle.

15 . The method of claim 14 , wherein:

the primary input is replaced with the secondary input based on confidence levels of the primary input and the secondary input.

16 . The method of claim 12 , further comprising validating each input by checking for a trusted certificate associated with the input,

wherein the trusted certificate is received from at least one of: a flight controller, a flight system, a laser altimeter, GPS, differential GPS, RTK, optic sensors, LIDAR, RADAR, ADSB sensors and transponders, unmanned traffic management (UTM), air traffic controller (ATC), command and control (C2), geofence, weather monitor, or aircraft capabilities and limitations.

17 . An apparatus for controlling an autonomous vehicle, comprising:

a non-transitory memory having instructions stored thereon; and

a processor configured to read the instructions to:

receive inputs from a plurality of sensors, wherein the inputs comprise a plurality of sensor measurements;

receive logical information indicating situations in which the plurality of sensors are operating;

determine a mission requirement associated with a mission task to be performed by the autonomous vehicle;

for each respective sensor of the plurality of sensors,

determine, based on the logical information, a risk level associated with a situation in which the respective sensor is operating,

determine, based on the logical information, a precision level associated with the respective sensor,

determine, based on the logical information, an operational condition associated with the situation in which the respective sensor is operating,

select one of the risk level, the precision level or the operational condition as a ranking criterion for the plurality of sensors based on the mission requirement, and

generate a confidence level of each input received from the respective sensor based on the ranking criterion;

prioritize, based on the confidence level associated with each input, the inputs;

generate, based on the prioritization of the inputs and respective confidence levels, a combined input; and

control the autonomous vehicle to perform the mission task based on the combined input and the situations.

18 . The apparatus of claim 17 , wherein the mission task to be performed comprises at least one of: forced landing of the autonomous vehicle, disabling one or more of the plurality of sensors, changing a route of the autonomous vehicle, beaconing an emergency status, or performing a desired flight maneuver of the autonomous vehicle.

19 . The apparatus of claim 17 , wherein the processor is further configured to read the instructions to:

identify a primary input received from a primary sensor of the plurality of sensors; and

replace, based on the situation in which the primary sensor is operating, the primary input with a secondary input received from another autonomous vehicle.

20 . The apparatus of claim 19 , wherein:

the primary input is replaced with the secondary input based on confidence levels of the primary input and the secondary input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2023
From: O'BRIEN, JOHN J.; HIGH, DONALD R.; MCHALE, BRIAN; WINKLE, DAVID
To: WALMART APOLLO, LLC
Reel/Frame 062937/0933 →
Continuity (3)
Continuation 16259463 · Jan 28, 2019
Provisional Application 62624728 · Jan 31, 2018
Related Publication 20230213940A1 · Jul 6, 2023
References Cited (65)
US 8028216B1 · Yeo · 2011 [cited by examiner]
US 9201421B1 · Fairfield · 2015 [cited by examiner]
US 9218232B2 · Khalastchi et al. · 2015 [cited by applicant]
US 9224053B1 · Ferguson et al. · 2015 [cited by applicant]
US 9540121B2 · Byers et al. · 2017 [cited by applicant]
US 9720415B2 · Levinson et al. · 2017 [cited by applicant]
US 9728014B2 · Khalaschi et al. · 2017 [cited by applicant]
US 9805273B1 · Seeber et al. · 2017 [cited by applicant]
US 10048686B2 · Brekke · 2018 [cited by examiner]
US 10268191B1 · Lockwood · 2019 [cited by examiner]
US 10921167B1 · Sahar et al. · 2021 [cited by applicant]
US 20030186663A1 · Chen · 2003 [cited by examiner]
US 20100063672A1 · Anderson · 2010 [cited by examiner]
US 20110246551A1 · Giancaspro et al. · 2011 [cited by applicant]
US 20140330456A1 · Lopez Morales et al. · 2014 [cited by applicant]
US 20150112570A1 · Schmudderich · 2015 [cited by examiner]
US 20150225081A1 · Stabler et al. · 2015 [cited by applicant]
US 20150331422A1 · Hartung et al. · 2015 [cited by applicant]
US 20160101855A1 · Stefani · 2016 [cited by applicant]
US 20160117932A1 · Park et al. · 2016 [cited by applicant]
US 20160236638A1 · Lavie et al. · 2016 [cited by applicant]
US 20160260328A1 · Mishra et al. · 2016 [cited by applicant]
US 20160274578A1 · Arwine · 2016 [cited by applicant]
US 20160275801A1 · Kopardekar · 2016 [cited by applicant]
US 20160294829A1 · Angus · 2016 [cited by examiner]
US 20160299233A1 · Levien et al. · 2016 [cited by applicant]
US 20170045892A1 · Wang et al. · 2017 [cited by applicant]
US 20170090480A1 · Ho · 2017 [cited by examiner]
US 20170131716A1 · Brekke et al. · 2017 [cited by applicant]
US 20170166218A1 · Hoare · 2017 [cited by examiner]
US 20170269611A1 · Rangarajan · 2017 [cited by applicant]
US 20170285092A1 · Moore · 2017 [cited by applicant]
US 20170364095A1 · Wang et al. · 2017 [cited by applicant]
US 20180001890A1 · Ratcliffe · 2018 [cited by applicant]
US 20180012498A1 · Zhu et al. · 2018 [cited by applicant]
US 20180017973A1 · Teague · 2018 [cited by applicant]
US 20180029092A1 · Burrage · 2018 [cited by examiner]
US 20180032042A1 · Turpin · 2018 [cited by examiner]
US 20180072419A1 · Burgess et al. · 2018 [cited by applicant]
US 20180106885A1 · Blayvas · 2018 [cited by examiner]
US 20180127001A1 · Ricci · 2018 [cited by applicant]
US 20180239991A1 · Weller · 2018 [cited by examiner]
US 20180270244A1 · Kumar · 2018 [cited by examiner]
US 20180274927A1 · Epperlein · 2018 [cited by examiner]
US 20180348358A1 · Anderson · 2018 [cited by examiner]
US 20180348374A1 · Laddha · 2018 [cited by examiner]
US 20190041856A1 · Dippelein et al. · 2019 [cited by applicant]
US 20190047581A1 · Bai · 2019 [cited by examiner]
US 20190056726A1 · Weldemariam et al. · 2019 [cited by applicant]
US 20190073908A1 · Neubecker · 2019 [cited by examiner]
US 20190205887A1 · Kimmel · 2019 [cited by applicant]
US 20190206156A1 · Ponda · 2019 [cited by examiner]
US 20190214019A1 · White · 2019 [cited by examiner]
US 20190265705A1 · Zhang · 2019 [cited by examiner]
US 20190361460A1 · Medeiros · 2019 [cited by examiner]
US 20200109954A1 · Li · 2020 [cited by examiner]
US 20200236602A1 · Mahkonen et al. · 2020 [cited by applicant]
US 20200272110A1 · Pan et al. · 2020 [cited by applicant]
US 20210286651A1 · Ho · 2021 [cited by examiner]
US 20220105634A1 · Oboril · 2022 [cited by examiner]
US 20230176575A1 · Letwin · 2023 [cited by examiner]
CN 106597510A · 2017 [cited by applicant]
CN 106840093A · 2017 [cited by applicant]
WO 2019057302A1 · 2019 [cited by applicant]
International Search Report and Written Opinion dated Apr. 26, 2019, issued in corresponding PCT Application No. PCT/US2019/015422. [cited by applicant]