IP Library Granted Patent US 12,195,039
Granted Patent B2
US 12,195,039 · App. 18/517,234 · Granted Jan 14, 2025

Information processing method, information processing system, and information processing device

Inventors: Motoshi Anabuki (Hyogo, JP); Yoshimasa Honda (Hyogo, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
B60W60/001B60W50/00G06V20/56H04L67/125B60W2050/0028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,195,039
App. No.
18/517,234
Granted
Jan 14, 2025
Kind
B2
Abstract

An information processing method is to be executed by a computer. The information processing method includes: receiving, from an autonomous moving body, a first processing result that is a result of first preprocessing of travel control processing in autonomous movement processing of the autonomous moving body, and sensing data received by the autonomous moving body; executing second preprocessing based on the sensing data to receive a second processing result, the second preprocessing being more advanced than the first preprocessing; determining a difference between the first processing result and the second processing result; and outputting, to the autonomous moving body based on the difference determined, a change request to change the first processing result to the third processing result, the third processing result being received based on at least one of the first processing result or the second processing result.

Claims (59)

1. An information processing method to be executed by an information processing device mounted on an autonomous moving body, the information processing method comprising:

executing first preprocessing based on sensing data received by the autonomous moving body, to receive a first processing result, the first preprocessing being preprocessing of travel control processing in autonomous driving of the autonomous moving body;

outputting the sensing data to an external device;

receiving, from the external device, a second processing result received by executing second preprocessing based on the sensing data, the second preprocessing being preprocessing that is more advanced than the first preprocessing and executed by the external device that is connected to the autonomous moving body via a network and has a processing power higher than a processing power of the information processing device;

restricting travel of the autonomous moving body when there is a communication delay between the autonomous moving body and the external device or there is a processing delay in the second preprocessing; and

performing travel control of the autonomous moving body based on the first processing result or a third processing result when there is no communication delay between the autonomous moving body and the external device or there is no processing delay in the second preprocessing, wherein

the third processing result is the second processing result or a processing result received by correcting the first processing result, and

the information processing method further comprises:

determining a difference between the first processing result and the second processing result when there is no communication delay between the autonomous moving body and the external device or there is no processing delay in the second preprocessing, and

changing the first processing result to the third processing result in accordance with the difference determined, and performing the travel control of the autonomous moving body based on the third processing result.

2. The information processing method according to claim 1 , wherein

when a change request to change the first processing result to the third processing result is received and the reception of the change request is delayed due to the communication delay, the change request received is ignored and the travel of the autonomous moving body is restricted.

3. The information processing method according to claim 1 , wherein

when the second processing result could not be received without any delay due to the communication delay, the travel of the autonomous moving body is restricted.

4. The information processing method according to claim 1 , wherein

when (i) the second processing result could not be received without any delay due to the communication delay or there is a processing delay in the second preprocessing, and (ii) the communication delay or the processing delay can be corrected, the travel control of the autonomous moving body is performed based on the first processing result or the third processing result.

5. The information processing method according to claim 1 , wherein

when (i) the second processing result could not be received without any delay due to the communication delay or there is a processing delay in the second preprocessing, and (ii) the communication delay or the processing delay cannot be corrected, the travel control of the autonomous moving body is performed based on the first processing result if a predetermined operational design domain (ODD) is satisfied and the travel control of the autonomous moving body is restricted unless the predetermined ODD is satisfied.

6. The information processing method according to claim 1 , wherein

when the difference satisfies a predetermined condition, the first processing result is changed to the third processing result and the travel control of the autonomous moving body is performed based on the third processing result.

7. The information processing method according to claim 6 , wherein

when the difference satisfies the predetermined condition: the first processing result is changed to the third processing result if a predetermined ODD is satisfied; and the travel of the autonomous moving body is restricted unless the predetermined ODD is satisfied.

8. The information processing method according to claim 1 , wherein

when the difference satisfies a predetermined condition, the travel of the autonomous moving body is restricted.

9. The information processing method according to claim 1 , wherein

when the difference satisfies a predetermined condition, an anomaly is notified.

10. The information processing method according to claim 1 , wherein

when a weather is not suitable for autonomous driving of the autonomous moving body, the difference is not determined, the first processing result is changed to the third processing result, and the travel control of the autonomous moving body is performed based on the third processing result.

11. The information processing method according to claim 1 , wherein

when the second processing result is received after a lapse of a predetermined time or more after the sensing data has been output, a difference between a part of the first processing result and a part of the second processing result is determined.

12. The information processing method according to claim 1 , further comprising:

outputting a request to execute the second preprocessing to the external device, based on at least one of a resource of the autonomous moving body, a moving condition of the autonomous moving body, an environment outside the autonomous moving body, a time, or a response time to an inquiry to the external device.

13. An information processing device mounted on an autonomous moving body, the information processing device that:

executes first preprocessing based on sensing data received by the autonomous moving body, to receive a first processing result, the first preprocessing being preprocessing of travel control processing in autonomous driving of the autonomous moving body;

outputs the sensing data to an external device;

receives, from the external device, a second processing result received by executing second preprocessing based on the sensing data, the second preprocessing being preprocessing that is more advanced than the first preprocessing and executed by the external device that is connected to the autonomous moving body via a network and has a processing power higher than a processing power of the information processing device;

restricts travel of the autonomous moving body when there is a communication delay between the autonomous moving body and the external device or there is a processing delay in the second preprocessing; and

performs travel control of the autonomous moving body based on the first processing result or a third processing result when there is no communication delay between the autonomous moving body and the external device or there is no processing delay in the second preprocessing, wherein

the third processing result is the second processing result or a processing result received by correcting the first processing result, and

the information processing device further:

determines a difference between the first processing result and the second processing result when there is no communication delay between the autonomous moving body and the external device or there is no processing delay in the second preprocessing, and

changes the first processing result to the third processing result in accordance with the difference determined, and performing the travel control of the autonomous moving body based on the third processing result.

14. An information processing method to be executed by an external device connected to an autonomous moving body via a network, the information processing method comprising:

receiving, from the autonomous moving body, a first processing result that is a result of first preprocessing and sensing data received by the autonomous moving body, the first preprocessing being preprocessing of travel control processing in autonomous movement processing of the autonomous moving body and executed based on the sensing data by an information processing device included in the autonomous moving body;

executing second preprocessing based on the sensing data to receive a second processing result, the second preprocessing being more advanced than the first preprocessing, the external device having a processing power higher than a processing power of the information processing device;

outputting, to the autonomous moving body, a travel restriction request to restrict travel of the autonomous moving body when there is a communication delay between the autonomous moving body and the external device or there is a processing delay in the second preprocessing;

outputting, to the autonomous moving body, a change request to change the first processing result to a third processing result when there is no communication delay between the autonomous moving body and the external device or there is no processing delay in the second preprocessing, wherein

the third processing result is the second processing result or a processing result received by correcting the first processing result, and

the information processing method further comprises:

determining a difference between the first processing result and the second processing result when there is no communication delay between the autonomous moving body and the external device or there is no processing delay in the second preprocessing; and

outputting the change request to the autonomous moving body in accordance with the difference determined.

15. The information processing method according to claim 14 , wherein

when (i) there is a communication delay between the autonomous moving body and the external device or there is a processing delay in the second preprocessing and (ii) the communication delay or the processing delay cannot be corrected: the change request is not output to the autonomous moving body if a predetermined operational design domain (ODD) is satisfied; and the travel restriction request is output to the autonomous moving body unless the predetermined ODD is satisfied.

16. The information processing method according to claim 14 , wherein

the change request is output to the autonomous moving body when the difference satisfies a predetermined condition.

17. The information processing method according to claim 16 , wherein

when the difference satisfies the predetermined condition, (i) the change request is output to the autonomous moving body if a predetermined ODD is satisfied, and (ii) the travel restriction request is output to the autonomous moving body unless the predetermined ODD is satisfied.

18. The information processing method according to claim 14 , wherein

when a request to execute the second preprocessing is received from a plurality of autonomous moving bodies each of which is the autonomous moving body, an autonomous moving body whose request is preferentially selected from among the plurality of autonomous moving bodies based on at least one of resources of the plurality of autonomous moving bodies, moving conditions of the plurality of autonomous moving bodies, environments outside the plurality of autonomous moving bodies, times, or response times to the requests.

Priority Claims (1)
JP 2020-023199 · Feb 14, 2020 · national
Continuity (3)
Continuation 17510957 · Oct 26, 2021
Continuation PCTJP2020048205 · Dec 23, 2020
Related Publication 20240092383A1 · Mar 21, 2024
References Cited (30)
US 10331128B1 · Hansel · 2019 [cited by applicant]
US 10919163B1 · Li · 2021 [cited by applicant]
US 11209887B1 · Jung · 2021 [cited by applicant]
US 20110125344A1 · An · 2011 [cited by examiner]
US 20130211988A1 · Dorn · 2013 [cited by applicant]
US 20180209802A1 · Jung · 2018 [cited by applicant]
US 20180314250A1 · Lewis · 2018 [cited by applicant]
US 20190271991A1 · Dulmage · 2019 [cited by examiner]
US 20190359202A1 · Zhu · 2019 [cited by examiner]
US 20190359221A1 · Ochida et al. · 2019 [cited by applicant]
US 20200204440A1 · Viswanathan · 2020 [cited by applicant]
US 20200204614A1 · Schmitz · 2020 [cited by applicant]
US 20200229206A1 · Badic · 2020 [cited by applicant]
US 20200349835A1 · Trim · 2020 [cited by applicant]
US 20220108248A1 · Oobayashi · 2022 [cited by applicant]
US 20220315045A1 · Urano · 2022 [cited by applicant]
US 20220318162A1 · Hornung · 2022 [cited by applicant]
US 20220332302A1 · Watanabe · 2022 [cited by applicant]
US 20220348232A1 · Vogt · 2022 [cited by applicant]
JP 200315741 · 2003 [cited by applicant]
JP 3881197 · 2007 [cited by applicant]
JP 201781425 · 2017 [cited by applicant]
JP 2018167648A · 2018 [cited by applicant]
JP 201916118 · 2019 [cited by applicant]
WO 2017057053 · 2017 [cited by applicant]
WO 2018154860 · 2018 [cited by applicant]
International Search Report (ISR) issued on Jan. 26, 2021 in International (PCT) Application No. PCT/JP2020/048205. [cited by applicant]
Extended European Search Report dated Jun. 19, 2023 in counterpart European Patent Application No. 20918381.3, 10 pages. [cited by applicant]
Oba Yoshihiro, Oct. 28, 2015, English Machine Translation_JP2017081425A provided by Patent Translate by EPO and Google (Year: 2015). [cited by applicant]
Kaino Akihiko, Sep. 30, 2015, English Machine Translation_WO2017057053A1 provided by Patent Translate by EPO and Google (Year: 2015). [cited by applicant]