IP Library Granted Patent US 12,340,591
Granted Patent B2
US 12,340,591 · App. 18/455,489 · Granted Jun 24, 2025

Autonomous driving system, autonomous driving method, and autonomous driving program

Inventor: Hideaki Misawa (Kariya, JP)
Assignee: DENSO CORPORATION
G06V20/54B60W50/14B60W60/001G06V10/70B60W2050/146B60W2540/215B60W2556/10B60W2556/20B60W2556/45
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,591
App. No.
18/455,489
Granted
Jun 24, 2025
Kind
B2
Abstract

An autonomous driving system includes a recognition unit configured to recognize an obstacle based on image data obtained by imaging a predetermined region including a road on which an autonomous vehicle travels, the imaging being performed by an imaging device installed at a specific location in the external environment of the autonomous vehicle, a feature quantity distribution creation unit configured to create a feature quantity distribution expressing a distribution of features related to obstacles recognized in the past, and an erroneous recognition judgement unit configured to compare the created feature quantity distribution with a feature quantity of an obstacle recognized as an evaluation subject, to thereby judge whether the obstacle recognized as the evaluation subject is erroneously recognized.

Claims (21)

1. An autonomous driving system comprising:

a recognition unit configured to recognize obstacles based on image data obtained by imaging a predetermined region including a road on which an autonomous vehicle travels, the imaging being performed by an imaging device installed at a specific location in the external environment of the autonomous vehicle;

a creation unit configured to create a feature quantity distribution expressing a distribution of features quantities relating to obstacles that have been recognized by recognition unit in the past for each of the locations where the obstacles were recognized and for each of the types of the obstacles; and

a judgement unit configured to compare (i) a feature amount distribution corresponding to the location and type of an obstacle recognized as an evaluation target created by the creation unit with (ii) a feature quantity of the obstacle recognized as the evaluation subject, to thereby judge whether the obstacle recognized as the evaluation subject is erroneously recognized.

2. The autonomous driving system according to claim 1 , wherein

the creation unit is configured to create, as the feature quantity distribution, at least one of a dwell time distribution expressing a distribution of dwell times of obstacles, a travel speed distribution expressing a distribution of travel speeds of obstacles, and a travel distance distribution expressing a distribution of travel distances of obstacles, and

the judgement unit is configured to compare at least one of the dwell time distribution, the travel speed distribution, and the travel distance distribution respectively created by the creation unit, with at least one of a dwell time, a travel speed, and a travel distance of the obstacle recognized as the evaluation subject, to thereby judge whether the obstacle recognized as the evaluation subject is erroneously recognized.

3. The autonomous driving system according to claim 2 , wherein the judgement unit is configured to perform the comparison based on at least one of a representative value obtained from a statistical analysis of the dwell time distribution, a representative value obtained from a statistical analysis of the travel speed distribution, and a representative value obtained from a statistical analysis of the travel distance distribution.

4. The autonomous driving system according to claim 2 , wherein the judgement unit is configured to perform the comparison based on at least one of a threshold value obtained from the dwell time distribution, a threshold value obtained from the travel speed distribution, and a threshold value obtained from the travel distance distribution.

5. The autonomous driving system according to claim 4 , further comprising a notification unit configured to, in response to the judgement unit judging that an obstacle is erroneously recognized, transmit obstacle information to an autonomous vehicle traveling in the surroundings of the obstacle, the obstacle information having a flag attached for removing the recognition results for the obstacle.

6. The autonomous driving system according to claim 5 , further comprising a presentation unit configured to, in response to the judgement unit judging that an obstacle is erroneously recognized, present image data to an operator that corresponds to the time at which the judgement of erroneous recognition occurred, and receive, as input from the operator, an indication as to whether there is an anomaly, and

wherein the notification unit is configured to, in response to an input notifying an anomaly being received from the operator, send the obstacle information to an autonomous vehicle traveling in the surroundings of the obstacle, the obstacle information having a flag attached for removing the recognition results for the obstacle.

7. The autonomous driving system according to claim 1 , further comprising a learning unit configured to, in response to an obstacle being judged by the judgement unit to be erroneously recognized, perform learning of an obstacle recognition model, the learning being performed by using judgement results input by the operator as a label, and the judgement results including an indication of whether there is an anomaly and the causes thereof.

8. An autonomous driving method comprising:

recognizing obstacles based on image data obtained by imaging a predetermined region including a road on which an autonomous vehicle travels, the imaging being performed by an imaging device installed at a specific location in the external environment of the autonomous vehicle;

creating a feature quantity distribution expressing a distribution of feature quantities relating to obstacles that have been recognized in the past for each of the locations where the obstacles were recognized and for each of the types of the obstacles; and

comparing (i) the created feature amount distribution corresponding to the location and type of an obstacle recognized as an evaluation target with (ii) a feature quantity of the obstacle recognized as the evaluation subject, to thereby judge whether the obstacle recognized as the evaluation subject is erroneously recognized.

9. A non-transitory computer-readable storage medium for storing an autonomous driving program for causing a computer to execute a process, the process comprising:

recognizing obstacles based on image data obtained by imaging a predetermined region including a road on which an autonomous vehicle travels, the imaging being performed by an imaging device installed at a specific location in the external environment of the autonomous vehicle;

creating a feature quantity distribution expressing a distribution of features quantities relating to obstacles that have been recognized in the past for each of the locations where the obstacles were recognized and for each of the types of the obstacles; and

comparing (i) a feature amount distribution corresponding to the location and type of an obstacle recognized as an evaluation target created with (ii) a feature quantity of the obstacle recognized as the evaluation subject, to thereby judge whether the obstacle recognized as the evaluation subject is erroneously recognized.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2023
From: MISAWA, HIDEAKI
To: DENSO CORPORATION
Reel/Frame 064864/0847 →
Priority Claims (1)
JP 2021-029263 · Feb 25, 2021 · national
Continuity (2)
Continuation PCTJP2022006780 · Feb 18, 2022
Related Publication 20230401870A1 · Dec 14, 2023
References Cited (8)
US 20120161951A1 · Ito · 2012 [cited by examiner]
US 20190171896A1 · Okada · 2019 [cited by examiner]
US 20220207279A1 · Kuybeda · 2022 [cited by examiner]
JP 200330776A · 2003 [cited by applicant]
JP 200826985A · 2008 [cited by applicant]
JP 2016057677A · 2016 [cited by applicant]
JP 2019021201A · 2019 [cited by applicant]
JP 2019127329A · 2019 [cited by applicant]