IP Library Granted Patent US 12,227,175
Granted Patent B2
US 12,227,175 · App. 18/451,812 · Granted Feb 18, 2025

Autonomous vehicle maneuvering based upon risk associated with occluded regions

Inventors: Shiva Ghose (Berkeley, CA); Daniel Chen (San Francisco, CA); Ted Nitz (Hayward, CA); Christophe Philippona (San Francisco, CA); Curt Harrington (San Francisco, CA); Christopher Daily-Diamond (Oakland, CA); Mason Swofford (Fishers, IN); Ryan Holben (San Francisco, CA); Eric Lujan (San Francisco, CA); Benjamin Greer (San Francisco, CA); Francesco Capodieci (Daly City, CA)
Assignee: GM Cruise Holdings LLC
B60W30/09B60W30/0956G05D1/0088G05D1/0214G08G1/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,227,175
App. No.
18/451,812
Granted
Feb 18, 2025
Kind
B2
Abstract

An autonomous vehicle (AV) is described herein. The AV is configured to identify an occluded region where a portion of a field of view of a sensor is occluded by an object. The AV is further configured to hypothesize that an object exists in the occluded region and is moving in the occluded region. The AV is still further configured to perform a driving maneuver based upon the hypothesized object existing in the occluded region.

Claims (51)

1. An autonomous vehicle (AV) comprising:

a computing system;

a sensor system that is in communication with the computing system; and

a mechanical system that is operably coupled to the computing system, where the computing system is programmed to perform acts comprising:

controlling the mechanical system of the AV in connection with the AV navigating a route from a beginning location to a destination location, where the route includes a turn at an intersection from a first roadway to a second roadway, where the turn is across a lane of oncoming traffic in the first roadway;

as the AV approaches the intersection, identifying an occluded region based upon output of the sensor system, where the occluded region is a spatial region where the AV lacks visibility, and further where the occluded region includes a portion of the lane of oncoming traffic in the first roadway;

hypothesizing that a vehicle is travelling in the lane of oncoming traffic in the occluded region towards the AV;

inferring that the vehicle will decelerate upon the AV becoming visible to a driver of the vehicle; and

based upon the inferring that the vehicle will decelerate upon the AV becoming visible to the driver of the vehicle, controlling the mechanical system of the AV in connection with completing the turn from the first roadway to the second roadway despite the occluded region including the portion of the lane of oncoming traffic.

2. The AV of claim 1 , the acts further comprising:

based upon inferring that the vehicle will decelerate upon the AV becoming visible to the driver of the vehicle, computing a time when the vehicle is expected to reach the intersection due to the vehicle decelerating, wherein the turn is completed based upon the computed time.

3. The AV of claim 2 , where computing the time when the vehicle is expected to reach the intersection comprises:

computing a position of the vehicle in the occluded region, where the AV is estimated to be observable to the vehicle at the position.

4. The AV of claim 3 , where computing the time when the vehicle is expected to reach the intersection further comprises:

assigning an initial velocity to the vehicle, where the initial velocity is a speed that the vehicle is travelling when the vehicle is located at the position.

5. The AV of claim 4 , where computing the time when the vehicle is expected to reach the intersection further comprises:

assigning a final velocity to the vehicle, the final velocity being a speed to which the hypothetical vehicle is expected to slow as the vehicle reaches the intersection.

6. The AV of claim 5 , where computing the time when the vehicle is expected to reach the intersection further comprises:

assigning a deceleration rate to the vehicle, where the vehicle is inferred to decelerate at the deceleration rate until the vehicle reaches the final velocity.

7. The AV of claim 1 , where the turn from the first roadway to the second roadway is a left turn across the lane of oncoming traffic.

8. The AV of claim 1 , where the turn from the first roadway to the second roadway is a right turn across the lane of oncoming traffic.

9. The AV of claim 1 , the acts further comprising:

prior to controlling the mechanical system in connection with completing the turn from the first roadway to the second roadway, computing an amount of time required for the AV to complete the turn, where the amount of time is computed based upon a profile for the AV, and further where the mechanical system is controlled in connection with completing the turn based upon the computed amount of time required for the AV to complete the turn.

10. A method performed by an autonomous vehicle (AV), the method comprising: navigating a route from a beginning location to a destination location, where the route includes a turn at an intersection from a first roadway to a second roadway, where the turn is across a lane of oncoming traffic in the first roadway;

obtaining a signal generated by a sensor system of the AV as the AV approaches the intersection;

identifying an occluded region based upon the signal generated by the sensor system, where the occluded region is a spatial region where the AV lacks visibility, and further where the occluded region includes a portion of the lane of oncoming traffic in the first roadway;

inferring that a vehicle is travelling in the lane of oncoming traffic in the occluded region towards the AV;

inferring that the vehicle will decelerate upon the AV becoming visible to a driver of the vehicle; and

based upon the inferring that the vehicle will decelerate upon the AV becoming visible to the driver of the vehicle, completing the turn from the first roadway to the second roadway despite the occluded region including the portion of the lane of oncoming traffic.

11. The method of claim 10 , further comprising:

based upon inferring that the vehicle will decelerate upon the AV becoming visible to the driver of the vehicle, computing a time when the vehicle is expected to reach the intersection due to the vehicle decelerating, wherein the turn is completed based upon the computed time.

12. The method of claim 11 , where computing the time when the vehicle is expected to reach the intersection comprises:

computing a position of the vehicle in the occluded region, where the AV is estimated to be observable to the vehicle at the position.

13. The method of claim 12 , where computing the time when the vehicle is expected to reach the intersection further comprises:

assigning an initial velocity to the vehicle, where the initial velocity is a speed that the vehicle is travelling when the vehicle is located at the position.

14. The method of claim 13 , where computing the time when the vehicle is expected to reach the intersection further comprises:

assigning a final velocity to the vehicle, the final velocity being a speed to which the hypothetical vehicle is expected to slow as the vehicle reaches the intersection.

15. The method of claim 14 , where computing the time when the vehicle is expected to reach the intersection further comprises:

assigning a deceleration rate to the vehicle, where the vehicle is inferred to decelerate at the deceleration rate until the vehicle reaches the final velocity.

16. The method of claim 10 , where the turn from the first roadway to the second roadway is a left turn across the lane of oncoming traffic.

17. The method of claim 10 , where the turn from the first roadway to the second roadway is a right turn across the lane of oncoming traffic.

18. The method of claim 10 , further comprising:

prior to completing the turn from the first roadway to the second roadway, computing an amount of time required for the AV to complete the turn, where the amount of time is computed based upon a profile for the AV, and further where the turn is completed based upon the computed amount of time required for the AV to complete the turn.

19. An autonomous vehicle (AV) comprising a computing system that includes a computer-readable storage medium, where the computer-readable storage medium includes instructions that, when executed by a processor, cause the processor to perform acts comprising: controlling a mechanical system of the AV to cause the AV to navigate a route from a beginning location to a destination location, where the route includes a turn at an intersection from a first roadway to a second roadway, where the turn is across a lane of oncoming traffic in the first roadway;

obtaining a signal generated by a sensor system of the AV as the AV approaches the intersection;

identifying an occluded region based upon the signal generated by the sensor system, where the occluded region is a spatial region where the AV lacks visibility, and further where the occluded region includes a portion of the lane of oncoming traffic in the first roadway;

inferring that a vehicle is travelling in the lane of oncoming traffic in the occluded region towards the AV;

inferring that the vehicle will decelerate upon the AV becoming visible to a driver of the vehicle; and

based upon the inferring that the vehicle will decelerate upon the AV becoming visible to the driver of the vehicle, controlling the mechanical system of the AV to cause the AV to complete the turn from the first roadway to the second roadway despite the occluded region including the portion of the lane of oncoming traffic.

20. The computer-readable storage medium of claim 19 , the acts further comprising:

based upon inferring that the vehicle will decelerate upon the AV becoming visible to the driver of the vehicle, computing a time when the vehicle is expected to reach the intersection due to the vehicle decelerating, wherein the mechanical system is controlled to cause the AV to complete the turn based upon the computed time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2023
From: GHOSE, SHIVA; CHEN, DANIEL; NITZ, TED; PHILIPPONA, CHRISTOPHE; HARRINGTON, CURT; DAILY-DIAMOND, CHRISTOPHER; SWOFFORD, MASON; HOLBEN, RYAN; LUJAN, ERIC; GREER, BENJAMIN; CAPODIECI, FRANCESCO
To: GM CRUISE HOLDINGS LLC
Reel/Frame 064696/0291 →
Continuity (6)
Continuation 17850994 · Jun 27, 2022
Continuation 16371088 · Mar 31, 2019
Continuation 16371012 · Mar 31, 2019
Continuation 16371083 · Mar 31, 2019
Continuation 16371012 · Mar 31, 2019
Related Publication 20230391323A1 · Dec 7, 2023
References Cited (69)
US RE41737E · Leem · 2010 [cited by applicant]
US 9254846B2 · Dolgov · 2016 [cited by examiner]
US 9381916B1 · Zhu · 2016 [cited by examiner]
US 9493157B2 · Prokhorov · 2016 [cited by examiner]
US 9811091B2 · Dolgov · 2017 [cited by examiner]
US 9947228B1 · Kim · 2018 [cited by examiner]
US 10146223B1 · Luders · 2018 [cited by examiner]
US 11002859B1 · Zhang · 2021 [cited by examiner]
US 11400924B2 · Ghose et al. · 2022 [cited by applicant]
US 11420621B2 · Ghose et al. · 2022 [cited by applicant]
US 11433883B2 · Ghose · 2022 [cited by examiner]
US 11572071B2 · Cieslar · 2023 [cited by applicant]
US 11625045B2 · Becker · 2023 [cited by applicant]
US 11643115B2 · Torres et al. · 2023 [cited by applicant]
US 11767011B2 · Ghose et al. · 2023 [cited by applicant]
US 20110313665A1 · Lueke et al. · 2011 [cited by applicant]
US 20140088855A1 · Ferguson · 2014 [cited by applicant]
US 20150066329A1 · Mielenz · 2015 [cited by applicant]
US 20160327953A1 · Nilsson · 2016 [cited by examiner]
US 20170371338A1 · Kamata · 2017 [cited by examiner]
US 20180259968A1 · Frazzoli · 2018 [cited by examiner]
US 20190250626A1 · Ghafarianzadeh · 2019 [cited by examiner]
US 20190384302A1 · Silva · 2019 [cited by examiner]
US 20200278681A1 · Gier · 2020 [cited by examiner]
US 20200307566A1 · Ghose et al. · 2020 [cited by applicant]
US 20200307567A1 · Ghose et al. · 2020 [cited by applicant]
US 20200310425A1 · Ghose et al. · 2020 [cited by applicant]
US 20220324439A1 · Ghose et al. · 2022 [cited by applicant]
CN 106114503A · 2016 [cited by applicant]
CN 106706341A · 2017 [cited by applicant]
CN 107444406A · 2017 [cited by applicant]
CN 113905940A · 2022 [cited by applicant]
CN 113905940B · 2023 [cited by applicant]
DE 102015205930A1 · 2016 [cited by applicant]
EP 3091370A1 · 2016 [cited by applicant]
EP 3934955A1 · 2022 [cited by applicant]
WO 2020205022A1 · 2020 [cited by applicant]
“International Search Report for PCT Patent Application No. PCT/US2019/068683”, Mailed Date: Mar. 23, 2020, 6 Pages. [cited by applicant]
“Written Opinion of the International Searching Authority for PCT Patent Application No. PCT/US2019/068683”, Mailed Date: Mar. 23, 2020, 8 Pages. [cited by applicant]
“Non-Final Office Action for U.S. Appl. No. 16/371,012”, Mailed Date: Jan. 13, 2021, 36 Pages. [cited by applicant]
“Non-Final Office Action for U.S. Appl. No. 16/371,083”, Mailed Date: Mar. 19, 2021, 51 Pages. [cited by applicant]
“Non-Final Office Action for U.S. Appl. No. 16/371,012”, Mailed Date: Jul. 23, 2021, 14 Pages. [cited by applicant]
“Final Office Action for U.S. Appl. No. 16/371,012”, Mailed Date: Dec. 24, 2021, 13 pages. [cited by applicant]
“Response to the Final Office Action for U.S. Appl. No. 16/371,012”, Filed Date: Feb. 22, 2022, 9 pages. [cited by applicant]
“Communication Pursuant to Rules 161(1) and 162 EPC for European Patent Application No. 19842769.2”, Mailed Date: Oct. 22, 2021, 3 pages. [cited by applicant]
“Corrected Notice of Allowability for U.S. Appl. No. 16/371,088”, Mailed Date: Jun. 2, 2022, 2 pages. [cited by applicant]
“Final Office Action for U.S. Appl. No. 16/371,083”, Mailed Date: Dec. 2, 2021, 24 pages. [cited by applicant]
“Final Office Action for U.S. Appl. No. 16/371,088”, Mailed Date: Nov. 29, 2021, 18 pages. [cited by applicant]
“International Preliminary Report on Patentability for PCT Patent Application No. PCT/US2019/068683”, Mailed Date: Sep. 28, 2021, 9 pages. [cited by applicant]
“Notice of Allowance for Chinese Patent Application No. 201980096961.8”, Mailed Date: Nov. 2, 2022, 4 pages. [cited by applicant]
“Notice of Allowance and Fees Due for U.S. Appl. No. 16/371,012”, Mailed Date: Apr. 15, 2022, 8 pages. [cited by applicant]
“Notice of Allowance and Fees Due for U.S. Appl. No. 16/371,083”, Mailed Date: Mar. 29, 2022, 10 pages. [cited by applicant]
“Notice of Allowance and Fees Due for U.S. Appl. No. 16/371,088”, Mailed Date: Apr. 28, 2022, 8 pages. [cited by applicant]
“Non-Final Office Action for U.S. Appl. No. 16/371,088”, Mailed Date: Mar. 23, 2021, 16 pages. [cited by applicant]
“Notification of Examination Decision on PPH Request for Chinese Patent Application No. 201980096961.8”, Mailed Date: Jul. 29, 2022, 2 pages. [cited by applicant]
“Office Action for Chinese Patent Application No. 201980096961.8”, Mailed Date: Aug. 23, 2022, 24 pages. [cited by applicant]
“Reply to Non-Final Office Action for U.S. Appl. No. 16/371,083”, Filed Date: Aug. 19, 2021, 15 pages. [cited by applicant]
“Reply to Non-Final Office Action for U.S. Appl. No. 16/371,088”, Filed Date: Aug. 23, 2021, 14 pages. [cited by applicant]
“Request for PPH Examination for Chinese Patent Application No. 201980096961.8”, Filed Date: Jun. 7, 2022, 33 pages. [cited by applicant]
“Response to the European Office Action for European Patent Application No. 19842769.2”, Filed Date: Apr. 28, 2022, 36 pages. [cited by applicant]
“Response to the Final Office Action for U.S. Appl. No. 16/371,083”, Filed Date: Feb. 22, 2022, 13 pages. [cited by applicant]
“Response to the Final Office Action for U.S. Appl. No. 16/371,088”, Filed Date: Feb. 22, 2022, 11 pages. [cited by applicant]
“Response to the Office Action for Chinese Patent Application No. 201980096961.8”, Filed Date: Oct. 14, 2022, 29 pages. [cited by applicant]
“Response to the Office Action for U.S. Appl. No. 16/371,012”, Filed Date: Apr. 13, 2021, 14 pages. [cited by applicant]
“Response to the Office Action for U.S. Appl. No. 16/371,012”, Filed Date: Nov. 23, 2021, 12 pages. [cited by applicant]
“Notice of Allowance and Fees Due for U.S. Appl. No. 17/850,994”, Mailed Date: Jun. 7, 2023, 8 pages. [cited by applicant]
“Office Action for U.S. Appl. No. 17/850,994”, Mailed Date: Dec. 22, 2022, 15 pages. [cited by applicant]
“Response to the Office Action for U.S. Appl. No. 17/850,994”, Filed Date: Mar. 22, 2023, 9 pages. [cited by applicant]
“Communication Under Rule 71(3) EPC for European Patent Application No. 19842769.2”, Mailed Date: Jan. 30, 2024, 55 pages. [cited by applicant]
Cited By (1)
US 12,585,276