IP Library › Granted Patent US 12,230,140
Granted Patent B2
US 12,230,140 · App. 18/490,520 · Granted Feb 18, 2025

Actively modifying a field of view of an autonomous vehicle in view of constraints

Inventors: David I. Ferguson (San Francisco, CA); Jiajun Zhu (Sunnyvale, CA)
Assignee: Waymo LLC
G08G1/167G05D1/0214G05D1/0231G05D1/24G05D1/2437G05D1/43G06V20/56B60R2300/301B60R2300/302B60R2300/307
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,230,140
App. No.
18/490,520
Granted
Feb 18, 2025
Kind
B2
Abstract

Methods and devices for actively modifying a field of view of an autonomous vehicle in view of constraints are disclosed. In one embodiment, an example method is disclosed that includes causing a sensor in an autonomous vehicle to sense information about an environment in a first field of view, where a portion of the environment is obscured in the first field of view. The example method further includes determining a desired field of view in which the portion of the environment is not obscured and, based on the desired field of view and a set of constraints for the vehicle, determining a second field of view in which the portion of the environment is less obscured than in the first field of view. The example method further includes modifying a position of the vehicle, thereby causing the sensor to sense information in the second field of view.

Claims (44)

1. A method comprising:

causing a sensor in an autonomous vehicle to sense information about an environment in a first field of view, wherein a portion of the environment is obscured in the first field of view;

determining a desired field of view in which the portion of the environment is not obscured;

based on the desired field of view, determining a second field of view in which the portion of the environment is less obscured than in the first field of view and more obscured than in the desired field of view; and

modifying the sensor's field of view, from the first field of view to the second field of view, wherein the second field of view is an improved field of view of the sensor.

2. The method of claim 1 , wherein the second field of view in which the portion of the environment is less obscured than in the first field of view is determined based on a set of constraints for the autonomous vehicle.

3. The method of claim 2 , wherein the set of constraints comprises a range of permitted speeds, a maximum deceleration, a proximity to a crosswalk, or a proximity to another vehicle.

4. The method of claim 1 , wherein the sensor's field of view is modified in response to determining the second field of view.

5. The method of claim 1 , wherein modifying the sensor's field of view comprises modifying a position of the autonomous vehicle.

6. The method of claim 1 , wherein modifying the sensor's field of view comprises causing the sensor to sense information in the second field of view.

7. The method of claim 1 , wherein determining the second field of view comprises:

detecting an obstacle in the first field of view; and

in response to detecting the obstacle, determining the second field of view.

8. The method of claim 1 , wherein determining the second field of view comprises:

estimating a location of the autonomous vehicle;

detecting that the location of the autonomous vehicle is near a predetermined location; and

in response to detecting that the location of the autonomous vehicle is near the predetermined location, determining the second field of view.

9. The method of claim 1 , wherein modifying the sensor's field of view further comprises modifying a position of the sensor, wherein modifying the position of the sensor comprises using one or more actuators to adjust the position of the sensor by moving the sensor or a movable mount, and wherein the one or more actuators comprise a motor, a pneumatic actuator, a hydraulic piston, a relay, a solenoid, or a piezoelectric actuator.

10. The method of claim 1 , wherein the second field of view is determined relative to the first field of view.

11. The method of claim 1 , further comprising:

determining a requested field of view for an external sensor, wherein the external sensor is physically separate from the autonomous vehicle;

sending to the external sensor a request for the requested field of view; and

receiving, from the external sensor, information sensed by the external sensor in the requested field of view.

12. The method of claim 1 , wherein the sensor comprises a radio detection and ranging (RADAR) unit.

13. An autonomous vehicle comprising:

a sensor;

at least one processor; and

data storage comprising:

instructions executable by the at least one processor to:

cause the sensor to sense information about an environment in a first field of view, wherein a portion of the environment is obscured in the first field of view;

determine a desired field of view in which the portion of the environment is not obscured;

based on the desired field of view, determine a second field of view in which the portion of the environment is less obscured than in the first field of view and more obscured than in the desired field of view; and

modify the sensor's field of view, from the first field of view to the second field of view, wherein the second field of view is an improved field of view of the sensor.

14. The autonomous vehicle of claim 13 , wherein the second field of view in which the portion of the environment is less obscured than in the first field of view is determined based on a set of constraints for the autonomous vehicle.

15. The autonomous vehicle of claim 14 , wherein the set of constraints comprises a range of permitted speeds, a maximum deceleration, a proximity to a crosswalk, or a proximity to another vehicle.

16. The autonomous vehicle of claim 13 , wherein the sensor's field of view is modified in response to determining the second field of view.

17. The autonomous vehicle of claim 13 , wherein modifying the sensor's field of view comprises modifying a position of the autonomous vehicle.

18. The autonomous vehicle of claim 13 , wherein modifying the sensor's field of view comprises causing the sensor to sense information in the second field of view.

19. The autonomous vehicle of claim 13 , wherein the second field of view is determined relative to the first field of view.

20. A non-transitory computer-readable medium having stored therein instructions executable by a computing device to cause the computing device to perform the functions of:

causing a sensor in an autonomous vehicle to sense information about an environment in a first field of view, wherein a portion of the environment is obscured in the first field of view;

determining a desired field of view in which the portion of the environment is not obscured;

based on the desired field of view, determining a second field of view in which the portion of the environment is less obscured than in the first field of view and more obscured than in the desired field of view; and

modifying the sensor's field of view, from the first field of view to the second field of view, wherein the second field of view is an improved field of view of the sensor.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2023
From: FERGUSON, DAVID I.; ZHU, JIAJUN
To: GOOGLE INC.
Reel/Frame 065283/0727 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2023
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 065290/0868 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2023
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 065692/0852 →
Continuity (5)
Continuation 18049134 · Oct 24, 2022
Continuation 16588746 · Sep 30, 2019
Continuation 15675857 · Aug 14, 2017
Continuation 13423143 · Mar 16, 2012
Related Publication 20240045438A1 · Feb 8, 2024
References Cited (128)
US 4758078A · Bracamonte · 1988 [cited by examiner]
US 5187664A · Yardley et al. · 1993 [cited by applicant]
US 5227748A · Sroka · 1993 [cited by applicant]
US 5410346A · Saneyoshi · 1995 [cited by applicant]
US 5548516A · Gudat et al. · 1996 [cited by applicant]
US 5605099A · Sroka et al. · 1997 [cited by applicant]
US 5610815A · Gudat et al. · 1997 [cited by applicant]
US 5615116A · Gudat et al. · 1997 [cited by applicant]
US 5670935A · Schofield et al. · 1997 [cited by applicant]
US 5793308A · Rosinski et al. · 1998 [cited by applicant]
US 6151539A · Bergholz et al. · 2000 [cited by applicant]
US 6198386B1 · White, II · 2001 [cited by applicant]
US 6208916B1 · Hori · 2001 [cited by applicant]
US 6363632B1 · Stentz et al. · 2002 [cited by applicant]
US 6516273B1 · Pierowicz et al. · 2003 [cited by applicant]
US 6643578B2 · Levine · 2003 [cited by applicant]
US 6691015B1 · Levine · 2004 [cited by applicant]
US 6721644B2 · Levine · 2004 [cited by applicant]
US 7072764B2 · Donath · 2006 [cited by examiner]
US 7079923B2 · Abramson et al. · 2006 [cited by applicant]
US 7106365B1 · Sogawa · 2006 [cited by applicant]
US 7196305B2 · Shaffer et al. · 2007 [cited by applicant]
US 7598889B2 · Maeda et al. · 2009 [cited by applicant]
US 7706917B1 · Chiappetta et al. · 2010 [cited by applicant]
US 7734275B2 · Kubota · 2010 [cited by applicant]
US 7734387B1 · Young et al. · 2010 [cited by applicant]
US 7804980B2 · Sasaki · 2010 [cited by applicant]
US 7979174B2 · Fregene et al. · 2011 [cited by applicant]
US 8036775B2 · Matsumoto et al. · 2011 [cited by applicant]
US 8050863B2 · Trepagnier et al. · 2011 [cited by applicant]
US 8081794B2 · Stiegler · 2011 [cited by applicant]
US 8139109B2 · Schmiedel et al. · 2012 [cited by applicant]
US 8179241B2 · Sakai et al. · 2012 [cited by applicant]
US 8195394B1 · Zhu et al. · 2012 [cited by applicant]
US 8457827B1 · Ferguson et al. · 2013 [cited by applicant]
US 8521352B1 · Ferguson et al. · 2013 [cited by applicant]
US 8547298B2 · Szczerba et al. · 2013 [cited by applicant]
US 8589014B2 · Fairfield et al. · 2013 [cited by applicant]
US 8842176B2 · Schofield et al. · 2014 [cited by applicant]
US 8908035B2 · Russ et al. · 2014 [cited by applicant]
US 9511711B2 · Petrillo et al. · 2016 [cited by applicant]
US 9760092B2 · Ferguson · 2017 [cited by examiner]
US 10466712B2 · Ferguson · 2019 [cited by examiner]
US 10525884B2 · Petrillo · 2020 [cited by examiner]
US 10896335B2 · Herman · 2021 [cited by applicant]
US 11294390B2 · Ferguson · 2022 [cited by examiner]
US 11507102B2 · Ferguson · 2022 [cited by examiner]
US 11829152B2 · Ferguson · 2023 [cited by examiner]
US 20020016653A1 · Levine · 2002 [cited by applicant]
US 20030014176A1 · Levine · 2003 [cited by applicant]
US 20030137517A1 · Kondo et al. · 2003 [cited by applicant]
US 20030227424A1 · Lynch · 2003 [cited by examiner]
US 20040073368A1 · Gonzalez-Banos et al. · 2004 [cited by applicant]
US 20050033505A1 · Zatz · 2005 [cited by applicant]
US 20050280707A1 · Sablak et al. · 2005 [cited by applicant]
US 20060079752A1 · Anderl et al. · 2006 [cited by applicant]
US 20070027612A1 · Barfoot et al. · 2007 [cited by applicant]
US 20070030212A1 · Shibata · 2007 [cited by examiner]
US 20070100498A1 · Matsumoto et al. · 2007 [cited by applicant]
US 20070115357A1 · Stein et al. · 2007 [cited by applicant]
US 20070122771A1 · Maeda et al. · 2007 [cited by applicant]
US 20070291130A1 · Broggi et al. · 2007 [cited by applicant]
US 20080012726A1 · Publicover · 2008 [cited by applicant]
US 20080027591A1 · Lenser et al. · 2008 [cited by applicant]
US 20080197997A1 · Vitito · 2008 [cited by applicant]
US 20080215231A1 · Breed · 2008 [cited by applicant]
US 20090015675A1 · Yang · 2009 [cited by applicant]
US 20090088916A1 · Elgersma et al. · 2009 [cited by applicant]
US 20090140881A1 · Sakai · 2009 [cited by examiner]
US 20090237269A1 · Okugi · 2009 [cited by examiner]
US 20100063651A1 · Anderson · 2010 [cited by applicant]
US 20100066527A1 · Liou · 2010 [cited by examiner]
US 20100117812A1 · Laubinger et al. · 2010 [cited by applicant]
US 20100118146A1 · Schofield · 2010 [cited by examiner]
US 20100134264A1 · Nagamine et al. · 2010 [cited by applicant]
US 20100215250A1 · Zhu · 2010 [cited by applicant]
US 20100228427A1 · Anderson et al. · 2010 [cited by applicant]
US 20100228482A1 · Yonak · 2010 [cited by applicant]
US 20100234993A1 · Seelinger et al. · 2010 [cited by applicant]
US 20100245575A1 · Mori et al. · 2010 [cited by applicant]
US 20100253540A1 · Seder et al. · 2010 [cited by applicant]
US 20100321500A1 · Cornett et al. · 2010 [cited by applicant]
US 20110046784A1 · Anderson · 2011 [cited by applicant]
US 20110090073A1 · Ozaki · 2011 [cited by applicant]
US 20110102195A1 · Kushi · 2011 [cited by examiner]
US 20110153166A1 · Yester · 2011 [cited by applicant]
US 20110175752A1 · Augst · 2011 [cited by applicant]
US 20110231061A1 · Reeve et al. · 2011 [cited by applicant]
US 20110242286A1 · Pace et al. · 2011 [cited by applicant]
US 20110280026A1 · Higgins-Luthman · 2011 [cited by applicant]
US 20110291859A1 · Kreis et al. · 2011 [cited by applicant]
US 20120069187A1 · Ozaki et al. · 2012 [cited by applicant]
US 20120083960A1 · Zhu et al. · 2012 [cited by applicant]
US 20120101680A1 · Trepagnier et al. · 2012 [cited by applicant]
US 20120166072A1 · Tamaoki et al. · 2012 [cited by applicant]
US 20120212614A1 · Oszwald · 2012 [cited by examiner]
US 20120218125A1 · Demirdjian et al. · 2012 [cited by applicant]
US 20120268262A1 · Popovic · 2012 [cited by applicant]
US 20120310466A1 · Fairfield et al. · 2012 [cited by applicant]
US 20120327188A1 · Takemura et al. · 2012 [cited by applicant]
US 20130033602A1 · Quast et al. · 2013 [cited by applicant]
US 20130181823A1 · Stahlin et al. · 2013 [cited by applicant]
US 20130197736A1 · Zhu et al. · 2013 [cited by applicant]
US 20130245877A1 · Ferguson et al. · 2013 [cited by applicant]
US 20130253754A1 · Ferguson et al. · 2013 [cited by applicant]
US 20130325241A1 · Lombrozo et al. · 2013 [cited by applicant]
US 20140333770A1 · Baur · 2014 [cited by applicant]
US 20150274074A1 · Petrillo et al. · 2015 [cited by applicant]
US 20180024567A1 · Ferguson et al. · 2018 [cited by applicant]
US 20180101737A1 · You · 2018 [cited by applicant]
US 20200026303A1 · Ferguson et al. · 2020 [cited by applicant]
US 20200216059A1 · Vladimerou · 2020 [cited by examiner]
US 20200327810A1 · Branson et al. · 2020 [cited by applicant]
US 20200357139A1 · Lu et al. · 2020 [cited by applicant]
US 20210304607A1 · Grace et al. · 2021 [cited by applicant]
DE 102006052779A1 · 2008 [cited by applicant]
JP 07009886A · 1995 [cited by applicant]
JP 2006193082A · 2006 [cited by examiner]
JP 2006293976A · 2006 [cited by applicant]
JP 2010152545A · 2010 [cited by applicant]
WO 2011048597A1 · 2011 [cited by applicant]
WO WO2011145141A1 · 2011 [cited by examiner]
Translation of WO-2011145141-A1, 10 pages (Year: 2011). [cited by examiner]
Translation of JP-2006193082-A, 15 pages (Year: 2006). [cited by examiner]
PCT International Search Report and Written Opinion, PCT International Application No. PCT/US2013/026917, dated Jun. 17, 2013. [cited by applicant]
European Patent Office, Supplementary European Search Report mailed on Dec. 1, 2015, issued in connection with EP Application No. 13760269, 5 pages. [cited by applicant]
Kim et al., “User-Centered Approach to Path Planning of Cleaning Robots: Analyzing User's Cleaning Behavior”, Proceedings of the ACM/IEEE international conference on Human-robot interaction, 2007. [cited by applicant]
Seo et al., “A Perception Mechanism for Supporting Autonomous Intersection Handling in Urban Driving”, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1830-1835. [cited by applicant]