IP Library › Granted Patent US 12,243,416
Granted Patent B1
US 12,243,416 · App. 18/206,115 · Granted Mar 4, 2025

Vehicle location assistance using audible signals

Inventors: Juliet Rothenberg (San Francisco, CA); Kiran Kaja (Santa Clara, CA)
Assignee: Waymo LLC
G08G1/005B60Q5/00B60Q5/005B60Q5/006G01C21/3438G05D1/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,416
App. No.
18/206,115
Granted
Mar 4, 2025
Kind
B1
Abstract

Aspects of the present disclosure relate to using audible cues to guide a passenger to a vehicle having an autonomous driving mode. For instance, one or more processors of the vehicle may receive, from a server computing device, instructions to pick up the passenger at a pickup location. The one or more processors may maneuver the vehicle towards the pickup location in the autonomous driving mode. The one or more processors may receive a signal indicating that the passenger requests assistance locating the vehicle. The one or more processors may use the signal to generate the audible cues. The audible cues may be played by the one or more processors through a speaker of the vehicle in order to guide the passenger towards the vehicle.

Claims (33)

1. A method of providing assistance to a visually impaired user, the user being associated with a client computing device, the method comprising:

maneuvering, by one or more processors of a vehicle having an autonomous driving mode, the vehicle towards a pickup location in the autonomous driving mode to pick up the user;

receiving, by the one or more processors, one or more signals from the client computing device, wherein the one or more signals indicate that the user requests audible cues to assist the user in reaching the vehicle, and the one or more signals further indicate that the user requests additional time to reach and enter the vehicle; and

in response to receiving the one or more signals, providing, by the one or more processors, audible cues to guide the user to the vehicle.

2. The method of claim 1 , wherein the audible cues played through one or more speakers of the vehicle.

3. The method of claim 1 , wherein the audible cues are provided for a predetermined period of time.

4. The method of claim 1 , wherein at least one of the one or more signals is received by the vehicle in response to the user selecting a button or option surfaced on a display of the client computing device indicating that the user requests assistance reaching the vehicle.

5. The method of claim 1 , wherein the audible cues are automatically provided based on a status of the vehicle.

6. The method of claim 5 , wherein the status of the vehicle includes at least one of: when the vehicle is within a predetermined distance in time or space from the pickup location, when a pull over location has been determined, when the vehicle is pulling over, when the vehicle has come to a complete stop, when the vehicle has arrived at the pull over location, when the vehicle is waiting for the passenger, when the vehicle is making the audible cues, when the client computing device has been authenticated, or when the vehicle's doors are unlocked or opened.

7. The method of claim 1 , wherein the audible cues are provided until the user had reached and entered the vehicle.

8. The method of claim 1 , wherein the audible cues are provided until the user opens a door of the vehicle.

9. The method of claim 1 , wherein at least one of volume, period or tempo of the audible cues is adjusted based on whether the client computing device is moving towards the vehicle or the client computing device is moving away from the vehicle.

10. The method of claim 1 , wherein the audible cues are adjusted as a status of the vehicle changes.

11. A vehicle for providing assistance to a visually impaired user, the user being associated with a client computing device, the vehicle having an autonomous driving mode, the vehicle comprising:

one or more external speakers; and

one or more processors configured to:

maneuver the vehicle towards a pickup location in the autonomous driving mode to pick up the user;

while the vehicle maneuvers towards the pickup location, receive one or more signals from the client computing device, wherein the one or more signals are associated with an initiation of cues to be provided by the vehicle, the one or more signals indicate that the user requests audible cues to assist the user in reaching the vehicle, and the one or more signals further indicate that the user requests additional time to reach and enter the vehicle; and

in response to receiving the one or more signals, use the one or more external speakers to provide the cues to guide the user to the vehicle.

12. The vehicle of claim 11 , wherein the audible cues played through one or more speakers of the vehicle.

13. The vehicle of claim 11 , wherein the audible cues are provided for a predetermined period of time.

14. The vehicle of claim 11 , wherein at least one of the one or more signals is received by the vehicle in response to the user selecting a button or option surfaced on a display of the client computing device indicating that the user requests assistance reaching the vehicle.

15. The vehicle of claim 11 , wherein the audible cues are automatically provided based on a status of the vehicle.

16. The vehicle of claim 15 , wherein the status of the vehicle includes at least one of: when the vehicle is within a predetermined distance in time or space from the pickup location, when a pull over location has been determined, when the vehicle is pulling over, when the vehicle has come to a complete stop, when the vehicle has arrived at the pull over location, when the vehicle is waiting for the passenger, when the vehicle is making the audible cues, when the client computing device has been authenticated, or when the vehicle's doors are unlocked or opened.

17. A client computing device for providing assistance to a visually impaired user, the client computing device comprising:

a display; and

one or more processors configured to:

receive, from a vehicle having an autonomous driving mode, one or more first signals indicating a status of the vehicle as the vehicle maneuvers towards a pickup location in the autonomous driving mode to pick up a user associated with the client computing device;

surface, based on the one or more first signals, a button or option on the display indicating that the user requests assistance reaching the vehicle; and

upon the user selecting the button or option, send, to the vehicle, one or more second signals requesting initiation of audible cues to be provided by the vehicle to guide the user to the vehicle, wherein the one or more second signals indicate that the user requests additional time to reach and enter the vehicle.

18. The client computing device of claim 17 , wherein the status of the vehicle indicates that the vehicle is within a certain distance or time from the pickup location.

19. The client computing device of claim 17 , wherein the status of the vehicle indicates that the vehicle has come to a complete stop in a pull over location.

20. The client computing device of claim 17 , wherein the status of the vehicle indicates that the vehicle is waiting for the user.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2023
From: ROTHENBERG, JULIET
To: LLC, WAYMO
Reel/Frame 063868/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2023
From: KAJA, KIRAN
To: GOOGLE LLC
Reel/Frame 063868/0860 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2023
From: GOOGLE LLC
To: WAYMO LLC
Reel/Frame 063868/0960 →
Continuity (4)
Continuation 17518683 · Nov 4, 2021
Continuation 16749094 · Jan 22, 2020
Continuation 16138070 · Sep 21, 2018
Provisional Application 62563997 · Sep 27, 2017
References Cited (37)
US 6489921B1 · Wilkinson · 2002 [cited by applicant]
US 6529142B2 · Yeh et al. · 2003 [cited by applicant]
US 6580368B1 · Jacobs · 2003 [cited by applicant]
US 6828907B1 · Galle · 2004 [cited by applicant]
US 7148802B2 · Abbruscato · 2006 [cited by applicant]
US 7911337B2 · King et al. · 2011 [cited by applicant]
US 8004400B2 · Tieman et al. · 2011 [cited by applicant]
US 8060109B2 · Fomukong et al. · 2011 [cited by applicant]
US 8380430B2 · Malone et al. · 2013 [cited by applicant]
US 8392118B2 · Korn et al. · 2013 [cited by applicant]
US 8521419B2 · Korn et al. · 2013 [cited by applicant]
US 9377315B2 · Grover et al. · 2016 [cited by applicant]
US 9836057B2 · Fairfield et al. · 2017 [cited by applicant]
US 9881503B1 · Goldman-Shenhar et al. · 2018 [cited by applicant]
US 9928734B2 · Newman · 2018 [cited by applicant]
US 10152884B2 · Frederick et al. · 2018 [cited by applicant]
US 10248119B2 · Kentley-Klay et al. · 2019 [cited by applicant]
US 10580291B1 · Rothenberg et al. · 2020 [cited by applicant]
US 10647250B1 · Diehl et al. · 2020 [cited by applicant]
US 10696222B1 · Pandit et al. · 2020 [cited by applicant]
US 10714116B2 · Tintor et al. · 2020 [cited by applicant]
US 11001199B1 · Galliano et al. · 2021 [cited by applicant]
US 11195409B1 · Rothenberg et al. · 2021 [cited by applicant]
US 11710399B1 · Rothenberg · 2023 [cited by examiner]
US 20080048909A1 · Ioffe et al. · 2008 [cited by applicant]
US 20080094254A1 · Hill · 2008 [cited by applicant]
US 20100161209A1 · Vaghefinazari · 2010 [cited by examiner]
US 20110148578A1 · Aloi et al. · 2011 [cited by applicant]
US 20140028477A1 · Michalske · 2014 [cited by applicant]
US 20170043707A1 · Kirchner · 2017 [cited by applicant]
US 20170178269A1 · McKinnon et al. · 2017 [cited by applicant]
US 20170277191A1 · Fairfield et al. · 2017 [cited by applicant]
US 20170344010A1 · Rander et al. · 2017 [cited by applicant]
US 20180050635A1 · Vincent et al. · 2018 [cited by applicant]
US 20180196415A1 · Iagnemma et al. · 2018 [cited by applicant]
FR 2971353A1 · 2012 [cited by applicant]
Translation of Lemaire [FR 297 1353] from Espacenet (Year: 2021). [cited by applicant]