IP Library Granted Patent US 12,399,023
Granted Patent B2
US 12,399,023 · App. 17/784,221 · Granted Aug 26, 2025

Message based navigational assistance

Inventor: Matthew Sharifi (Kilchberg, CH)
Assignee: GOOGLE LLC
G01C21/362G01C21/343H04L51/216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,399,023
App. No.
17/784,221
Granted
Aug 26, 2025
Kind
B2
Abstract

Methods, systems, devices, and tangible non-transitory computer readable media for using incoming communications to generate suggestions for navigation. The disclosed technology can include accessing route data that includes information associated with navigation from a starting location to a destination. Based on the route data, one or more routes from the starting location to the destination can be determined. Message data including one or more messages to a user can be accessed. Based on the message data and one or more machine-learned models, at least one entity and objectives that are associated with the one or more messages can be determined. Based on the one or more routes, the at least one entity, and the objectives, suggestions associated with the one or more messages can be determined. Furthermore, output including indications associated with the suggestions directed to the user can be generated via a user interface.

Claims (70)

1. A computer-implemented method of navigation, the computer-implemented method comprising:

accessing, by a computing system comprising one or more processors, route data comprising information associated with navigation from a starting location to a destination for a vehicle associated with the computing system;

determining, by the computing system, based at least in part on the route data, one or more routes from the starting location to the destination;

accessing, by the computing system, message data comprising one or more messages associated with a user;

determining, by the computing system, based at least in part on the message data and one or more machine-learned models, at least one entity and one or more objectives that are associated with the one or more messages;

providing, for presentation to the user by the computing system, based at least in part on the one or more routes, the at least one entity, and the one or more objectives, one or more suggestions associated with the one or more messages which request feedback from the user associated with potential courses of action relating to the vehicle;

generating, by the computing system, via a user interface, a plurality of outputs directed to the user,

wherein

the plurality of outputs are associated with the one or more suggestions which request feedback from the user and are associated with potential courses of action relating to the vehicle, and

the plurality of outputs include a first selectable option comprising a first user interface element provided for presentation on the user interface, the first selectable option being configured to, when selected, provide feedback indicating to maintain a current course of action relating to the vehicle and a second selectable option comprising a second user interface element provided for presentation on the user interface, the second selectable option being configured to, when selected, provide feedback indicating to update the current course of action relating to the vehicle;

based on a selection of one of the first selectable option and the second selectable option, controlling a navigation system of the vehicle;

based on the selection of the first selectable option, automatically generating a first response to a sender of the one or more messages; and

based on the selection of the second selectable option, automatically generating a second response to the sender of the one or more messages.

2. The computer-implemented method of claim 1 , wherein the generating, by the computing system, based at least in part on the one or more routes, the at least one entity, and the one or more objectives, one or more suggestions associated with the one or more messages comprises:

determining, by the computing system, whether the at least one entity satisfies one or more relationship criteria;

determining, by the computing system, whether the one or more objectives are associated with one or more requests to modify the one or more routes; and

in response to the at least one entity satisfying the one or more relationship criteria and the one or more objectives including the one or more requests to modify the one or more routes, determining, by the computing system, that the one or more suggestions are associated with one or more requests to modify the one or more routes.

3. The computer-implemented method of claim 2 , wherein the satisfying the one or more relationship criteria comprises the at least one entity being associated with a high priority relationship group, the at least one entity being an individual that has previously communicated with the user at a frequency that exceeds a communication frequency threshold, the at least one entity being an individual that has previously communicated with the user a total number of times that exceeds a communication quantity threshold, or the at least one entity being an individual that is associated with the one or more routes.

4. The computer-implemented method of claim 2 , wherein the one or more requests to modify the one or more routes comprise a request to add at least one waypoint to the one or more routes, a request to modify a pick-up location, a request to modify a pick-up time, a request to modify a drop-off location, a request to modify a drop-off time, or a request to modify a destination of the one or more routes.

5. The computer-implemented method of claim 1 , wherein the generating, by the computing system, based at least in part on the one or more routes, the at least one entity, and the one or more objectives, one or more suggestions associated with the one or more messages comprises:

determining, by the computing system, a level of importance associated with the at least one entity or the one or more objectives;

in response to the level of importance exceeding an importance threshold, determining, by the computing system, that the one or more suggestions shall include one or more requests for the feedback from the user; and

in response to the level of importance not exceeding the importance threshold, determining, by the computing system, that the one or more suggestions shall not include one or more requests for the feedback from the user.

6. The computer-implemented method of claim 5 , wherein the one or more requests for feedback from the user comprise a request for spoken feedback, a request for haptic feedback, or a request for gesture feedback.

7. The computer-implemented method of claim 1 , wherein the generating, by the computing system, based at least in part on the one or more routes, the at least one entity, and the one or more objectives, one or more suggestions associated with the one or more messages comprises:

determining, by the computing system, whether the one or more objectives are associated with a request for a travel status associated with the one or more routes; and

in response to the one or more objectives being associated with the request for the travel status associated with the one or more routes, determining, by the computing system, that the one or more suggestions are associated with the request for the travel status associated with the one or more routes.

8. The computer-implemented method of claim 1 , wherein the generating, by the computing system, based at least in part on the one or more routes, the at least one entity, and the one or more objectives, one or more suggestions associated with the one or more messages comprises:

determining, by the computing system, whether the one or more objectives are associated with a request for a pick-up or a request for a drop-off; and

in response to the one or more objectives being associated with the request for a pick-up or the request for a drop-off, determining, by the computing system, that the one or more suggestions shall be associated with the request for a pick-up or a drop-off.

9. The computer-implemented method of claim 1 , further comprising:

receiving, by the computing system, one or more user inputs comprising a navigation request from the user; and

generating, by the computing system, the route data based at least in part on the navigation request.

10. The computer-implemented method of claim 1 , wherein the at least one entity is associated with one or more personal names, one or more geographic locations, one or more occupational titles, or one or more organizational names.

11. The computer-implemented method of claim 1 , wherein the one or more suggestions are based at least in part on the one or more machine-learned models.

12. The computer-implemented method of claim 1 , wherein the one or more machine-learned models are configured to determine the at least one entity or the one or more objectives based at least in part on one or more natural language processing techniques.

13. The computer-implemented method of claim 1 , further comprising:

training the one or more machine-learned models based at least in part on the selection of the one of the first selectable option and the second selectable option.

14. One or more tangible non-transitory computer-readable media storing computer-readable instructions that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:

accessing, for a vehicle, route data comprising information associated with navigation from a starting location to a destination;

determining, based at least in part on the route data, one or more routes from the starting location to the destination;

accessing message data comprising one or more messages associated with a user;

determining, based at least in part on the message data and one or more machine-learned models, at least one entity and one or more objectives that are associated with the one or more messages;

providing, for presentation to the user, based at least in part on the one or more routes, the at least one entity, and the one or more objectives, one or more suggestions associated with the one or more messages which request feedback from the user and are associated with potential courses of action relating to the vehicle;

generating, via a user interface, a plurality of outputs directed to the user,

wherein

the plurality of outputs are associated with the one or more suggestions which request feedback from the user associated with potential courses of action relating to the vehicle, and

the plurality of outputs include a first selectable option comprising a first user interface element provided for presentation on the user interface, the first selectable option being configured to, when selected, provide feedback indicating to maintain a current course of action relating to the vehicle and a second selectable option comprising a second user interface element provided for presentation on the user interface, the second selectable option being configured to, when selected, provide feedback indicating to update the current course of action relating to the vehicle;

based on a selection of one of the first selectable option and the second selectable option, controlling a navigation system of the vehicle;

based on the selection of the first selectable option, automatically generating a first response to a sender of the one or more messages; and

based on the selection of the second selectable option, automatically generating a second response to the sender of the one or more messages.

15. The one or more tangible non-transitory computer-readable media of claim 14 , wherein the one or more messages comprise one or more text messages.

16. The one or more tangible non-transitory computer-readable media of claim 14 , wherein the one or more suggestions comprise one or more turn-by-turn directions for the user to navigate the one or more routes.

17. A computing system comprising:

one or more processors;

one or more non-transitory computer-readable media storing instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising:

accessing route data comprising information associated with navigation from a starting location to a destination for a vehicle associated with the computing system;

determining, based at least in part on the route data, one or more routes from the starting location to the destination;

accessing message data comprising one or more messages associated with a user;

determining, based at least in part on the message data and one or more machine-learned models, at least one entity and one or more objectives that are associated with the one or more messages;

providing, for presentation to the user, based at least in part on the one or more routes, the at least one entity, and the one or more objectives, one or more suggestions associated with the one or more messages which request feedback from the user associated with potential courses of action relating to the vehicle;

generating, via a user interface, a plurality of outputs directed to the user,

wherein

the plurality of outputs are associated with the one or more suggestions which request feedback from the user and are associated with potential courses of action relating to the vehicle, and

the plurality of outputs include a first selectable option comprising a first user interface element provided for presentation on the user interface, the first selectable option being configured to, when selected, provide feedback indicating to maintain a current course of action relating to the vehicle and a second selectable option comprising a second user interface element provided for presentation on the user interface, the second selectable option being configured to, when selected, provide feedback indicating to update the current course of action relating to the vehicle; and

based on a selection of one of the first selectable option and the second selectable option, controlling a navigation system of the vehicle;

based on the selection of the first selectable option, automatically generating a first response to a sender of the one or more messages; and

based on the selection of the second selectable option, automatically generating a second response to the sender of the one or more messages.

18. The computing system of claim 17 , wherein the plurality of outputs comprise one or more visual indications or one or more aural indications.

19. The computing system of claim 17 , wherein the one or more machine-learned models are configured to generate output comprising the at least one entity and the one or more objectives based at least in part on input comprising the message data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2022
From: SHARIFI, MATTHEW
To: GOOGLE LLC
Reel/Frame 060690/0291 →
Continuity (1)
Related Publication 20240167834A1 · May 23, 2024
References Cited (16)
US 8897822B2 · Martin · 2014 [cited by examiner]
US 8996639B1 · Faaborg et al. · 2015 [cited by applicant]
US 10339925B1 · Rastrow · 2019 [cited by examiner]
US 10503724B2 · Ochiai et al. · 2019 [cited by applicant]
US 20080171555A1 · Oh · 2008 [cited by examiner]
US 20120010805A1 · Wilkerson · 2012 [cited by examiner]
US 20120016678A1 · Gruber · 2012 [cited by examiner]
US 20120166076A1 · Hardy · 2012 [cited by examiner]
US 20150341290A1 · Cherifi · 2015 [cited by examiner]
US 20160163311A1 · Crook · 2016 [cited by examiner]
US 20180052909A1 · Sharifi · 2018 [cited by examiner]
US 20200372796A1 · Gajapala · 2020 [cited by applicant]
WO WO2018174840A1 · 2018 [cited by examiner]
Daly et al., “Westland Row Why So Slow? Fusing Social Media and Linked Data Sources for Understanding Real-Time Traffic Conditions”, In Proceedings of the 2013 international conference on Intelligent user interfaces, 20… [cited by applicant]
International Search Report and Written Opinion for PCT/US2021/031382, mailed on Feb. 16, 2022, 17 pages. [cited by applicant]
International Preliminary Report on Patentability for Application No. PCT/US2021/031382, mailed Nov. 16, 2023, 11 pages. [cited by applicant]