IP Library Granted Patent US 11,842,731
Granted Patent B2
US 11,842,731 · App. 16/951,155 · Granted Dec 12, 2023

Method and system for executing an action for a user based on audio input

Inventors: Charles Hart Isaacs (Annapolis, MD); Vala Afshar (Burlington, MA); Bruce Richardson (Chestnut Hill, MA)
Assignee: Salesforce, Inc.
G10L15/22G01C21/3608G06F3/167G10L15/08G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,842,731
App. No.
16/951,155
Granted
Dec 12, 2023
Kind
B2
Abstract

The method system described herein is configured to identify and execute a next recommended action for a user based on the user's audio input. In an embodiment, the system is configured to receive audio input from the user and convert the audio input into a string. The system may identify an attribute associated with the user. The system may identify a type of action based on the string. The system may query a data repository using the attribute associated with the user to retrieve information associated with the type of action. The system may identify a recommended action for the user based on the information associated with the type of action. The system may then execute the recommended action for the user.

Claims (49)

1. A computer-implemented method, comprising:

receiving, by one or more computing devices, an audio file including audio input from a user, telemetry data indicating a location of the user, and a user identifier;

converting, by the one or more computing devices, the audio input into a string representing a transcription of the audio input;

identifying, by the one or more computing devices, a type of action to be executed based on content of the string;

querying, by the one or more computing devices, a data repository corresponding to the type of action, using the telemetry data indicating the location of the user to retrieve information about an entity related to the type of action;

comparing elements of previous performance associated with the user to elements of the information about the entity;

determining, based on the comparing, that at least a threshold of the elements of the previous performance associated with the user match the elements of the information about the entity;

generating, by the one or more computing devices, a recommended action corresponding to the type of action based on the determining; and

executing, by the one or more computing devices, the recommended action for the user by interfacing with the entity,

wherein the elements of the previous performance associated with the user include a sales history of the user, and

wherein the elements of the information about the entity include potential sale amount, type of entity, and entity purchase history.

2. The method of claim 1 , further comprising identifying, by the one or more computing devices, a keyword from the request, wherein the type of action is determined based on the keyword.

3. The method of claim 1 , further comprising identifying, by the one or more computing devices, the data repository to query based on the type of action.

4. The method of claim 1 , wherein the audio input is captured by a device installed in a vehicle of the user.

5. The method of claim 1 , wherein the recommended action includes navigating to a destination.

6. The method of claim 5 , further comprising causing display, by the one or more computing devices, of navigation instructions for the destination on a user interface.

7. The method of claim 1 , further comprising causing output, by the one or more computing devices, of information associated with the recommended action on a user interface, wherein the output at least one of an audio output or a visual output.

8. A system comprising:

a memory; and

a processor coupled to the memory, the processor configured to:

receive an audio file including audio input from a user, telemetry data indicating a location of the user, and a user identifier;

convert the audio input into a string representing a transcription of the audio input;

identify a type of action to be executed based on content of the string;

query a data repository corresponding to the type of action, using the telemetry data indicating the location of the user to retrieve information about an entity related to the type of action;

compare elements of previous performance associated with the user to elements of information about the entity;

determine, based on the comparing, that at least a threshold of the elements of the previous performance associated with the user match the elements of the information about the entity;

generate a recommended action corresponding to the type of action based on the determining; and

execute the recommended action for the user by interfacing with the entity,

wherein the elements of the previous performance associated with the user include a sales history of the user, and

wherein the elements of the information about the entity include potential sale amount, type of entity, and entity purchase history.

9. The system of claim 8 , wherein the processor is further configured to identify a keyword from the request, wherein the type of action is determined based on the keyword.

10. The system of claim 8 , wherein the processor is further configured to identify the data repository to query based on the type of action.

11. The system of claim 8 , wherein the output is an audio output or a visual output.

12. The system of claim 8 , wherein the recommended action includes navigating to a destination.

13. The system of claim 12 , wherein the processor is further configured to cause display of navigation instructions for the destination on a user interface.

14. A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

receiving an audio file including audio input from a user, telemetry data indicating a location of the user, and a user identifier;

converting the audio input into a string representing a transcription of the audio input;

identifying a type of action to be executed based on content of the string;

querying a data repository corresponding to the type of action, using the telemetry data indicating the location of the user to retrieve information about an entity related to the type of action;

comparing elements of previous performance associated with the user to elements of the information about the entity;

determining, based on the comparing, that at least a threshold of the elements of the previous performance associated with the user match the elements of the information about the entity;

generating a recommended action corresponding to the type of based on the determining; and

executing the recommended action for the user by interfacing with the entity,

wherein the elements of the previous performance associated with the user include a sales history of the user, and

wherein the elements of the information about the entity include potential sale amount, type of entity, and entity purchase history.

15. The non-transitory computer-readable device of claim 14 , the operations further comprising identifying the data repository to query based on the type of action.

16. The non-transitory computer-readable device of claim 14 , the operations further comprising identifying a keyword from the request, wherein the type of action is determined based on the keyword.

17. The non-transitory computer-readable device of claim 14 , the operations further comprising causing output of information associated with the recommended action on a user interface, wherein the output at least one of an audio output or visual output.

Assignments (2)
CHANGE OF NAME Recorded Dec 18, 2024
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 069717/0499 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2020
From: ISAACS, CHARLES HART; AFSHAR, VALA; RICHARDSON, BRUCE
To: SALESFORCE.COM, INC.
Reel/Frame 054776/0344 →
Continuity (2)
Provisional Application 62957664 · Jan 6, 2020
Related Publication 20210210090A1 · Jul 8, 2021