IP Library › Granted Patent US 11,068,954
Granted Patent B2
US 11,068,954 · App. 15/356,512 · Granted Jul 20, 2021

System for virtual agents to help customers and businesses

Inventors: Jagadeshwar Nomula (Fremont, CA); Vinesh Gudla (Pleasanton, CA)
Assignee: Voicemonk Inc
G06Q30/0617G06F16/957G06Q30/0629
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,068,954
App. No.
15/356,512
Granted
Jul 20, 2021
Kind
B2
Abstract

A system for executing actions based on user input is provided. The system comprises a virtual agent for a software application, wherein the virtual agent is configured to store a correlation between actions available in the software application. Further, the system associates one or more of the actions with one or more tags. The system receives at least an audio input from a user of the software application, and uses the input to identify an action desired by the user to be performed among the actions. Further, the system executes one or more actions based on the desired action and the correlation between the actions available in the software application.

Claims (19)

1. A system configured to execute actions based on user input, the system comprising a virtual agent comprising a virtual agent client and a virtual agent server for an application, wherein the virtual agent is disposed to be configured to function with the application,

wherein the virtual agent server is configured to:

receive an audio input from a user of the application;

identify among a plurality of actions, using the audio input, a desired action by the user to be performed;

execute at least one of the plurality of actions;

wherein the virtual agent client and server are collectively configured to:

store, in the virtual agent server, a correlation between one or more actions available in the application, wherein the one or more actions available in the application comprise one or more of: search, sort, select, submit, or compare;

associate the one or more actions available in the application with one or more tags;

determine, by crawling the application, at least one input box and at least one submit button in one or more web-forms associated with the one or more actions available in the application;

execute an action from the one or more actions available in the application, based on the desired action, the correlation between the one or more actions available in the application, and by executing a code snippet in the virtual agent client to fill out the input box and click the submit button;

display an output page to the user based on the executed action;

determine that the user is unhappy with an output of the executed action based on an unhappiness score, wherein the unhappiness score is generated using at least one of a facial expression of the user and a duration the user looked at an item on the output page; and

suggest a different output to the user in response to determining that the user is unhappy with the output of the executed action.

2. The system according to claim 1 , wherein the virtual agent is configured to extract the correlation between the one or more actions available in the application by crawling through the application.

3. The system according to claim 1 , wherein one or more of the actions of search, sort, select, submit, or compare, are initiated by the virtual agent.

4. The system according to claim 1 , wherein the virtual agent is further configured to carry out natural language processing on the audio input and determine a context corresponding to the desired action.

5. The system according to claim 4 , wherein the virtual agent is further configured to incorporate the context while executing the one or more actions available in the application.

6. The system according to claim 1 , wherein the correlation between the one or more actions available in the application is at least one of sequential, hierarchical or lateral.

7. The system according to claim 1 , wherein at least two of the executed plurality of actions have any one of a sequential correlation, a hierarchical correlation or a lateral correlation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2021
From: NOMULA, JAGADESHWAR; GUDLA, VINESH
To: VOICEMONK INC.
Reel/Frame 056186/0120 →
Continuity (4)
Provisional Application 62257722 · Nov 20, 2015
Provisional Application 62275043 · Jan 5, 2016
Provisional Application 62318762 · Apr 5, 2016
Related Publication 20170148073A1 · May 25, 2017