IP Library › Granted Patent US 11,107,470
Granted Patent B2
US 11,107,470 · App. 16/466,248 · Granted Aug 31, 2021

Platform selection for performing requested actions in audio-based computing environments

Inventors: Chad Ward (Mountain View, CA); Bogdan Caprita (Mountain View, CA); Yilei Wang (Sunnyvale, CA)
Assignee: GOOGLE LLC
G10L15/22G06F9/4843G10L15/1822G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,107,470
App. No.
16/466,248
Granted
Aug 31, 2021
Kind
B2
Abstract

Systems and methods of selecting digital platforms for execution of voice-based commands are provided. The system receives an application that performs an action associated with a service via digital platforms. The system debugs the application to validate parameters of the action on at least two platforms of the digital platforms. The system receives data packets comprising an input audio signal detected by a sensor of a client device, and parses the input audio signal to identify the action and the service. The system selects a first platform from the digital platforms to perform the action. The system initiates, responsive to selection of the first platform, an interactive data exchange to populate parameters of an action data structure corresponding to the action. The system executes the action via the selected platform using the action data structure.

Claims (72)

1. A system to select digital platforms for execution of voice-based commands, comprising:

a data processing system comprising at least one processor and memory to:

receive, from a service provider device, an application that performs an action associated with a service via a plurality of digital platforms;

debug the application to validate parameters of the action on at least two platforms of the plurality of digital platforms;

receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a sensor of a client device;

parse the input audio signal to identify the action and the service;

select, based on a policy and at least one of the input audio signal or historical execution information, a first platform of the plurality of digital platforms to perform the action;

initiate, responsive to selection of the first platform, an interactive data exchange to populate parameters of an action data structure corresponding to the action; and

execute the action via the selected platform using the action data structure.

2. The system of claim 1 , wherein the plurality of digital platforms include at least one of a web-based application platform for the service, a mobile application platform for the service, and a conversational platform for the service.

3. The system of claim 1 , comprising the data processing system to:

identify, for the action, first markup information indicating first parameters for the first platform of the plurality of digital platforms;

identify, for the action, second markup information indicating second parameters for a second platform of the plurality of digital platforms;

determine, based on a comparison of the first markup information and the second markup information, a conflict between the first parameters and the second parameters; and

provide, to the service provider device, an indication of the conflict.

4. The system of claim 1 , comprising the data processing system to:

identify, for the action, first parameters for the first platform of the plurality of digital platforms, and second markup information indicating second parameters for a second platform of the plurality of digital platforms;

determine a conflict between the first parameters and the second parameters based on a comparison; and

transmit a prompt to the service provider device to resolve the conflict.

5. The system of claim 4 , comprising the data processing system to:

determine that fewer parameters are configured for the conversational platform compared to the web-based application platform;

wherein the first platform is a web-based application platform for the service and the second platform is a conversational platform for the service.

6. The system of claim 1 , comprising the data processing system to:

identify a conflict within the parameters of the action on at least two of the plurality of digital platforms; and

automatically resolve the conflict based on at least one policy stored by the data processing system.

7. The system of claim 1 , comprising the data processing system to:

identify a conflict within the parameters of the action on at least two of the plurality of digital platforms; and

automatically resolve the conflict by removing at least one parameter associated with the action on one of the at least two of the plurality of digital platforms.

8. The system of claim 1 , comprising the data processing system to:

identify, for the action, first parameters for the first platform of the plurality of digital platforms, and second markup information indicating second parameters for a second platform of the plurality of digital platforms;

determine an inconsistency between the first parameters and the second parameters based on a comparison;

retrieve, responsive to determination of the inconsistency, a resolution policy for the service provider device; and

resolve the inconsistency based on the resolution policy.

9. The system of claim 8 , comprising the data processing system to:

determine the first platform is associated with a latest version update compared to the second platform; and

resolve, responsive to the determination that the first platform is associated with the latest version update, the inconsistency by updating the second parameters to match the first parameters.

10. The system of claim 1 , comprising:

the data processing system to select the first platform of the plurality of digital platforms based on a ranking policy.

11. The system of claim 1 , wherein the historical execution information includes an indication of a previous platform executed to perform the action for the service responsive to a request from the client device, comprising:

the data processing system to select the first platform based on the previous platform that executed the action being the first platform.

12. The system of claim 1 , comprising:

the data processing system to select the first platform based on a determination that execution of the action via the first platform utilizes less computing resources compared to execution of the action via a second platform of the plurality of digital platforms.

13. A method of selecting digital platforms for execution of voice-based commands, comprising:

receiving, by a data processing system comprising at least one processor, from a service provider device, an application that performs an action associated with a service via a plurality of digital platforms;

debugging, by the data processing system, the application to validate parameters of the action on at least two platforms of the plurality of digital platforms;

receiving, by the data processing system via an interface of the data processing system, data packets comprising an input audio signal detected by a sensor of a client device;

parsing, by the data processing system, the input audio signal to identify the action and the service;

selecting, by the data processing system, based on a policy and at least one of the input audio signal or historical execution information, a first platform of the plurality of digital platforms to perform the action;

initiating, by the data processing system responsive to selection of the first platform, an interactive data exchange to populate parameters of an action data structure corresponding to the action; and

executing, by the data processing system, the action via the selected platform using the action data structure.

14. The method of claim 13 , wherein the plurality of digital platforms include at least one of a web-based application platform for the service, a mobile application platform for the service, and a conversational platform for the service.

15. The method of claim 13 , comprising:

identifying, for the action, first markup information indicating first parameters for the first platform of the plurality of digital platforms;

identifying, for the action, second markup information indicating second parameters for a second platform of the plurality of digital platforms;

determining, based on a comparison of the first markup information and the second markup information, a conflict between the first parameters and the second parameters; and

providing, to the service provider device, an indication of the conflict.

16. The method of claim 13 , comprising:

identifying, for the action, first parameters for the first platform of the plurality of digital platforms, and second markup information indicating second parameters for a second platform of the plurality of digital platforms;

determining a conflict between the first parameters and the second parameters based on a comparison; and

transmitting a prompt to the service provider device to resolve the conflict.

17. The method of claim 16 , wherein the first platform is a web-based application platform and the second platform is a conversational platform for the service, the method comprising:

determining that fewer parameters are configured for the conversational platform compared to the web-based application platform.

18. The method of claim 13 , comprising:

identifying a conflict within the parameters of the action on at least two of the plurality of digital platforms; and

automatically resolving the conflict based on at least one policy stored by the data processing system.

19. The method of claim 13 , comprising:

identifying, for the action, first parameters for the first platform of the plurality of digital platforms, and second markup information indicating second parameters for a second platform of the plurality of digital platforms;

determining an inconsistency between the first parameters and the second parameters based on a comparison;

retrieving, responsive to determination of the inconsistency, a resolution policy for the service provider device; and

resolving the inconsistency based on the resolution policy.

20. The method of claim 13 , comprising:

selecting the first platform of the plurality of digital platforms based on a ranking policy.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2019
From: WARD, CHAD; CAPRITA, BOGDAN; WANG, YILEI
To: GOOGLE LLC
Reel/Frame 050463/0682 →
Continuity (2)
Provisional Application 62668207 · May 7, 2018
Related Publication 20210050008A1 · Feb 18, 2021
Cited By (1)
US 12,567,410