IP Library Granted Patent US 11,508,371
Granted Patent B2
US 11,508,371 · App. 16/874,240 · Granted Nov 22, 2022

Digital assistant processing of stacked data structures

Inventors: Anshul Kothari (Cupertino, CA); Tarun Jain (Los Altos, CA); Gaurav Bhaya (Sunnyvale, CA); Ruxandra Davies (Mountain View, CA); Lisa Takehana (Mountain View, CA)
Assignee: GOOGLE LLC
G10L15/22G10L15/1822G10L17/22H04W12/06H04W12/64G10L15/30G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,508,371
App. No.
16/874,240
Granted
Nov 22, 2022
Kind
B2
Abstract

Processing stacked data structures is provided. A system receives an input audio signal detected by a sensor of a local computing device, identifies an acoustic signature, and identifies an account corresponding to the signature. The system establishes a session and a profile stack data structure including a first profile layer having policies configured by a third-party device. The system pushes, to the profile stack data structure, a second profile layer retrieved from the account. The system parses the input audio signal to identify a request and a trigger keyword. The system generates, based on the trigger keyword and the second profile layer, a first action data structure compatible with the first profile layer. The system provides the first action data structure for execution. The system disassembles the profile stack data structure to remove the first profile layer or the second profile layer from the profile stack data structure.

Claims (69)

1. A system to process input audio signals, comprising:

a data processing system comprising one or more processors and memory to:

receive data packets comprising an input audio signal detected by a sensor of a local computing device;

identify, based on a lookup in a data repository, an electronic account corresponding to the input audio signal, the electronic account comprising a profile layer with one or more policies;

establish, responsive to identification of the electronic account, a profile stack data structure with the profile layer from the electronic account and a default profile layer established for the local computing device by a third party different from the electronic account;

parse the data packets or second data packets comprising a second input audio signal detected by the sensor of the local computing device to identify a request;

generate, based on the profile stack data structure, a first action data structure that is responsive to the request;

provide the first action data structure for execution; and

remove, responsive to detection of a trigger event, the profile layer from the profile stack data structure.

2. The system of claim 1 , comprising the data processing system to:

establish a session with the profile stack data structure for use in the session; and

terminate the session by removal of the profile layer.

3. The system of claim 1 , comprising the data processing system to:

perform authentication prior to establishment of the profile stack data structure with the profile layer from the electronic account; and

establish the profile stack data structure with the profile layer from the electronic account responsive to authentication.

4. The system of claim 1 , comprising the data processing system to:

perform multi-factor authentication prior to establishment of the profile stack data structure with the profile layer from the electronic account; and

establish the profile stack data structure with the profile layer from the electronic account responsive to the multi-factor authentication.

5. The system of claim 4 , wherein the multi-factor authentication is based on at least two of a passcode, a password, a pin, a passphrase, a biometric authentication, or a security code transmitted to a mobile device.

6. The system of claim 1 , comprising the local computing device to:

broadcast a pairing signal;

receive, from a client computing device associated with the electronic account, a request to pair with the local computing device;

pair with the client computing device; and

establish the profile stack data structure with the profile layer responsive to pairing with the client computing device.

7. The system of claim 1 , comprising:

the local computing device to pair with a client computing device corresponding to the electronic account; and

the data processing system to establish, responsive to the local computing device pairing with the client computing device, the profile stack data structure with the profile layer.

8. The system of claim 1 , comprising the data processing system to:

identify a location entry stored in a calendar event in the electronic account;

determine the location entry is within a threshold distance from the local computing device;

command, responsive to the determination, the local computing device to transmit a request to pair with a client computing device linked to the electronic account; and

push, responsive to the client computing device paired with the local computing device, the profile layer to the profile stack data structure.

9. The system of claim 1 , comprising the local computing device to:

pair with a client computing device corresponding to the electronic account; and

receive the profile layer from the client computing device.

10. The system of claim 1 , wherein the local computing device adds a wakeup call from the profile layer.

11. The system of claim 1 , comprising the data processing system to:

identify an acoustic signature from the input audio signal; and

identify the electronic account based on the acoustic signature.

12. The system of claim 1 , comprising:

the data processing system to detect the trigger event based on a geographic fence.

13. A method of processing input audio signals, comprising:

receiving, by a data processing system comprising one or more processors and memory, data packets comprising an input audio signal detected by a sensor of a local computing device;

identifying, by the data processing system based on a lookup in a data repository, an electronic account corresponding to the input audio signal, the electronic account comprising a profile layer with one or more policies;

establishing, by the data processing system responsive to identification of the electronic account, a profile stack data structure with the profile layer from the electronic account and a default profile layer established for the local computing device by a third party different from the electronic account;

parsing, by the data processing system, the data packets or second data packets comprising a second input audio signal detected by the sensor of the local computing device to identify a request;

generating, by the data processing system based on the profile stack data structure, a first action data structure that is responsive to the request;

providing, by the data processing system, the first action data structure for execution; and

removing, by the data processing system responsive to detection of a trigger event, the profile layer from the profile stack data structure.

14. The method of claim 13 , comprising:

establishing, by the data processing system, a session with the profile stack data structure for use in the session; and

terminating, by the data processing system, the session by removal of the profile layer.

15. The method of claim 13 , comprising:

performing, by the data processing system, authentication prior to establishment of the profile stack data structure with the profile layer from the electronic account; and

establishing, by the data processing system, the profile stack data structure with the profile layer from the electronic account responsive to authentication.

16. The method of claim 13 , comprising:

performing, by the data processing system, multi-factor authentication prior to establishment of the profile stack data structure with the profile layer from the electronic account; and

establishing, by the data processing system, the profile stack data structure with the profile layer from the electronic account responsive to the multi-factor authentication.

17. The method of claim 16 , wherein the multi-factor authentication is based on at least two of a passcode, a password, a pin, a passphrase, a biometric authentication, or a security code transmitted to a mobile device.

18. The method of claim 13 , comprising:

pairing the local computing device with a client computing device corresponding to the electronic account; and

establishing, by the data processing system responsive to the local computing device pairing with the client computing device, the profile stack data structure with the profile layer.

19. The method of claim 13 , comprising:

identifying a location entry stored in a calendar event in the electronic account;

determining the location entry is within a threshold distance from the local computing device;

commanding, responsive to the determination, the local computing device to transmit a request to pair with a client computing device linked to the electronic account; and

pushing, responsive to the client computing device paired with the local computing device, the profile layer to the profile stack data structure.

20. The method of claim 13 , comprising:

adding a wakeup call from the profile layer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 14, 2020
From: KOTHARI, ANSHUL; JAIN, TARUN; BHAYA, GAURAV; DAVIES, RUXANDRA; TAKEHANA, LISA
To: GOOGLE LLC
Reel/Frame 052666/0326 →
Continuity (3)
Continuation 15966940 · Apr 30, 2018
Continuation In Part 15771613
Related Publication 20200273461A1 · Aug 27, 2020
Cited By (3)
US 12,683,991 US 12,730,883 US 12,739,264