IP Library Granted Patent US 10,643,608
Granted Patent B2
US 10,643,608 · App. 16/544,367 · Granted May 5, 2020

Feedback controller for data transmissions

Inventors: Gaurav Bhaya (Sunnyvale, CA); Robert James Stets, Jr. (Mountain View, CA)
Assignee: GOOGLE LLC
G10L15/1822G06F16/3329G06F16/3344G06F16/90332G06F40/205G10L15/22G10L25/69G10L25/87G10L25/90H04B17/309H04L65/1069H04L65/602H04L65/80H04L67/20H04L67/22H04L67/42H04M3/2236H04M3/4931G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,643,608
App. No.
16/544,367
Granted
May 5, 2020
Kind
B2
Abstract

A feedback control system for data transmissions in voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a content item using the trigger keyword or request. The content item can be configured to establish a communication session between the device and a third party device. The system can monitor the communication session to measure a characteristic of the communication session. The system can generate a quality signal based on the measured characteristic.

Claims (63)

1. A system for data transmissions over a computer network, comprising:

a data processing system comprising one or more processors and memory;

a natural language processor component executed by the data processing system to:

receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a sensor of a client device;

establish a communication session responsive to the input audio signal; and

parse the input audio signal to identify a request and a keyword associated with the request;

a feedback monitor component to:

determine a characteristic of the communication session based on the input audio signal; and

generate a quality signal based on the characteristic; and

a content selector component executed by the data processing system to:

receive the keyword identified by the natural language processor component;

adjust a real-time content selection process based on the quality signal; and

select a content item responsive to the request and the keyword via the real-time content selection process adjusted based on the quality signal.

2. The system of claim 1 , comprising:

the data processing system to receive second data packets carrying auditory signals transmitted between the client device and a conversational application programming interface that established a second communication session with the client device responsive to interaction with the content item; and

determine a second quality signal based on a second characteristic associated with the second communication session.

3. The system of claim 2 , wherein the conversational application programming interface is executed by a third party provider device or the data processing system.

4. The system of claim 1 , comprising:

the feedback monitor component to forward data packets carrying one or more input audio signals to the natural language processor component to determine a first characteristic of the one or more input audio signals at a first time interval, and a second characteristic of the one or more input audio signals at a second time interval subsequent to the first time interval; and

measure the characteristic based on a comparison of the first characteristic and the second characteristic.

5. The system of claim 1 , wherein the characteristic includes at least one of amplitude, frequency, tempo, tone, or pitch.

6. The system of claim 1 , wherein the characteristic indicates a sentiment of a user associated with the client device.

7. The system of claim 1 , comprising the data processing system to:

determine the characteristic based on at least one of amplitude, frequency, tempo, tone, or pitch; and

determine, based on the characteristic, a sentiment of a user associated with the client device.

8. The system of claim 1 , comprising the data processing system to:

transmit a plurality of voice-based queries to the client device; and

measure the characteristic based on responses to the plurality of voice-based queries.

9. The system of claim 1 , comprising the data processing system to:

generate a query based on the quality signal being less than a threshold;

receive a response to the query from the client device; and

generate a second quality signal based on the response.

10. The system of claim 1 , comprising:

the data processing system to measure the characteristic based on a duration of the communication session.

11. The system of claim 1 , comprising the data processing system to:

measure the characteristic based on network activity on multiple electronic surfaces; and

aggregate quality signals measured from the multiple electronic surfaces to generate a summed quality signal.

12. The system of claim 1 , comprising:

the data processing system to prevent the content selector component from selection, during the communication session, of a second content item responsive to the quality signal being less than or equal to a threshold.

13. The system of claim 1 , comprising:

the data processing system to permit the content selector component to select, during the communication session, a second content item responsive to the quality signal being greater than or equal to a threshold.

14. The system of claim 1 , comprising:

the feedback monitor component to determine a reaction of a user associated with the input audio signal based on the characteristic of the communication session.

15. A method of feedback control for data transmissions over a computer network, comprising:

receiving, by a data processing system comprising one or more processors, data packets comprising an input audio signal detected by a sensor of a client device;

establishing, by the data processing system, a communication session responsive to the input audio signal;

parsing, by the data processing system, the input audio signal to identify a request and a keyword associated with the request;

determining, by the data processing system, a characteristic of the communication session based on the input audio signal;

generating, by the data processing system, a quality signal based on the characteristic;

adjusting, by the data processing system, a real-time content selection process based on the quality signal;

selecting, by the data processing system, a content item responsive to the request and the keyword via the real-time content selection process adjusted based on the quality signal.

16. The method of claim 15 , comprising:

receiving second data packets carrying auditory signals transmitted between the client device and a conversational application programming interface that established a second communication session with the client device responsive to interaction with the content item; and

determining a second quality signal based on a second characteristic associated with the second communication session.

17. The method of claim 15 , comprising:

receiving data packets carrying one or more input audio signals;

determining a first characteristic of the one or more input audio signals at a first time interval, and a second characteristic of the one or more input audio signals at a second time interval subsequent to the first time interval; and

measuring the characteristic based on a comparison of the first characteristic and the second characteristic.

18. The method of claim 15 , wherein the characteristic includes at least one of amplitude, frequency, tempo, tone, or pitch.

19. The method of claim 15 , wherein the characteristic indicates a sentiment of a user associated with the client device.

20. The method of claim 15 , comprising:

transmitting a plurality of voice-based queries to the client device; and

measuring the characteristic based on responses to the plurality of voice-based queries.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2019
From: BHAYA, GAURAV; STETS, ROBERT JAMES, JR
To: GOOGLE INC.
Reel/Frame 050092/0418 →
CHANGE OF NAME Recorded Aug 19, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 050093/0037 →
Continuity (2)
Continuation 15395694 · Dec 30, 2016
Related Publication 20190371306A1 · Dec 5, 2019