IP Library Granted Patent US 10,431,209
Granted Patent B2
US 10,431,209 · App. 15/395,694 · Granted Oct 1, 2019

Feedback controller for data transmissions

Inventors: Gaurav Bhaya (Sunnyvale, CA); Robert Stets (Mountain View, CA)
Assignee: Google LLC
G10L15/1822G06F16/3329G06F16/3344G06F16/90332G06F17/2705G10L15/22G10L25/69G10L25/87G10L25/90H04B17/309H04L65/1069H04L65/602H04L65/80H04L67/20H04L67/22H04L67/42H04M3/2236H04M3/4931G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,431,209
App. No.
15/395,694
Granted
Oct 1, 2019
Kind
B2
Abstract

A feedback control system for data transmissions in voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a content item using the trigger keyword or request. The content item can be configured to establish a communication session between the device and a third party device. The system can monitor the communication session to measure a characteristic of the communication session. The system can generate a quality signal based on the measured characteristic.

Claims (57)

1. A feedback control system for data transmissions over a computer network, comprising:

a natural language processor component executed by a data processing system to receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a sensor of a client device;

the natural language processor component to parse the input audio signal to identify a request and a trigger keyword corresponding to the request;

a content selector component executed by the data processing system to receive the trigger keyword identified by the natural language processor component and to select, based on the trigger keyword, a content item via a real-time content selection process;

a feedback monitor component to:

receive data packets carrying auditory signals transmitted between the client device and a conversational application programming interface that established a communication session with the client device responsive to interaction with the content item;

measure a characteristic of the communication session based on the auditory signals; and

generate a quality signal based on the measured characteristic; and

the content selector component to adjust the real-time content selection process based on the quality signal.

2. The system of claim 1 , comprising the conversational application programming interface executed by the data processing system.

3. The system of claim 1 , comprising the conversational application programming interface executed by a third party provider device.

4. The system of claim 1 , comprising the data processing system to:

intercept the data packets transmitted from the client device;

parse the data packets to identify a third party device; and

route the data packets to the third party device.

5. The system of claim 1 , comprising the data processing system to:

parse the data packets to determine an absence of auditory signals; and

generate the quality signal indicating a low level of quality based on the absence of the auditory signals.

6. The system of claim 1 , comprising:

the feedback monitor component to forward the data packets carrying the auditory signals to the natural language processor component to determine a first characteristic of the auditory signals at a first time interval, and a second characteristic of the auditory signals at a second time interval subsequent to the first time interval; and

measure the characteristic based on a comparison of the first characteristic and the second characteristic.

7. The system of claim 6 , wherein the first characteristic and the second characteristic include at least one of amplitude, frequency, tempo, tone, and pitch.

8. The system of claim 1 , comprising the data processing system to:

transmit a plurality of voice-based queries to the client device; and

measure the characteristic based on responses to the plurality of voice-based queries.

9. The system of claim 1 , comprising the data processing system to:

generate a query based on the quality signal being less than a threshold;

receive a response to the query from the client device; and

generate a second quality signal based on the response.

10. The system of claim 1 , comprising the data processing system to:

measure the characteristic based on a duration of the communication session.

11. The system of claim 1 , comprising the data processing system to:

measure the characteristic based on network activity on multiple electronic surfaces; and

aggregate quality signals measured from the multiple electronic surfaces to generate a summed quality signal.

12. The system of claim 1 , comprising the data processing system to:

prevent the content selector component from selection, in the real-time content selection process, of the content item responsive to the quality signal being less than a threshold.

13. The system of claim 1 , comprising:

permit the content selector component to select, in the real-time content selection process, the content item responsive to the quality signal being greater than or equal to a threshold.

14. A method of transmitting data over a computer network using a feedback control system, comprising:

receiving, by a natural language processor component executed by a data processing system, via an interface of the data processing system, data packets comprising an input audio signal detected by a sensor of a client device;

parsing, by the data processing system, the input audio signal to identify a request and a trigger keyword corresponding to the request;

receiving, by a content selector component executed by the data processing system, the trigger keyword identified by the natural language processor component;

selecting, by the content selector component, based on the trigger keyword, a content item via a real-time content selection process;

receiving, by a feedback monitor component, data packets carrying auditory signals transmitted between the client device and a conversational application programming interface that established a communication session with the client device responsive to interaction with the content item;

measuring, by the feedback monitor component, a quality of the communication session based on the auditory signals;

generating, by the feedback monitor component, a quality signal based on the measured characteristic; and

adjusting, by the content selector component, the real-time content selection process based on the quality signal.

15. The method of claim 14 , comprising:

forwarding, by the feedback monitor component, the data packets carrying the auditory signals to the natural language processor component to determine a first characteristic of the auditory signals at a first time interval, and a second characteristic of the auditory signals at a second time interval subsequent to the first time interval; and

measuring, by the feedback monitor component, the quality based on a comparison of the first characteristic and the second characteristic.

16. The method of claim 15 , wherein the first characteristic and the second characteristic include at least one of amplitude, frequency, tempo, tone, and pitch.

17. The system of claim 1 , comprising:

the feedback monitor component to determine a reaction of a user associated with the input audio signal based on the characteristic of the communication session.

18. The system of claim 1 , comprising:

the content selector component to adjust the real-time content selection process based on the quality signal, wherein the characteristic of the communication session is indicative of a sentiment of a user associated with the client device.

19. The system of claim 1 , wherein the characteristic of the communication session includes at least one of amplitude, frequency, tempo, tone, and pitch.

20. The method of claim 14 , wherein the auditory signals indicate at least one of amplitude, frequency, tempo, tone, and pitch.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2017
From: BHAYA, GAURAV; STETS, ROBERT JAMES, JR
To: GOOGLE INC.
Reel/Frame 041125/0670 →
Continuity (1)
Related Publication 20180190271A1 · Jul 5, 2018
Cited By (1)
US 12,200,166