IP Library Granted Patent US 11,804,213
Granted Patent B2
US 11,804,213 · App. 17/365,629 · Granted Oct 31, 2023

Systems and methods for training a control system based on prior audio inputs

Inventors: Bryan James (Davis, CA); Manik Malhotra (Durham, NC)
Assignee: Rovi Guides, Inc.
G10L15/063G10L15/1815G10L15/1822G10L15/22G10L15/02G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,804,213
App. No.
17/365,629
Granted
Oct 31, 2023
Kind
B2
Abstract

Systems and methods are disclosed herein for training a control system based on prior audio inputs. The disclosed systems and methods receive a non-lexical or interjectional audio input. State change indications are also received and stored by the system within a predefined period of time starting from the time the system received the audio input. The system then receives a subsequent audio input. If the audio inputs of both the audio input and the subsequent audio input match, and contextual information for the audio input and the subsequent audio input match, the system stores a match association, comprising a confidence factor, for the subsequent audio input to the audio input in the associative data structure. If the confidence factor is greater than a preconfigured confidence level, the system executes one or more functions based on stored state change indications.

Claims (81)

1. A method comprising:

determining a first audio input comprises a non-lexical sound or an interjection based on a first audio signature;

receiving an indication of at least one state change within a predefined period of time of the first audio input;

in response to receiving the indication of the at least one state change within the predefined period of time, storing, in memory, the first audio input and the indication of the at least one state change;

receiving, by input/output circuitry, a second audio input, wherein the second audio input comprises a second audio signature;

comparing, by control circuitry, the second audio signature to the stored first audio signature;

generating, by the control circuitry, a confidence factor based on the comparing, wherein the confidence factor indicates a likelihood the second audio input matches the first audio input; and

storing, in memory, a match association comprising the confidence factor for use in processing subsequent audio inputs to determine if a subsequent audio input that comprises a non-lexical sound or an interjection is associated with the at least one state change.

2. The method of claim 1 , further comprising:

retrieving, by control circuitry, a first set of contextual information associated with the first audio input corresponding to a predefined period of time from the receipt of the first audio input; and

storing the first set of contextual information in memory such that it is associated with the first audio input.

3. The method of claim 2 , further comprising:

retrieving, by control circuitry, a second set of contextual information associated with the second audio input;

comparing the first set of contextual information to the second set of contextual information;

determining, based on the comparing, the first set of contextual information matches the second set of contextual information; and

in response to the determining, increasing the confidence factor stored as the match association.

4. The method of claim 1 , wherein determining the first audio input comprises the non-lexical sound or the interjection based on the first audio signature comprises:

retrieving, from memory, a lexical sound data structure, wherein the lexical sound data structure comprises a plurality of lexical sounds;

comparing the first audio signature to the plurality of lexical sounds; and

determining, based on the comparing, the first audio signature does not match any of the plurality of lexical sounds.

5. The method of claim 1 , further comprising:

comparing the confidence factor to a preconfigured confidence factor;

in response to determining the confidence factor is greater than the preconfigured confidence factor, executing at least one function based on the indication of the at least one state change.

6. The method of claim 5 , further comprising:

in response to determining the confidence factor is greater than the preconfigured confidence factor, generating selectable options for execution of at least one of a plurality of confirmatory functions;

receiving a selection of one of the selectable options; and

in response to receiving the selection, storing an association between the selected confirmatory function, the first audio input and the second audio input.

7. The method of claim 6 , further comprising:

in response to receiving the selection, executing the selected confirmatory function by transmitting an instruction to a network-connected device, wherein the instruction comprises executable information corresponding to the state change indications.

8. The method of claim 1 , wherein generating the confidence factor comprises:

determining, by the control circuitry, statistical information associated with the comparing; and

calculating, by the control circuitry, the confidence factor by applying a mathematical operation to a previous confidence factor associated with a previous audio input determined to be within a similarity value of the first audio input, wherein the mathematical operation utilizes the statistical information of the comparing.

9. The method of claim 1 , further comprising:

parsing, by the control circuitry, the first audio input into at least one audio component;

identifying, based on the parsing, the first audio signature and a first set of corresponding contextual information;

comparing, by the control circuitry, the at least on audio component to a plurality of audio signal profiles, wherein each of the plurality of audio signal profiles comprise a respective audio signature and respective set of corresponding contextual information;

determining, based on the comparing, the first audio signature match a respective audio signatures of one of the plurality of audio signal profiles; and

in response to the determining, assigning the first set of contextual information to a respective set of contextual information of the one of the plurality of audio signatures.

10. The method of claim 9 , wherein the first set of contextual information comprises metadata corresponding to the audio input.

11. A system comprising:

input/output circuitry configured to:

receive a first audio input comprising a first audio signature;

receive an indication of at least one state change within a predefined period of time of the first audio input;

receive a second audio input, wherein the second audio input comprises a second audio signature; and

control circuitry configured to:

determine a first audio input comprises a non-lexical sound or an interjection based on a first audio signature;

in response to receiving the indication of the at least one state change within the predefined period of time, store, in memory, the first audio input and the indication of the at least one state change;

compare the second audio signature to the stored first audio signature;

generate a confidence factor based on the comparing, wherein the confidence factor indicates a likelihood the second audio input matches the first audio input; and

store, in memory, a match association comprising the confidence factor for use in processing subsequent audio inputs to determine if a subsequent audio input that comprises a non-lexical sound or an interjection is associated with the at least one state change.

12. The system of claim 11 , wherein the control circuitry is further configured to:

retrieve a first set of contextual information associated with the first audio input corresponding to a predefined period of time from the receipt of the first audio input; and

store the first set of contextual information in memory such that it is associated with the first audio input.

13. The system of claim 12 , wherein the control circuitry is further configured to:

retrieve a second set of contextual information associated with the second audio input;

compare the first set of contextual information to the second set of contextual information;

determine, based on the comparing, the first set of contextual information matches the second set of contextual information; and

in response to the determining, increase the confidence factor stored as the match association.

14. The system of claim 11 , wherein the control circuitry configured to determine the first audio input comprises the non-lexical sound or the interjection based on the first audio signature is further configured to:

retrieve from memory, a lexical sound data structure, wherein the lexical sound data structure comprises a plurality of lexical sounds;

compare the first audio signature to the plurality of lexical sounds; and

determine, based on the comparing, the first audio signature does not match any of the plurality of lexical sounds.

15. The system of claim 11 , wherein the control circuitry is further configured to:

comparing the confidence factor to a preconfigured confidence factor;

in response to determining the confidence factor is greater than the preconfigured confidence factor, executing at least one function based on the indication of the at least one state change.

16. The system of claim 15 , wherein the control circuitry is further configured to:

in response to determining the confidence factor is greater than the preconfigured confidence factor, generate selectable options for execution of at least one of a plurality of confirmatory functions;

receive a selection of one of the selectable options; and

in response to receiving the selection, store an association between the selected confirmatory function, the first audio input and the second audio input.

17. The system of claim 16 , wherein the control circuitry is further configured to:

in response to receiving the selection, execute the selected confirmatory function by transmitting an instruction to a network-connected device, wherein the instruction comprises executable information corresponding to the state change indications.

18. The system of claim 11 , wherein the control circuitry configured to generate the confidence factor is further configured to:

determine statistical information associated with the comparing; and

calculate the confidence factor by applying a mathematical operation to a previous confidence factor associated with a previous audio input determined to be within a similarity value of the first audio input, wherein the mathematical operation utilizes the statistical information of the comparing.

19. The system of claim 11 , wherein the control circuitry is further configured to:

parse the first audio input into at least one audio component;

identify, based on the parsing, the first audio signature and a first set of corresponding contextual information;

compare the at least on audio component to a plurality of audio signal profiles, wherein each of the plurality of audio signal profiles comprise a respective audio signature and respective set of corresponding contextual information;

determine, based on the comparing, the first audio signature match a respective audio signatures of one of the plurality of audio signal profiles; and

in response to the determining, assign the first set of contextual information to a respective set of contextual information of the one of the plurality of audio signatures.

20. The system of claim 19 , wherein the control circuitry configured to identify the first set of contextual information is further configured to identify metadata comprising the first set of contextual information.

Assignments (3)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0171 →
SECURITY INTEREST Recorded May 19, 2023
From: ADEIA GUIDES INC.; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063707/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2021
From: JAMES, BRYAN; MALHOTRA, MANIK
To: ROVI GUIDES, INC.
Reel/Frame 056738/0664 →
Continuity (2)
Continuation 16201679 · Nov 27, 2018
Related Publication 20210327414A1 · Oct 21, 2021
Cited By (1)
US 12,293,757