Systems and methods for neural network training via local target signal augmentation
Provided herein is an integrated circuit for generating augmented training data, including a host processor configured to receive a signal stream. The integrated circuit also has a co-processor commutatively coupled to the host-processor includes a neural network with at least a first set of weights configured to identify one or more target signals from the signal stream received from the host processor. A plurality of augmentation tools are also accessible to the integrated circuit. Finally, the integrated circuit, coupled computing device or other suitable digital signal processor stores a plurality of the one or more identified target signals, and upon reaching a predetermined threshold of identified target signals, utilizes the plurality of augmentation tools to generate an extended set of target signals, and generates a second set of weights for the neural network based on the extended set of target signals generated by the augmentation tools.
1. An integrated circuit for generating augmented training data, comprising:
a host processor configured to receive a signal stream and compute one or more frequency components;
a co-processor commutatively coupled to the host processor comprising a neural network with at least a first set of weights configured to identify one or more target signals from the signal stream received from the host processor;
wherein the host processor transmits the frequency components to the co-processor;
wherein the neural network of the co-processor performs inference and identifies one or more patterns from among the frequency components;
a plurality of augmentation tools;
wherein the integrated circuit further stores a plurality of the one or more identified target signals, and upon reaching a predetermined number of identified target signals, utilizes the plurality of augmentation tools to generate an extended set of target signals, and generates a second set of weights for the neural network based on the extended set of target signals generated by the augmentation tools; and
wherein one of the first or second set of weights are processed as a set of weight data that is transmitted utilizing hash encryption, or obfuscated as a subset of data within a larger set of data to be transmitted.
2. The integrated circuit of claim 1 , wherein the signal stream comprises an audio data stream.
3. The integrated circuit of claim 2 , wherein the one or more target signals comprise at least one keyword.
4. The integrated circuit of claim 3 , wherein the at least one keyword is spoken by the same user.
5. The integrated circuit of claim 4 , wherein the plurality of one or more identified target signals comprise a plurality of audio recordings of the at least one keyword or key phrase spoken by the same user.
6. The integrated circuit of claim 5 , wherein the plurality of audio recordings of the at least one keyword or key phrase spoken by the same user are of the same keyword or key phrase.
7. The integrated circuit of claim 1 , wherein the plurality of augmentation tools comprise equalization algorithms, noise generating algorithms, pitch-shifting algorithms, and time-shifting algorithms.
8. The integrated circuit of claim 1 , wherein the extended set of target signals is at least one order of magnitude greater than the plurality of the one or more identified target signals.
9. The integrated circuit of claim 1 , wherein second set of weights for the neural network are generated by utilizing the extended set of target signals as training data for the neural network.
10. The integrated circuit of claim 1 , wherein the generation of the extended set of target signals is processed on a remote device.
11. An integrated circuit for generating augmented training data, comprising:
a host processor commutatively coupled to a digital signal processor configured to receive a signal stream and compute one or more frequency components;
a co-processor commutatively coupled to the host processor comprising a neural network with at least a first set of weights configured to identify one or more target signals from the signal stream received from the host processor; and
a plurality of augmentation tools;
wherein the integrated circuit further directs the stores a plurality of the one or more identified target signals, and upon reaching a predetermined number of identified target signals, directs the digital signal processor to utilize the plurality of augmentation tools to generate an extended set of target signals, and a second set of weights for the neural network based on the extended set of target signals generated by the augmentation tools;
wherein the co-processor performs inference and identifies one or more patterns from among the frequency components; and
wherein the first and second set of weights are transmitted utilizing hash encryption, or obfuscated as a subset of data within a larger set of data to be transmitted.
12. The integrated circuit of claim 11 , wherein the signal stream comprises an audio data stream.
13. The integrated circuit of claim 12 , wherein the one or more target signals comprise at least one keyword.
14. The integrated circuit of claim 13 , wherein the at least one keyword is spoken by the same user.
15. The integrated circuit of claim 14 , wherein the plurality of one or more identified target signals comprise a plurality of audio recordings of the at least one keyword or key phrase spoken by the same user.
16. The integrated circuit of claim 15 , wherein the plurality of audio recordings of the at least one keyword or key phrase spoken by the same user are of the same keyword or key phrase.
17. The integrated circuit of claim 11 , wherein the plurality of augmentation tools comprise equalization algorithms, noise generating algorithms, pitch-shifting algorithms, and time-shifting algorithms.
18. The integrated circuit of claim 11 , wherein the extended set of target signals is at least one order of magnitude greater than the plurality of the one or more identified target signals.
19. The integrated circuit of claim 11 , wherein second set of weights for the neural network are generated by utilizing the extended set of target signals as training data for the neural network.
20. The integrated circuit of claim 11 , wherein the generation of the extended set of target signals is processed on a remote device.
21. A method for generating augmented training data, comprising:
receiving a first set of neural network weight data;
receiving a plurality of identified target signals;
computing one or more frequency components;
generating, in response to the received plurality of identified target signals exceeding a first pre-determined number, an extended set of target signals with at least one augmentation tools;
generating a second set of neural network weight data with the extended set of target signals; and
performing an inference and identifying one or more patterns from among the frequency components; and
wherein at least the first set of neural network weight data is transmitted utilizing hash encryption, or obfuscated as a subset of data within a larger set of data to be transmitted.