IP Library Granted Patent US 11,373,091
Granted Patent B2
US 11,373,091 · App. 16/164,671 · Granted Jun 28, 2022

Systems and methods for customizing neural networks

Inventors: Kurt F. Busch (Laguna Hills, CA); Pieter Vorenkamp (Laguna Beach, CA); Stephen W. Bailey (Irvine, CA)
Assignee: Syntiant
G06N3/08G06F8/65G06F16/16G06N3/0635G06N3/105
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,373,091
App. No.
16/164,671
Granted
Jun 28, 2022
Kind
B2
Abstract

Provided herein is a system including, in some embodiments, one or more servers and one or more database servers configured to receive user-specific target information from a client application for training a neural network on a neuromorphic integrated circuit. The one or more database servers are configured to merge the user-specific target information with existing target information to form merged target information in the one or more databases. The system further includes a training set builder and a trainer. The training set builder is configured to build a training set for training a software-based version of the neural network from the merged target information. The trainer is configured to train the software-based version of the neural network with the training set to determine a set of synaptic weights for the neural network on the neuromorphic integrated circuit.

Claims (47)

1. A system for customizing neural networks, comprising:

one or more web application servers comprising a microprocessor configured to receive user-specific target information from a client application for training a neural network on an integrated circuit;

one or more database servers comprising a microprocessor configured to:

(i) receive the user-specific target information from the one or more web application servers and

(ii) merge the user-specific target information in one or more databases including existing target information to form merged target information in the one or more databases, wherein if a first user-specific target information includes background information which already exists in the one or more database servers as an existing target information, the first user-specific target information is re-labeled as a background information;

wherein the system is configured to build a training set for training a software-based version of the neural network from the merged target information and

to train the software-based version of the neural network with the training set to determine a set of synaptic weights for the neural network on the integrated circuit.

2. The system of claim 1 , wherein the system is further configured to build the training set to use existing training for the existing target information.

3. The system of claim 1 , wherein the system is further configured to update the synaptic weights for the software-based neural network for previously learned existing target information in view of newly learned user-specific target information.

4. The system of claim 1 ,

wherein the system is further configured to build a file of the set of synaptic weights for updating firmware of the integrated circuit including the neural network.

5. The system of claim 4 , wherein the one or more web application servers are further configured to provide the file to the client application for updating the firmware of the integrated circuit with the set of synaptic weights for the neural network.

6. A system for customizing neural networks, comprising:

one or more web application servers comprising a microprocessor configured to receive user-specific target information from a client application for training a neural network on an integrated circuit;

one or more database servers comprising a microprocessor configured to:

(i) receive the user-specific target information from the one or more servers and

(ii) merge the user-specific target information in one or more databases including existing target information to form merged target information in the one or more databases, wherein if a first user-specific target information includes background information which already exists in the one or more database servers as an existing target information, the first user-specific target information is re-labeled as a background information;

wherein the system is configured to build a training set for training a software-based version of the neural network from the merged target information;

wherein the system is configured to train the software-based version of the neural network with the training set to determine a set of synaptic weights for the neural network on the integrated circuit; and

wherein the system is further configured to build a file of the set of synaptic weights for updating firmware of the integrated circuit including the neural network.

7. The system of claim 6 , wherein the system is further configured to build the training set to use existing training for the existing target information.

8. The system of claim 7 , wherein the system is further configured to update the synaptic weights for the software-based neural network for previously learned existing target information in view of newly learned user-specific target information.

9. The system of claim 8 , wherein the one or more web application servers are further configured to provide the file to the client application for updating the firmware of the integrated circuit with the set of synaptic weights for the neural network.

10. A method for customizing neural networks, comprising:

receiving, by one or more servers, user-specific target information from a client application for training a neural network on an integrated circuit;

receiving, by one or more database servers, the user-specific target information from the one or more servers;

merging the user-specific target information in one or more databases including existing target information to form merged target information in the one or more databases, wherein upon a determination that a first user-specific target information includes background information which already exists in the one or more database servers as an existing target information, the first user-specific target information is re-labeled as a background information;

building a training set with a training set builder, the training set for training a software-based version of the neural network from the merged target information; and

training with a trainer the software-based version of the neural network on the training set to determine a set of synaptic weights for the neural network on the integrated circuit.

11. The method of claim 10 , further comprising:

labeling the target information in the one or more databases before merging the user-specific target information in the one or more databases, wherein the labeling includes labeling keywords for keyword spotting.

12. The method of claim 10 , wherein building the training set includes building the training set configured to use existing training for the existing target information.

13. The method of claim 10 , further comprising:

updating, with the trainer, the synaptic weights for the software-based neural network for previously learned existing target information in view of newly learned user-specific target information, wherein the updating includes training the software-based neural network on information other than the existing target information already learned.

14. The method of claim 10 , further comprising:

building, with a file builder, a file of the set of synaptic weights for updating firmware of the integrated circuit including the neural network.

15. The method of claim 14 , further comprising:

providing the file to the client application, thereby allowing the firmware of the integrated circuit to be updated with the set of synaptic weights for the neural network.

16. The method of claim 10 ,

wherein the software-based neural network is configured to recognize one or more desired target information and disregard the background information.

17. The method of claim 16 , further comprising:

updating, with the trainer, the synaptic weights for the software-based neural network for previously learned existing target information in view of newly learned user-specific target information, wherein the updating includes training the software-based neural network on information other than the existing target information already learned.

18. The method of claim 17 , further comprising:

building, with a file builder, a file of the set of synaptic weights for updating firmware of the integrated circuit including the neural network.

19. The method of claim 18 , further comprising:

providing the file to the client application, thereby allowing the firmware of the integrated circuit to be updated with the set of synaptic weights for the neural network.

20. The method of claim 19 , wherein building the training set includes building the training set configured to use existing training for the existing target information.

Assignments (2)
SECURITY INTEREST Recorded Dec 27, 2024
From: SYNTIANT CORP.; PILOT AI LABS, INC.; SYNTIANT TAIWAN LLC; SYNTIANT HOLDINGS LLC
To: OCEAN II PLO LLC
Reel/Frame 069687/0757 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2019
From: BUSCH, KURT F.; VORENKAMP, PIETER; BAILEY, STEPHEN W.
To: SYNTIANT
Reel/Frame 048373/0977 →
Continuity (2)
Provisional Application 62574650 · Oct 19, 2017
Related Publication 20190122109A1 · Apr 25, 2019