IP Library Granted Patent US 11,366,472
Granted Patent B1
US 11,366,472 · App. 17/063,984 · Granted Jun 21, 2022

Apparatus and method for monitoring and controlling of a neural network using another neural network implemented on one or more solid-state chips

Inventor: Kenneth A. Abeloe (Carlsbad, CA)
Assignee: APEX ARTIFICIAL INTELLIGENCE INDUSTRIES, INC.
G05D1/0088B60R11/0217B60R11/04B60W30/0956G05D1/0221G06N3/0454G06N3/08G06N5/046G06N20/00G10L13/00G10L13/047G10L15/16G10L15/22B60Q5/006B60R2300/102B60R2300/103G05D2201/0213G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,366,472
App. No.
17/063,984
Granted
Jun 21, 2022
Kind
B1
Abstract

A method of operating an apparatus using a control system that includes at least one neural network. The method includes receiving an input value captured by the apparatus, processing the input value using the at least one neural network of the control system implemented on first one or more solid-state chips, and obtaining an output from the at least one neural network resulting from processing the input value. The method may also include processing the output with another neural network implemented on solid-state chips to determine whether the output breaches a predetermined condition that is unchangeable after an initial installation onto the control system. The aforementioned another neural network is prevented from being retrained. The method may also include the step of using the output from the at least one neural network to control the apparatus unless the output breaches the predetermined condition. Similar corresponding apparatuses are described.

Claims (40)

1. A method of operating an apparatus using a control system, comprising:

processing, using at least one first neural network of the control system implemented on one or more solid-state chips of the control system, an input value from a sensor coupled to the apparatus;

obtaining an output from the at least one first neural network resulting from processing the input value;

processing the output of the at least one first neural network with a second neural network of the control system implemented on a second one or more solid-state chips to obtain an output of the second neural network, the output of the second neural network indicative of whether the output of the at least one first neural network breaches a predetermined operating condition for operating the apparatus, the predetermined operating condition comprising a confidence level of the output of the first neural network;

using the output from the at least one first neural network to control the apparatus unless the output of the second neural network indicates the output of the at least one first neural network breaches the predetermined operating condition; and

re-training the at least one first neural network when the output of the at least one first neural network is determined to breach the predetermined condition.

2. The method of claim 1 , further comprising defining the predetermined condition to prevent a damage to the apparatus.

3. The method of claim 1 , further comprising defining the predetermined condition with a machine recognizable human speech part.

4. The method of claim 1 , wherein the apparatus is a human speech generator with a loudspeaker and the step of using the obtained output further includes the step of generating human speech parts to be played on the loudspeaker.

5. The method of claim 1 , wherein the apparatus is an autonomous land vehicle and the at least one first neural network and the second neural network are the autonomous land vehicle.

6. A method of operating an apparatus using a control system, comprising:

processing, using at least one first neural network of the control system implemented on one or more solid-state chips of the control system, an input value from a sensor coupled to the apparatus;

obtaining an output from the at least one first neural network resulting from processing the input value;

processing the output of the at least one first neural network with a second neural network of the control system implemented on a second one or more solid-state chips to obtain an output of the second neural network, the output of the second neural network indicative of whether the output of the at least one first neural network breaches a predetermined operating condition for operating the apparatus, the predetermined operating condition comprising a confidence level of the output of the first neural network;

in response to determining the obtained output from the at least one first neural network breaches a predetermined condition, replacing nodal values of the at least one first neural network with previously stored nodal values; and

using the output from the at least one first neural network to control the apparatus unless the output of the second neural network indicates the output of the at least one first neural network breaches the predetermined operating condition.

7. The method of claim 1 , wherein the at least one first neural network is trained with a first data set and the second neural network is trained with a second data set, the second data set different than the first data set.

8. An apparatus, comprising:

a controller configured to receive an input value generated by a sensor coupled to the controller, the controller including

at least one first neural network implemented on a first one or more solid-state chips coupled to the controller, the at least one neural network constructed to receive the input value and to generate an output; and

a second neural network implemented on a second one or more solid-state chips constructed to receive the output from the at least one first neural network and determine whether the output breaches a predetermined condition, the predetermined condition comprising a confidence level of the output of the first neural network;

wherein the controller is constructed to operate the apparatus using the output from the at least one neural network unless the confidence level of the output from the at least one first neural network is determined to fall below a predetermined level,

wherein the controller is further constructed to re-train the at least one first neural network when the confidence level of the output from the at least one first neural network falls below the predetermined level.

9. The apparatus of claim 8 , wherein the controller is further constructed to generate a human recognizable notification when the confidence level falls of the output from the at least one first neural network falls below the predetermined level.

10. The apparatus of claim 8 , wherein the predetermined condition is defined to prevent damage to the apparatus.

11. The apparatus of claim 8 , wherein the predetermined condition is defined with a machine recognizable human speech part.

12. The apparatus of claim 8 , wherein the apparatus is an autonomous land vehicle.

13. An apparatus, comprising:

a controller configured to receive an input value generated by a sensor coupled to the controller, the controller including

at least one first neural network implemented on a first one or more solid-state chips coupled to the controller, the at least one neural network constructed to receive the input value and to generate an output; and

a second neural network implemented on a second one or more solid-state chips constructed to receive the output from the at least one first neural network and determine whether the output breaches a predetermined condition, the predetermined condition comprising a confidence level of the output of the first neural network;

wherein the controller is constructed to operate the apparatus using the output from the at least one neural network unless the confidence level of the output from the at least one first neural network is determined to fall below a predetermined level, and

wherein nodal values of the at least one first neural network are replaced by to a previously stored nodal values when the obtained output from the at least one neural network is determined to breach a predetermined condition.

14. The apparatus of claim 8 , wherein the at least one first neural network is trained with a first data set and the second neural network is trained with a second data set, the second data set different than the first data set.

15. An apparatus configured to be operated at least in part by a controller, the apparatus comprising:

at least one first neural network implemented on a first one or more solid-state chips coupled to the controller and constructed to receive an input value from a sensor of the apparatus and to generate an output; and

a second neural network implemented on a second one or more solid-state chips coupled to the at least one first neural network and constructed for determining if the output from the at least one first neural network falls below a confidence level of being a valid output and in a predetermined range of values that are unchangeable after an initial installation onto the control system, and

wherein the controller is configured to operate the apparatus using the output from the at least one first neural network unless the output is determined, by the second neural network, to fall below the confidence level, and wherein nodal values of the at least one first neural network are replaced by previously stored nodal values when the obtained output from the at least one neural network is determined to breach a predetermined condition.

16. The apparatus of claim 15 , wherein the apparatus is an autonomous land vehicle coupled.

17. The apparatus of claim 15 , wherein the at least one first neural network is trained with a first data set and the second neural network is trained with a second data set, the second data set different than the first data set.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 15/991,759 SHOULD BE 15/991,769 PREVIOUSLY RECORDED AT REEL: 66730 FRAME: 991. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 22, 2024
From: ABELOE, KENNETH A.
To: APEX AI INDUSTRIES, LLC
Reel/Frame 066871/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2024
From: ABELOE, KENNETH A.
To: APEX AI INDUSTRIES, LLC
Reel/Frame 066730/0991 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 057920 FRAME: 0648. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 31, 2023
From: ABELOE, KENNETH A.
To: APEX AI INDUSTRIES, LLC
Reel/Frame 063815/0030 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2021
From: ABELOE, KENNETH A.
To: APEX ARTIFICIAL INTELLIGENCE INDUSTRIES, INC.
Reel/Frame 057920/0648 →
Continuity (11)
Continuation 16540916 · Aug 14, 2019
Continuation In Part 16377964 · Apr 8, 2019
Continuation In Part 16363183 · Mar 25, 2019
Continuation 15997192 · Jun 4, 2018
Continuation 15997031 · Jun 4, 2018
Continuation In Part 15997192 · Jun 4, 2018
Continuation In Part 15991769 · May 29, 2018
Continuation In Part 15991769 · May 29, 2018
Provisional Application 62659359 · Apr 18, 2018
Provisional Application 62630596 · Feb 14, 2018
Provisional Application 62612008 · Dec 29, 2017