IP Library › Granted Patent US 11,593,232
Granted Patent B2
US 11,593,232 · App. 16/240,003 · Granted Feb 28, 2023

Method and device for verifying a neuron function in a neural network

Inventors: Andre Guntoro (Weil der Stadt, DE); Armin Runge (Wuerzburg, DE); Christoph Schorn (Leonberg, DE); Sebastian Vogel (Schaidt, DE); Jaroslaw Topp (Renningen, DE); Juergen Schirmer (Heidelberg, DE)
Assignee: Robert Bosch GmbH
G06F11/1476G06F17/15G06F17/16G06N3/10G06N20/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,593,232
App. No.
16/240,003
Granted
Feb 28, 2023
Kind
B2
Abstract

A method for verifying a calculation of a neuron value of multiple neurons of a neural network, including: carrying out or triggering a calculation of neuron functions of the multiple neurons, in each case to obtain a neuron value, the neuron functions being determined by individual weightings for each neuron input; calculating a first comparison value as the sum of the neuron values of the multiple neurons; carrying out or triggering a control calculation with one or multiple control neuron functions and with all neuron inputs of the multiple neurons, to obtain a second comparison value as a function of the neuron inputs of the multiple neurons and of the sum of the weightings of the multiple neurons assigned to the respective neuron input; and recognizing an error as a function of the first comparison value and of the second comparison value.

Claims (24)

1. A method for verifying a calculation of a neuron value of multiple neurons of a neural network, the method comprising:

performing or triggering a calculation of neuron functions of each of the multiple neurons, to obtain neuron values, the neuron functions being determined by individual weightings for each neuron input;

calculating a first comparison value as a sum of the neuron values of the multiple neurons;

performing or triggering a control calculation with one or multiple control neuron functions and with all neuron inputs of the multiple neurons, to obtain a second comparison value as a function of the neuron inputs of the multiple neurons and of a sum of the weightings of the multiple neurons assigned to the respective neuron input; and

recognizing an error as a function of the first comparison value and of the second comparison value.

2. The method of claim 1 , wherein the one or the multiple control neuron functions are performed by one or multiple additional provided control neurons.

3. The method of claim 1 , wherein the neuron functions are each determined as a function of a bias value, the neuron values of the multiple neurons being calculated with the aid of the neuron functions as a function of the bias values, the control calculation of the second comparison value with the one or the multiple control neuron functions being performed as a function of a sum of all bias values of the multiple neuron functions.

4. The method of claim 1 , wherein the multiple neurons are parts of multiple kernels for calculating a convolutional neural network based on a multi-dimensional data matrix having multiple channels, the control calculation being performed based on a control kernel, the weightings of the neuron functions of the control kernel being determined by a sum of the weightings of the multiple kernels assigned to a neuron input.

5. The method of claim 4 , wherein the sum of all correlating data points within the multi-dimensional data matrix across all channels is formed as first comparison value, the second comparison value being ascertained by applying the control calculation with the control kernel for a matrix position of the respectively correlating data points.

6. The method of claim 1 , wherein the multiple neurons are parts of a kernel for calculating a convolutional neural network based on a multi-dimensional data matrix, the control calculation being performed based on a number of sums of data values of the data matrix in a verification dimension, the second comparison value being determined as the sum of the products of the weightings of the kernel, in each case with one of the sums of the data values.

7. A verification system for verifying a calculation of neuron values of multiple neurons to be verified of a neural network, comprising:

a summing circuit for calculating a first comparison value as a sum of the neuron values of the multiple neurons, wherein the multiple neurons perform calculations of neuron functions for each of the multiple neurons, to obtain the neuron values, the neuron functions being determined by individual weightings for each neuron input, and wherein at least one control neuron, which is provided to perform a control calculation with one or multiple control neuron functions and with all neuron inputs of the multiple neurons, to obtain a second comparison value as a function of the neuron inputs of the multiple neurons and of a sum of the weightings of the multiple neurons assigned to the respective neuron input; and

a comparison circuit to recognize an error as a function of the first comparison value and of the second comparison value.

8. A non-transitory computer readable medium having a computer program, which is executable by a processor, comprising:

a program code arrangement having program code for verifying a calculation of a neuron value of multiple neurons of a neural network, by performing the following:

performing or triggering a calculation of neuron functions of each of the multiple neurons, to obtain neuron values, the neuron functions being determined by individual weightings for each neuron input;

calculating a first comparison value as a sum of the neuron values of the multiple neurons;

performing or triggering a control calculation with one or multiple control neuron functions and with all neuron inputs of the multiple neurons, to obtain a second comparison value as a function of the neuron inputs of the multiple neurons and of a sum of the weightings of the multiple neurons assigned to the respective neuron input; and

recognizing an error as a function of the first comparison value and of the second comparison value.

9. The computer readable medium of claim 8 , wherein the one or the multiple control neuron functions are performed by one or multiple additional provided control neurons.

10. The computer readable medium of claim 8 , wherein the neuron functions are each determined as a function of a bias value, the neuron values of the multiple neurons being calculated with the aid of the neuron functions as a function of the bias values, the control calculation of the second comparison value with the one or the multiple control neuron functions being performed as a function of a sum of all bias values of the multiple neuron functions.

11. The computer readable medium of claim 8 , wherein the multiple neurons are parts of multiple kernels for calculating a convolutional neural network based on a multi-dimensional data matrix having multiple channels, the control calculation being performed based on a control kernel, the weightings of the neuron functions of the control kernel being determined by a sum of the weightings of the multiple kernels assigned to a neuron input.

12. The computer readable medium of claim 11 , wherein the sum of all correlating data points within the multi-dimensional data matrix across all channels is formed as first comparison value, the second comparison value being ascertained by applying the control calculation with the control kernel for a matrix position of the respectively correlating data points.

13. The computer readable medium of claim 8 , wherein the multiple neurons are parts of a kernel for calculating a convolutional neural network based on a multi-dimensional data matrix, the control calculation being performed based on a number of sums of data values of the data matrix in a verification dimension, the second comparison value being determined as the sum of the products of the weightings of the kernel, in each case with one of the sums of the data values.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2019
From: GUNTORO, ANDRE; RUNGE, ARMIN; SCHORN, CHRISTOPH; VOGEL, SEBASTIAN; TOPP, JAROSLAW; SCHIRMER, JUERGEN
To: ROBERT BOSCH GMBH
Reel/Frame 048820/0706 →
Priority Claims (1)
DE 102018202095.7 · Feb 12, 2018 · national
Continuity (1)
Related Publication 20190251005A1 · Aug 15, 2019