IP Library Granted Patent US 12,136,032
Granted Patent B2
US 12,136,032 · App. 15/812,118 · Granted Nov 5, 2024

Information estimation apparatus and information estimation method

Inventor: Jingo Adachi (Tokyo, JP)
Assignee: DENSO IT LABORATORY, INC.
G06N3/08G06N3/04G06N3/045G06N3/082G06N7/01G06F7/02G06F7/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,136,032
App. No.
15/812,118
Granted
Nov 5, 2024
Kind
B2
Abstract

A technique for stable and fast computation of a variance representing a confidence interval for an estimation result in an estimation apparatus using a neural network including an integrated layer that combines a dropout layer for dropping out part of input data and an FC layer for computing a weight is provided. When input data having a multivariate distribution is supplied to the integrated layer, a data analysis unit 30 determines, based on a numerical distribution of terms formed by respective products of each vector element of the input data and the weight, a data type of each vector element of output data from the integrated layer. An estimated confidence interval computation unit 20 applies an approximate computation method associated with the data type, to analytically compute a variance of each vector element of the output data from the integrated layer based on the input data to the integrated layer.

Claims (34)

1. In a hardware-based processing unit having implemented thereon a neural network and an information estimation apparatus, the information estimation apparatus using the neural network for performing an estimation process to obtain an estimation result,

wherein the neural network comprises a structure that includes an integrated layer that combines a dropout layer for dropping out a part of input data and a fully connected layer for computing a weight, and

wherein the information estimation apparatus comprises:

a data analysis unit configured to calculate from being acquired input data each vector element of output data of a numerical distribution of terms output from the integrated layer having a multivariate distribution based on

determining a user defined number of peak terms each of which is a product of the acquired input data and a represented weight in the integrated layer by

estimating how much each determined peak term is exceptionally larger than other terms of the numerical distribution of terms, and collecting the peak terms, and

approximating the output from the integrated layer as a sum of dropout and not dropout conditions for all peak terms,

where each peak term is composed of

the product of the probability of dropout condition for all peak terms and

conditional Gaussian distribution under dropout condition which is calculated by dropout sampling sum of the portion of the Gaussian distribution, the portion of the Gaussian distribution excluding the peak terms; and

an estimated confidence interval computation unit configured to apply an optimum approximation computation method associated with the output data calculated by the data analysis unit to analytically compute a variance of each vector element of the output data from the integrated layer based on the input data to the integrated layer;

whereby the computed variances provide a reliable confidence level for the estimation result adapted to be used by at least a mobile object.

2. An information estimation method for performing an estimation process using a hardware-based processing unit having implemented thereon a neural network comprising a structure that includes an integrated layer that combines a dropout layer for dropping out a part of input data and a fully connected layer for computing a weight, the information estimation method comprising:

a data analysis step to calculate from being acquired input data each vector element of output data of a numerical distribution of terms output from the integrated layer having a multivariate distribution based on

determining a user defined number of peak terms each of which is a product of the acquired input data and a represented weight in the integrated layer by

estimating how much each determined peak term is exceptionally larger than other terms of the numerical distribution of terms, and collecting the peak terms, and

approximating the output from the integrated layer as a sum of dropout and not dropout conditions for all peak terms,

where each peak term is composed of

the product of the probability of dropout condition for all peak terms and

conditional Gaussian distribution under dropout condition which is calculated by dropout sampling sum of the portion of the Gaussian distribution, the portion of the Gaussian distribution excluding the peak terms; and

an estimated confidence interval computation step of applying an optimum approximation computation method associated with the output data calculated by the data analysis step to analytically compute a variance of each vector element of the output data from the integrated layer based on the input data to the integrated layer;

whereby the computed variances provide a reliable confidence level for the estimation result adapted to be used by at least a mobile object.

3. A non-transitory computer-readable medium comprising instructions that cause an information estimation unit of a hardware-based processing unit, in response to the instructions, to output an estimation result adapted to be used by at least a mobile object, the instructions causing the information estimation unit to:

perform an estimation process using a neural network implemented on the hardware-based processing unit that includes an integrated layer that combines a dropout layer for dropping out a part of input data and a fully connected layer for computing a weight;

wherein the estimation process comprises:

a data analysis step to calculate from being acquired input data each vector element of output data of a numerical distribution of terms output from the integrated layer having a multivariate distribution based on

determining a user defined number of peak terms each of which is a product of the acquired input data and a represented weight in the integrated layer by

estimating how much each determined peak term is exceptionally larger than other terms of the numerical distribution of terms, and collecting the peak terms, and

approximating the output from the integrated layer as a sum of dropout and not dropout conditions for all peak terms,

where each peak term is composed of

the product of the probability of dropout condition for all peak terms and

conditional Gaussian distribution under dropout condition which is calculated by dropout sampling sum of the portion of the Gaussian distribution, the portion of the Gaussian distribution excluding the peak terms; and

an estimated confidence interval computation step of applying an optimum approximation computation method associated with the output data calculated by the data analysis step to analytically compute a variance of each vector element of the output data from the integrated layer based on the input data to the integrated layer;

whereby the computed variances provide a reliable confidence level for the estimation result to be used by the mobile object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2017
From: ADACHI, JINGO
To: DENSO IT LABORATORY, INC.
Reel/Frame 044430/0219 →
Priority Claims (1)
JP 2016-252813 · Dec 27, 2016 · national
Continuity (1)
Related Publication 20180181865A1 · Jun 28, 2018