IP Library Granted Patent US 10,496,901
Granted Patent B2
US 10,496,901 · App. 15/262,813 · Granted Dec 3, 2019

Image recognition method

Inventors: Min Young Kim (San Jose, CA); Luca Rigazio (Gatos, CA); Ryota Fujimura (Kanagawa, JP); Sotaro Tsukizawa (Osaka, JP); Kazuki Kozuka (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
G06K9/6273
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,496,901
App. No.
15/262,813
Granted
Dec 3, 2019
Kind
B2
Abstract

In an image recognition method executed by a computer of an image recognizer using a convolutional neural network, the convolutional neural network is a first convolutional neural network in which a fully connected layer is changed to a convolutional layer, and the method includes controlling a first convolutional neural network to acquire an input image, controlling the first convolutional neural network to estimate a center area of a recognition target in the acquired input image and to output a value indicating the estimated center area as a location of the recognition target in the input image.

Claims (15)

1. An image recognition method executed by a computer of an image recognizer using a convolutional neural network, the convolutional neural network being a first convolutional neural network in which a fully connected layer is changed to a convolutional layer, the method comprising:

controlling the first convolutional neural network to acquire an input image including a recognition target; and

controlling the first convolutional neural network to perform a recognition process on the input image and as a result of the recognition process to

output only coordinates of two vertices on a diagonal of a rectangle surrounding the recognition target in the acquired input image,

the first convolutional neural network outputting the coordinates as a result of estimating the coordinates of two vertices on the diagonal of the rectangle surrounding the recognition target in the acquired input image, the outputted coordinates being the estimated coordinates of the two vertices on the diagonal of the rectangle as a location of the recognition target in the input image.

2. The image recognition method according to claim 1 , further comprising:

before performing the acquisition of the input image by the first convolutional neural network, controlling the first convolutional neural network to learn a weight of the first convolutional neural network by using learning data including a plurality of sets of a training image and a correct answer image, the training image including a recognition target, the correct answer image including the training image and coordinates of two vertices on a diagonal of a rectangle surrounding the recognition target in the training image and a value indicating a location of a center line indicating a center of the recognition target in the training image.

3. The image recognition method according to claim 2 , wherein the learning includes:

controlling a second convolutional neural network to output a value indicating a location of the recognition target in the training image included in the learning data, the second convolutional neural network having the same structure as that of the first convolutional neural network,

calculating an error, according to an error function, between the output value indicating the location of the recognition target and coordinates of two vertices on a diagonal of a rectangle surrounding the recognition target indicated by the correct answer image corresponding to the training image included in the learning data,

updating a weight of the second convolutional neural network based on the calculated error,

recursively performing the calculation by controlling the second convolutional neural network with the updated weight of the second convolutional neural network to again perform the outputting in the learning, and

in a case where the calculated error achieves a minimum value in the recursive calculation, ending the recursive calculation and determining the weight of the second convolutional neural network assigned when the error achieves the minimum value as the weight of the first convolutional neural network.

4. The image recognition method according to claim 3 , wherein the error function is an error function using a Euclidean distance.

5. The image recognition method according to claim 1 , wherein the recognition target is a person in the input image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: KIM, MIN YOUNG; RIGAZIO, LUCA; FUJIMURA, RYOTA; TSUKIZAWA, SOTARO; KOZUKA, KAZUKI
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 040964/0128 →
Priority Claims (1)
JP 2016-098222 · May 16, 2016 · national
Continuity (2)
Provisional Application 62220535 · Sep 18, 2015
Related Publication 20170083796A1 · Mar 23, 2017
Cited By (1)
US 12,189,713