IP Library › Granted Patent US 11,315,235
Granted Patent B2
US 11,315,235 · App. 16/969,838 · Granted Apr 26, 2022

Processing method for performing process on image and processing device using the processing method

Inventor: Toshihide Horii (Osaka, JP)
Assignee: Panasonic Intellectual Property Management Co., Ltd.
G06T7/0004G06F17/15G06N3/04G06N3/08G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,315,235
App. No.
16/969,838
Granted
Apr 26, 2022
Kind
B2
Abstract

An input unit 132 receives an input of an image subject to a process. A processing unit subjects the image input to the input unit 132 to a process of a convolutional neural network in which a fully connected layer is excluded. The convolutional neural network in the processing unit 114 includes a convolutional layer and a pooling layer. An output unit outputs a result of the process in the processing unit 114 . A filter of the convolutional layer in the convolutional neural network in the processing unit 114 is trained to learn the result of the process having a 1×1 spatial dimension.

Claims (54)

1. A processing device comprising,

an input unit that receives an input of an image subject to a process;

a processing unit that subjects the Image Input to the input unit to a process of a convolutional neural network in which a fully connected layer is excluded; and

an output unit that outputs a result of the process in the processing unit,

wherein the convolutional neural network in the processing unit, includes a convolutional layer and a pooling layer;

wherein a filter of the convolutional layer in the convolutional neural network in the processing unit is trained to learn the result of the process having a 1×1 spatial dimension,

wherein a size of the image input to the input unit is larger than a size of an image for learning input to the convolutional neural network when the filter of the convolutional layer is trained for learning, the image for learning corresponding to the result of the process used to train the filter of the convolutional layer Air learning,

wherein the convolutional neural network in the processing unit performs a downsampling process in the convolutional layer and the pooling layer and does not perform an upsampling process, and

wherein the result of the process output from the output unit has a spatial dimension smaller than the size of the image input to the input unit and larger than 1×1 and represents a feature map.

2. A processing device comprising;

an input unit that receives an input of an image subject to a process;

a processing unit that subjects the image input to the input unit to a process of a convolutional neural network to which a fully connected layer is excluded; and

an output unit that outputs a result of the process in the processing unit,

wherein the convolutional neural network in the processing unit includes a convolutional layer and a pooling layer,

wherein a filter of the convolutional layer in the convolutional neural network in the processing unit is trained to learn the result of the process having a 1×1 spatial dimension,

wherein a size of the image input to the input unit is larger than a size of an image for learning input to the convolutional neural network when the filter of the convolutional layer is trained for learning, the image for learning corresponding to the result of the process used to train the taller of the convolutional layer for learning,

wherein the convolutional layer included in the convolutional neural network in the processing unit expands a border of the image by a padding and subjects an expanded image to convolution by successively shifting a filter having a size smaller than a size of the expanded image, and

wherein in the case the filter is applied to include the padding, the processing unit uses, in the padding, one of values in a portion of the image to which the filter is applied.

3. A processing device comprising:

an input unit that receives an input of an image subject to a process;

a processing unit that subjects the image input to the input unit to a process of a convolutional neural network in which a fully connected layer is excluded; and

an output unit that outputs a result of the process in the processing unit,

wherein the convolutional neural network in the processing unit Includes a convolutional layer and a pooling layer,

wherein a filter of the convolutional layer in the convolutional neural network in the processing unit is trained to learn the result of the process having a 1×1 spatial dimension,

wherein a size of the image input to the input unit is larger than a size of an image for learning input to the convolutional neural network when the filter of the convolutional layer is trained for learning, the image for learning corresponding to the result of the process used to train the filter of the convolutional layer for learning,

wherein the convolutional layer included in the convolutional neural network in the processing unit expands a border of the image by a padding and subjects an expanded image to convolution by successively shifting a filter having a size smaller than a size of the expanded image, and

wherein in the case the filter is applied to include the padding, the processing unit uses, in the padding, a statistical value of values in a portion of the image to which the filter is applied.

4. A processing method comprising:

receiving an input of an image subject to a process;

subjecting the input image to a process of a convolutional neural network in which a folly connected layer is excluded; and

outputting a result of the process,

wherein the convolutional neural network includes a convolutional layer and a pooling layer,

wherein a filter of the convolutional layer in the convolutional neural network is trained to learn the result of the process having a 1×1 spatial dimension,

wherein a size of the input image is larger than a size of an image for learning input to the convolutional neural network when the filter of the convolutional layer is trained for learning, the image for learning corresponding to the result of the process used to train the filter of the convolutional layer for learning,

wherein the convolutional neural network performs a downsampling process in the convolutional layer and the pooling layer and does not perform an upsampling process, and

wherein the result of the output process output has a spacial dimension smaller than the size of the Input image and, lamer than 1×1 and represents a feature map.

5. A processing method comprising:

receiving an input of an image subject to a process;

subjecting the input image to a process of a convolutional neural network in which a fully connected layer is excluded; and

outputting a result of the process,

wherein the convolutional neural network includes a convolutional layer and a pooling layer,

wherein a filter of the convolutional layer in the convolutional neural network is trained to learn the result of the process having a 1×1 spatial dimension,

wherein a size of the input image is larger than a size of an image for learning input to the convolutional neural network when the filter of the convolutional layer is trained for learning, the image for learning corresponding to the result of the process used to train the filter of the convolutional layer for learning,

wherein the convolutional layer included in the convolutional neural network expands a border of the Image by a padding and subjects an expanded image to convolution by successively shifting a filter having a size smaller than a size of the expanded image, and

wherein in the case the filter is applied to include the padding, one of values in a portion of the image to which the filter is applied is used in the padding.

6. A processing method comprising:

receiving an input of an image subject to a process;

subjecting the input image to a process of a convolutional neural network in which a fully connected layer is excluded; and

outputting a result of the process,

wherein the convolutional neural network includes a convolutional layer and a pooling layer,

wherein a filter of the convolutional layer in the convolutional neural network is trained to learn the result of the process having a 1×1 spatial dimension,

wherein a size of the input image is larger than a size of an image for learning input to the convolutional neural network when the filter of the convolutional layer is trained for learning, the image for learning corresponding to the result of the process used to train the filter of the convolutional layer for learning,

wherein the convolutional layer included in the convolutional neural network expands a border of the image by a padding and subjects an expanded image to convolution by successively shilling a filter having a size smaller than a size of the expanded image, and

wherein in the case the filter is applied to include the padding, a statistical value of values in a portion of the image to which the filter is applied is used in the padding.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2020
From: HORII, TOSHIHIDE
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 053925/0856 →
Priority Claims (1)
WO PCT/JP2018/005494 · Feb 16, 2018 · international
Continuity (1)
Related Publication 20200380665A1 · Dec 3, 2020
Cited By (2)
US 12,573,189 US 12,694,471