IP Library › Granted Patent US 10,635,926
Granted Patent B2
US 10,635,926 · App. 15/664,480 · Granted Apr 28, 2020

Image analyzing apparatus, image analyzing method, and recording medium

Inventor: Takayuki Hara (Kanagawa, JP)
Assignee: RICOH COMPANY, LTD.
G06K9/4671G06K9/66G06N3/0454G06N3/0472G06N3/08G06T7/11G06N3/0481
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,635,926
App. No.
15/664,480
Granted
Apr 28, 2020
Kind
B2
Abstract

An image analyzing apparatus reprojects an input image in a plurality of different directions to divide the input image into a plurality of partial images, extracts a feature amount from each of the partial images, and calculates a degree of importance of the input image by position from the extracted feature amount in accordance with a predetermined regression model.

Claims (36)

1. An image analyzing apparatus, comprising:

a memory that stores a plurality of instructions; and

processing circuitry that executes the plurality of instructions to:

reproject an input image in a plurality of different directions to divide the input image into a plurality of partial images;

extract a feature amount from each of the partial images;

calculate a degree of importance of each pixel of the input image based on the extracted feature amount and in accordance with a predetermined regression model;

calculate a likelihood distribution of an attention point from the calculated degree of importance of each pixel of the input image in accordance with the predetermined regression model, and

calculate the attention point from the likelihood distribution.

2. The image analyzing apparatus according to claim 1 , wherein the processing circuitry calculates, as the attention point, a position of a pixel corresponding to one of a maximum likelihood value, an average value, and a local maximum value of the likelihood distribution of the attention point.

3. The image analyzing apparatus according to claim 1 , wherein the processing circuitry further executes the plurality of instructions to add the degree of importance to calculate the likelihood distribution of the attention point.

4. The image analyzing apparatus according to claim 1 , wherein the processing circuitry is further configured to train a neural network to

calculate a likelihood distribution of an attention point from the calculated degree of importance of each pixel of the input image in accordance with the predetermined regression model, and

calculate the attention point from the likelihood distribution.

5. The image analyzing apparatus according to claim 1 , wherein the input image is of an equirectangular projection format.

6. The image analyzing apparatus according to claim 5 , wherein the input image includes pixel values plotted on a unit sphere.

7. The image analyzing apparatus according to claim 1 , wherein the input image is an omnidirectional image.

8. The image analyzing apparatus according to claim 1 , wherein the processing circuitry extracts the feature amount from each of the partial images to minimize distortion.

9. The image analyzing apparatus according to claim 1 , wherein the degree of importance of each pixel of the input image is training data for training a neural network.

10. A method for extracting a degree of importance of an input image by position, the method comprising:

reprojecting the input image in a plurality of different directions to divide the input image into a plurality of partial images;

extracting, by processing circuitry of an image analyzing apparatus, a feature amount from each of the partial images;

calculating, by the processing circuitry, a degree of importance of each pixel of the input image based on the extracted feature amount and in accordance with a predetermined regression model;

calculating a likelihood distribution of an attention point from the calculated degree of importance of each pixel in the input image in accordance with the predetermined regression model; and

calculating an attention point from the likelihood distribution.

11. The method according to claim 10 , wherein the calculating the attention point includes calculating a position of a pixel corresponding to one of a maximum likelihood value, an average value, and a local maximum value of the likelihood distribution of the attention point as the attention point.

12. The method according to claim 10 , wherein the calculating the likelihood distribution of the attention point includes adding the degree of importance.

13. An image analyzing apparatus, comprising:

processing circuitry configured to:

reproject an input image in a plurality of different directions to divide the input image into a plurality of partial images;

extract a feature amount from each of the partial images; and

calculate a degree of importance of each pixel of the input image based on the extracted feature amount and in accordance with a predetermined regression model; and

a neural network is configured to

calculate a likelihood distribution of an attention point from the calculated degree of importance of each pixel of the input image in accordance with the predetermined regression model; and

calculate the attention point from the likelihood distribution.

14. The image analyzing apparatus according to claim 13 , wherein the neural network calculates, as the attention point, a position of a pixel corresponding to one of a maximum likelihood value, an average value, and a local maximum value of the likelihood distribution of the attention point.

15. The image analyzing apparatus according to claim 13 , wherein the neural network is further configured to add the degree of importance to calculate the likelihood distribution of the attention point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2017
From: HARA, TAKAYUKI
To: RICOH COMPANY, LTD.
Reel/Frame 043145/0698 →
Priority Claims (1)
JP 2016-153492 · Aug 4, 2016 · national
Continuity (1)
Related Publication 20180039856A1 · Feb 8, 2018
Cited By (2)
US 12,340,549 US 12,360,268