IP Library › Granted Patent US 11,416,707
Granted Patent B2
US 11,416,707 · App. 17/108,492 · Granted Aug 16, 2022

Information processing method, information processing system, and information processing apparatus

Inventors: Satoshi Sato (Kyoto, JP); Yasunori Ishii (Osaka, JP); Ryota Fujimura (Kanagawa, JP); Pongsak Lasang (Singapore, SG); Changxin Zhou (Singapore, SG)
Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
G06K9/6256G06V10/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,416,707
App. No.
17/108,492
Granted
Aug 16, 2022
Kind
B2
Abstract

An information processing method is executed by a computer, and includes: obtaining a first image generated by a multi-pinhole camera; extracting at least one point spread function (PSF) in each of a plurality of regions in the first image; obtaining a second image different from the first image, and reference data used in machine learning for the second image; generating a third image, by convolving each of a plurality of regions in the second image with at least one PSF extracted in a corresponding region of the plurality of regions in the first image; and outputting a pair of the reference data and the third image.

Claims (33)

1. An information processing method executed by a computer, the information processing method comprising:

obtaining a first image generated by a multi-pinhole camera;

extracting at least one point spread function (PSF) in each of a plurality of regions in the first image;

obtaining a second image different from the first image, and reference data used in machine learning for the second image;

generating a third image, by convolving each of a plurality of regions in the second image with at least one PSF extracted in a corresponding region of the plurality of regions in the first image; and

outputting a pair of the reference data and the third image.

2. The information processing method according to claim 1 ,

wherein the at least one PSF extracted in each of the plurality of regions in the first image comprises a plurality of PSFs, and

a PSF with which each of the plurality of regions in the second image is convolved is selected from the plurality of PSFs.

3. The information processing method according to claim 2 ,

wherein a plurality of the second images are obtained, and

the PSF selected to convolve each of the plurality of regions in the second image is different between the plurality of the second images.

4. The information processing method according to claim 1 , comprising:

training an inference model by machine learning, using the third image as training data and the reference data.

5. The information processing method according to claim 1 ,

wherein the plurality of regions in the first image and the plurality of regions in the second image correspond one-to-one to each other.

6. The information processing method according to claim 1 ,

wherein the plurality of regions in the first image and the plurality of regions in the second image each include a plurality of pixels.

7. The information processing method according to claim 1 ,

wherein the second image is an image generated by a camera different from the multi-pinhole camera by which the first image is generated.

8. An information processing system, comprising:

a first obtainer that obtains a first image generated by a multi-pinhole camera;

a PSF extractor that extracts at least one point spread function (PSF) in each of a plurality of regions in the first image;

a second obtainer that obtains a second image different from the first image, and reference data used in machine learning for the second image;

an image generator that generates a third image, by convolving each of a plurality of regions in the second image with at least one PSF extracted in a corresponding region of the plurality of regions in the first image; and

an outputter that outputs a pair of the reference data and the third image.

9. An information processing apparatus, comprising:

an obtainer that obtains a fourth image;

a controller that inputs the fourth image to an inference model to obtain an inference result; and

an outputter that outputs data based on the inference result obtained,

wherein the inference model is trained using: reference data used in machine learning for a second image; and a third image as training data,

the third image is generated by convolving each of a plurality of regions in the second image with at least one point spread function (PSF) extracted in a corresponding region of a plurality of regions in a first image that is different from the second image, and

the first image is generated by a multi-pinhole camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2021
From: SATO, SATOSHI; ISHII, YASUNORI; FUJIMURA, RYOTA; LASANG, PONGSAK; ZHOU, CHANGXIN
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 057695/0795 →
Priority Claims (1)
JP JP2020-109061 · Jun 24, 2020 · national
Continuity (2)
Provisional Application 62943494 · Dec 4, 2019
Related Publication 20210174143A1 · Jun 10, 2021