IP Library Granted Patent US 11,398,060
Granted Patent B2
US 11,398,060 · App. 16/495,041 · Granted Jul 26, 2022

Information processing device, information processing method, and program

Inventors: Masatoshi Takashima (Tokyo, JP); Tetsu Ogawa (Tokyo, JP)
Assignee: Sony Group Corporation
G06T11/00G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,398,060
App. No.
16/495,041
Granted
Jul 26, 2022
Kind
B2
Abstract

An object is to provide, for synthetic information such as synthetic images, images with few errors. Thus, for an acquired image including information regarding a specific wavelength region, for example, an image of a specific region corresponding to a specific positional range in a captured image is extracted. A plurality of pieces of information regarding the specific region extracted from respective captured images captured at different points in time is synthesized to generate a synthetic information. By performing synthesis on the captured images captured at the different points in time during movement, synthetic information with few errors is obtained from an object spanning a wide range.

Claims (42)

1. An information processing device comprising:

an extraction section extracting images of a first specific region and a second specific region in an acquired image including information regarding a specific wavelength region, first extracted images for the first specific region corresponding to a first angle of incidence to an imaging device and second extracted images for the second specific region corresponding to a second angle of incidence to the imaging device that is different from the first angle of incidence; and

a synthesis section synthesizing the images extracted by the extraction section from respective acquired images acquired at different points in time to generate a synthetic image, the synthesizing of the images including a stitching of the first extracted images corresponding to the first angle of incidence in a spatial domain to generate a first synthetic image and a stitching of the second extracted images corresponding to the second angle of incidence in the spatial domain to generate a second synthetic image.

2. The information processing device according to claim 1 , wherein

the extraction section extracts the images of the first and second specific regions as captured images captured by the imaging device.

3. The information processing device according to claim 2 , wherein

the synthesis section executes:

processing of synthesizing a plurality of images of the first specific region extracted by the extraction section from respective captured images captured at different points in time to generate the first synthetic image, and

processing of synthesizing a plurality of images of the second specific region extracted by the extraction section from respective captured images captured at the different points in time to generate the second synthetic image.

4. The information processing device according to claim 1 , wherein

the first angle of incidence is less than or equal to a predetermined angle from a lens system optical axis of the imaging device.

5. The information processing device according to claim 4 , wherein

the second angle of incidence is greater than the first angle of incidence.

6. The information processing device according to claim 1 , wherein

the synthesis section executes processing using positional information on the images resulting from the stitch processing of the first and second extracted images.

7. The information processing device according to claim 1 , wherein

the extraction section executes

processing of extracting images of the first specific region from first captured images captured at different points in time by a first camera of the imaging device, and

processing of extracting images of the second specific region from second captured images captured at different points in time by a second camera of the imaging device; and

the synthesis section executes

processing of synthesizing the images of the first specific region extracted from the first captured images captured at the different points in time to generate the first synthetic image, and

processing of synthesizing the images of the second specific region extracted from the second captured images captured at the different points in time to generate the second synthetic image.

8. The information processing device according to claim 7 , wherein

the extraction section extracts, as images of the first and second specific regions, images of an image region in which the angle of incidence of the object light on imaging elements of the imaging device is less than or equal to a predetermined angle from the lens system optical axis, both from the first captured images and from the second captured images.

9. The information processing device according to claim 1 , wherein

the extraction section sets the first and second specific regions according to the acquired image.

10. The information processing device according to claim 1 , wherein

the extraction section sets the first and second specific regions according to selection information.

11. The information processing device according to claim 2 , wherein

the extraction section executes processing of extracting images of the first and second specific regions from the captured images captured at the different points in time by a line sensor-type imaging device.

12. The information processing device according to claim 1 , further comprising:

a calculation section configured to calculate a first vegetation characteristic using the first synthetic image and a second vegetation characteristic using the second synthetic image, the first vegetation characteristic being different from the second vegetation characteristic.

13. An information processing method executed by an information processing device, comprising:

extracting images of a first specific region and a second specific region in an acquired image including information regarding a specific wavelength region, first extracted images for the first specific region corresponding to a first angle of incidence to an imaging device and second extracted images for the second specific region corresponding to a second angle of incidence to the imaging device that is different from the first angle of incidence; and

synthesizing the extracted images from respective acquired images acquired at different points in time to generate a synthetic image, the synthesizing of the images including a stitching of the first extracted images corresponding to the first angle of incidence in a spatial domain to generate a first synthetic image and a stitching of the second extracted images corresponding to the second angle of incidence in the spatial domain to generate a second synthetic image.

14. A non-transitory computer readable medium storing program code, the program code being executable by a computer to perform operations comprising:

extracting images of a first specific region and a second specific region in an acquired image including information regarding a specific wavelength region, first extracted images for the first specific region corresponding to a first angle of incidence to an imaging device and second extracted images for the second specific region corresponding to a second angle of incidence to the imaging device that is different from the first angle of incidence; and

synthesizing the extracted images from respective acquired images acquired at different points in time to generate a synthetic image, the synthesizing of the images including a stitching of the first extracted images corresponding to the first angle of incidence in a spatial domain to generate a first synthetic image and a stitching of the second extracted images corresponding to the second angle of incidence in the spatial domain to generate a second synthetic image.

15. The non-transitory computer readable medium according to claim 14 , wherein the operations further comprise:

calculating a first vegetation characteristic using the first synthetic image and a second vegetation characteristic using the second synthetic image, the first vegetation characteristic being different from the second vegetation characteristic.

16. The method according to claim 13 , further comprising:

calculating a first vegetation characteristic using the first synthetic image and a second vegetation characteristic using the second synthetic image, the first vegetation characteristic being different from the second vegetation characteristic.

Assignments (2)
CHANGE OF NAME Recorded Apr 13, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 059691/0411 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2019
From: TAKASHIMA, MASATOSHI; OGAWA, TETSU
To: SONY CORPORATION
Reel/Frame 050405/0154 →
Priority Claims (1)
JP JP2017-075043 · Apr 5, 2017 · national
Continuity (1)
Related Publication 20200258265A1 · Aug 13, 2020