IP Library › Granted Patent US 12,081,863
Granted Patent B2
US 12,081,863 · App. 17/801,422 · Granted Sep 3, 2024

Information processing with alignment of images of first and second imaging devices

Inventors: Kouji Yamamoto (Kanagawa, JP); Kazuya Sento (Kanagawa, JP); Hiroki Takahara (Kanagawa, JP)
Assignee: Sony Group Corporation
H04N23/64G06T7/30G06T7/55H04N23/675H04N23/90H04N23/951
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,081,863
App. No.
17/801,422
Granted
Sep 3, 2024
Kind
B2
Abstract

An information processing apparatus ( 10 ) includes: a deciding unit configured to decide alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on the basis of imaging-related information related to imaging performed by the first imaging device; and an outputting unit configured to output the alignment information.

Claims (51)

1. An information processing apparatus comprising:

a memory storing program code, and

a processor configured to execute the program code to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device, wherein the alignment information is arranged to be used for alignment with the second image; and

outputting the alignment information to the second imaging device.

2. An information processing apparatus comprising:

a memory storing program code, and

a processor configured to execute the program code to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device;

determining whether or not the imaging-related information satisfies a predetermined condition; and

selecting, as the alignment information, at least one of a depth map corresponding to the first image, an image of a vicinity of focus corresponding to a vicinity of a subject focused by adjustment control of a predetermined focal length in the first image, edge information detected from the first image, or the first image on a basis of a determination result of the determining.

3. The information processing apparatus according to claim 2 , wherein the operations further comprise:

determining a presence or absence of unevenness of a subject on a basis of depth distribution information of the subject in the first image, and selecting the depth map as the alignment information in a case where the subject has unevenness.

4. The information processing apparatus according to claim 3 , wherein the operations further comprise:

determining whether or not the subject has unevenness on a basis of whether or not a proportion of pixels within a predetermined depth range to the total number of pixels of the subject is within a predetermined threshold.

5. The information processing apparatus according to claim 2 , wherein

the selecting is to further select a depth to the subject as the alignment information in a case of selecting other than the depth map.

6. An information processing apparatus comprising:

a memory storing program code, and

a processor configured to execute the program code to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device;

determining whether or not the number of pixels whose blur amount exceeds a first predetermined threshold is within a second predetermined threshold in a region other than a vicinity of focus focused by an adjustment control of a focal length; and

selecting, as the alignment information, an image of the vicinity of focus in a case where the number of pixels whose blur amount exceeds the first predetermined threshold is not within the second predetermined threshold in the region other than the vicinity of focus.

7. An information processing apparatus comprising:

a memory storing program code, and

a processor configured to execute the program code to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device;

determining whether or not a transmission band between the first imaging device and the second imaging device is equal to or more than a predetermined threshold; and

selecting, as the alignment information, the first image in a case where the transmission band is equal to or more than the predetermined threshold and selecting, as the alignment information, edge information in a case where the transmission band is not equal to or more than the predetermined threshold.

8. An information processing apparatus comprising:

a memory storing program code, and

a processor configured to execute the program code to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device;

determining whether or not processing capability of the second imaging device is equal to or more than a predetermined threshold; and

selecting, as the alignment information, the first image in a case where the processing capability is equal to or more than the predetermined threshold and selecting, as the alignment information, edge information in a case where the processing capability is not equal to or more than the predetermined threshold.

9. An information processing apparatus comprising:

a memory storing program code, and

a processor configured to execute the program code to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device;

calculating, as a resolution of an overlapping region where an angle of view of the first imaging device and an angle of view of the second imaging device overlap each other, a number of pixels of an imaging sensor of the second imaging device included in the overlapping region; and

generating, as the alignment information, a first image obtained by changing a resolution of the first image to a resolution that matches the resolution of the overlapping region.

10. The information processing apparatus according to claim 9 , wherein

calculating the resolution comprises calculation of the overlapping region in a case where a zoom function is operating in either the first imaging device or the second imaging device.

11. An information processing apparatus comprising:

a memory storing program code, and

a processor configured to execute the program code to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device, wherein the alignment information is arranged to be used for alignment with the first image; and

outputting the alignment information to the first imaging device.

12. A non-transitory computer readable medium storing program code, the program code being executable by a computer to perform operations comprising:

deciding alignment information to be used for alignment between a first image captured by a first imaging device and a second image captured by a second imaging device having an angle of view wider than an angle of view of the first imaging device, on a basis of imaging-related information related to imaging performed by the first imaging device, wherein the alignment information is arranged to be used for alignment with the second image; and

outputting the alignment information to the second imaging device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2022
From: YAMAMOTO, KOUJI; SENTO, KAZUYA; TAKAHARA, HIROKI
To: SONY GROUP CORPORATION
Reel/Frame 060860/0166 →
Priority Claims (1)
JP 2020-050031 · Mar 19, 2020 · national
Continuity (1)
Related Publication 20230085080A1 · Mar 16, 2023
Cited By (1)
US 12,511,717