IP Library › Granted Patent US 12,513,423
Granted Patent B2
US 12,513,423 · App. 18/544,823 · Granted Dec 30, 2025

Image processing apparatus generating a combined image, image pickup apparatus, and image processing method

Inventor: Yoichi Takahashi (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N25/61G06T5/50G06T5/80G06T7/337H04N23/741H04N23/743H04N25/611G06T2207/20212H04N23/687
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,513,423
App. No.
18/544,823
Granted
Dec 30, 2025
Kind
B2
Abstract

An image processing apparatus is configured to process a plurality of images acquired by sequentially capturing an object image. The image processing apparatus detects a positional shift amount between the plurality of images, generate a combined image by combining the plurality of images that have been aligned based on the positional shift amount, and acquire an optical center position of the combined image based on the positional shift amount. The optical center position is a reference position in performing optical correction processing for the combined image. A correcting amount in the optical correction processing changes according to a distance from the reference position.

Claims (113)

1 . An image processing apparatus configured to process a plurality of images acquired by sequentially capturing an object image, the image processing apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a positional shift amount between the plurality of images,

generate a combined image by combining the plurality of images that have been aligned based on the positional shift amount, and

acquire an optical center position of the combined image based on the positional shift amount,

wherein the plurality of images are RAW data,

wherein the optical center position is a reference position in performing optical correction processing for the combined image,

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein the processor is configured to:

determine whether or not to record the RAW data based on a setting by a user,

perform the optical correction processing for the combined image, record a developed image of the combined image that has received the optical correction processing in a recorder, in a case where it is determined that the RAW data is not to be recorded, and

record the combined image and the optical center position of the combined image in the recorder in a case where it is determined that the RAW data is to be recorded.

2 . The image processing apparatus according to claim 1 , wherein the processor is configured to perform the optical correction processing for the combined image.

3 . The image processing apparatus according to claim 1 , wherein the optical correction processing includes peripheral light amount correction.

4 . The image processing apparatus according to claim 1 , wherein the optical correction processing includes lateral chromatic aberration correction.

5 . The image processing apparatus according to claim 1 , wherein the optical correction processing includes distortion correction.

6 . The image processing apparatus according to claim 1 , wherein the optical correction processing includes image restoration processing.

7 . The image processing apparatus according to claim 1 , wherein the optical center position of the combined image is an average value of optical center positions of the plurality of images combined based on the positional shift amount.

8 . The image processing apparatus according to claim 1 , wherein the processor is configured to acquire the optical center position of the combined image using an average value of optical center positions of the plurality of images in a case where an optical image stabilization mechanism operates during exposure.

9 . The image processing apparatus according to claim 1 , wherein the processor is configured to correct the positional shift amount using a first image among the plurality of images as a reference image.

10 . An image pickup apparatus comprising:

an image sensor;

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a positional shift amount between a plurality of images acquired by sequentially capturing an object image with the image sensor,

generate a combined image by combining the plurality of images that have been aligned based on the positional shift amount, and

acquire an optical center position of the combined image based on the positional shift amount,

wherein the plurality of images are RAW data,

wherein the optical center position is a reference position in performing optical correction processing for the combined image,

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein the processor is configured to:

determine whether or not to record the RAW data based on a setting by a user,

perform the optical correction processing for the combined image, record a developed image of the combined image that has received the optical correction processing in a recorder, in a case where it is determined that the RAW data is not to be recorded, and

record the combined image and the optical center position of the combined image in the recorder in a case where it is determined that the RAW data is to be recorded.

11 . An image processing method for processing a plurality of images acquired by sequentially capturing an object image, the image processing method comprising the steps of:

detecting a positional shift amount between the plurality of images;

generating a combined image by combining the plurality of images that have been aligned based on the positional shift amount; and

acquiring an optical center position of the combined image based on the positional shift amount,

wherein the plurality of images are RAW data,

wherein the optical center position is a reference position in performing optical correction processing for the combined image,

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein determining whether or not to record the RAW data based on a setting by a user,

wherein performing the optical correction processing for the combined image, recording a developed image of the combined image that has received the optical correction processing in a recorder, in a case where it is determined that the RAW data is not to be recorded, and

wherein recording the combined image and the optical center position of the combined image in the recorder in a case where it is determined that the RAW data is to be recorded.

12 . An image processing apparatus configured to process a plurality of images acquired by sequentially capturing an object image, the image processing apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a positional shift amount between the plurality of images,

generate a combined image by combining the plurality of images that have been aligned based on the positional shift amount, and

acquire an optical center position of the combined image based on the positional shift amount,

wherein the optical center position is a reference position in performing optical correction processing for the combined image,

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein the optical center position of the combined image is an average value of optical center positions of the plurality of images combined based on the positional shift amount.

13 . The image processing apparatus according to claim 12 , wherein the processor is configured to perform the optical correction processing for the combined image.

14 . The image processing apparatus according to claim 12 , wherein the processor is configured to record the combined image and the optical center position of the combined image in a recorder.

15 . The image processing apparatus according to claim 12 , wherein the plurality of images are RAW data.

16 . The image processing apparatus according to claim 12 , wherein the optical correction processing includes peripheral light amount correction.

17 . The image processing apparatus according to claim 12 , wherein the optical correction processing includes lateral chromatic aberration correction.

18 . The image processing apparatus according to claim 12 , wherein the optical correction processing includes distortion correction.

19 . The image processing apparatus according to claim 12 , wherein the optical correction processing includes image restoration processing.

20 . The image processing apparatus according to claim 12 , wherein the processor is configured to correct the positional shift amount using a first image among the plurality of images as a reference image.

21 . An image processing apparatus configured to process a plurality of images acquired by sequentially capturing an object image, the image processing apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a positional shift amount between the plurality of images,

generate a combined image by combining the plurality of images that have been aligned based on the positional shift amount, and

acquire an optical center position of the combined image based on the positional shift amount,

wherein the optical center position is a reference position in performing optical correction processing for the combined image,

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein the processor is configured to acquire the optical center position of the combined image using an average value of optical center positions of the plurality of images in a case where an optical image stabilization mechanism operates during exposure.

22 . The image processing apparatus according to claim 21 , wherein the processor is configured to perform the optical correction processing for the combined image.

23 . The image processing apparatus according to claim 21 , wherein the processor is configured to record the combined image and the optical center position of the combined image in a recorder.

24 . The image processing apparatus according to claim 21 , wherein the plurality of images are RAW data.

25 . The image processing apparatus according to claim 21 , wherein the optical correction processing includes peripheral light amount correction.

26 . The image processing apparatus according to claim 21 , wherein the optical correction processing includes lateral chromatic aberration correction.

27 . The image processing apparatus according to claim 21 , wherein the optical correction processing includes distortion correction.

28 . The image processing apparatus according to claim 21 , wherein the optical correction processing includes image restoration processing.

29 . The image processing apparatus according to claim 21 , wherein the processor is configured to correct the positional shift amount using a first image among the plurality of images as a reference image.

30 . An image pickup apparatus comprising:

an image sensor;

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a positional shift amount between a plurality of images acquired by sequentially capturing an object image with the image sensor,

generate a combined image by combining the plurality of images that have been aligned based on the positional shift amount, and

acquire an optical center position of the combined image based on the positional shift amount,

wherein the optical center position is a reference position in performing optical correction processing for the combined image,

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein the optical center position of the combined image is an average value of optical center positions of the plurality of images combined based on the positional shift amount.

31 . An image pickup apparatus comprising:

an image sensor;

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a positional shift amount between a plurality of images acquired by sequentially capturing an object image with the image sensor,

generate a combined image by combining the plurality of images that have been aligned based on the positional shift amount, and

acquire an optical center position of the combined image based on the positional shift amount,

wherein the optical center position is a reference position in performing optical correction processing for the combined image, and

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein the processor is configured to acquire the optical center position of the combined image using an average value of optical center positions of the plurality of images in a case where an optical image stabilization mechanism operates during exposure.

32 . An image processing method for processing a plurality of images acquired by sequentially capturing an object image, the image processing method comprising the steps of:

detecting a positional shift amount between the plurality of images;

generating a combined image by combining the plurality of images that have been aligned based on the positional shift amount; and

acquiring an optical center position of the combined image based on the positional shift amount,

wherein the optical center position is a reference position in performing optical correction processing for the combined image,

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein the optical center position of the combined image is an average value of optical center positions of the plurality of images combined based on the positional shift amount.

33 . An image processing method for processing a plurality of images acquired by sequentially capturing an object image, the image processing method comprising the steps of:

detecting a positional shift amount between the plurality of images;

generating a combined image by combining the plurality of images that have been aligned based on the positional shift amount; and

acquiring an optical center position of the combined image based on the positional shift amount,

wherein the optical center position is a reference position in performing optical correction processing for the combined image, and

wherein a correcting amount in the optical correction processing changes according to a distance from the reference position, and

wherein acquiring the optical center position of the combined image using an average value of optical center positions of the plurality of images in a case where an optical image stabilization mechanism operates during exposure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2024
From: TAKAHASHI, YOICHI
To: CANON KABUSHIKI KAISHA
Reel/Frame 066610/0034 →
Priority Claims (1)
JP 2022-206727 · Dec 23, 2022 · national
Continuity (1)
Related Publication 20240214678A1 · Jun 27, 2024
References Cited (4)
US 20110043667A1 · Kotani · 2011 [cited by examiner]
US 20230316461A1 · Chen · 2023 [cited by examiner]
CN 113905183A · 2022 [cited by examiner]
JP 2008092548A · 2008 [cited by applicant]