IP Library › Granted Patent US 11,727,545
Granted Patent B2
US 11,727,545 · App. 17/116,553 · Granted Aug 15, 2023

Image processing apparatus and image capturing apparatus

Inventors: Michinori Nakajima (Kanagawa, JP); Hidetaka Uemura (Kanagawa, JP)
Assignee: CANON KABUSHIKI KAISHA
G06T5/006G06T5/003H04N23/55H04N23/683
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,545
App. No.
17/116,553
Granted
Aug 15, 2023
Kind
B2
Abstract

The image processing apparatus generates recording image data by image capturing through an image capturing optical system, and adds information to the recording image data. When the image capturing optical system is an anamorphic optical system, the apparatus adds, to the recording image data, information on a compression rate of the anamorphic optical system, and information indicating a center position of the anamorphic optical system in each of frame images constituting the recording image data.

Claims (40)

1. An image processing apparatus comprising:

at least one processor or circuit configured to execute a plurality of tasks including:

an image data generation task configured to generate recording image data by performing, on each of frame images of captured image data generated by image capturing through an image capturing optical system, electronic image stabilization that clips a part of the frame image of the captured image data so as to reduce image blur; and

an information addition task configured to add meta information to the recording image data,

wherein each frame image of the recording image data is data of image area clipped by the electronic image stabilization, and

wherein the information addition task is configured to add to the recording image data, when the image capturing optical system is an anamorphic optical system, the meta information including a) information on a compression rate of the anamorphic optical system, and b) information on a clipping position of the image area in the electronic image stabilization.

2. The image processing apparatus according to claim 1 , wherein

the information addition task is configured to add to the recording image data, the meta information including information on a clipping magnification ratio of the image area.

3. The image processing apparatus according to claim 2 , wherein the information addition task is configured to further add to the recording image data, the meta information including c) information on a roll angle of the frame image of the recording image data, and d) information on distortion of the frame image of the recording image data.

4. The image processing apparatus according to claim 1 , wherein the information addition task is configured to add to the recording image data, when information acquired from an interchangeable lens including the image capturing optical system indicates that the image capturing optical system is the anamorphic optical system, the meta information including the information on the compression rate and the information indicating the center position.

5. The image processing apparatus according to claim 1 , wherein:

the plurality of tasks further includes a processing task configured to perform, on the frame image of the recording image data, correction processing including at least one of roll correction and distortion correction; and

the processing task is configured to limit the correction processing when the image capturing optical system is the anamorphic optical system.

6. The image processing apparatus according to claim 1 , wherein the information on the compression rate is information based on a compression rate input by a user.

7. The image processing apparatus according to claim 1 , wherein the information of the clipping position of the image area in the electronic image stabilization is information indicating a relation between the clipping position of the image area in the electronic image stabilization and a center position of the anamorphic optical system.

8. The image processing apparatus according to claim 7 , wherein the relation between the clipping position of the image area in the electronic image stabilization and the center position of the anamorphic optical system changes depending on correction amount of the electronic image stabilization.

9. The image processing apparatus according to claim 1 , wherein the information on the clipping position of the image area in the electronic image stabilization changes depending on shake amount of an image capturing apparatus.

10. An image capturing apparatus comprising:

an image sensor configured to capture an optical image formed by an image capturing optical system; and

the image processing apparatus according to claim 1 .

11. The image capturing apparatus according to claim 10 , further comprising a sensor image stabilization unit configured to move the image sensor in a direction intersecting an optical axis of the image capturing optical system.

12. The image capturing apparatus according to claim 10 , further comprising a controller configured to control movement of a correction lens that is included in the image capturing optical system and is movable in a direction intersecting an optical axis of the image capturing optical system.

13. An image processing apparatus comprising:

at least one processor or circuit configured to execute a plurality of tasks including:

an information read-out task configured to read out meta information added to recording image data which is generated by performing electronic image stabilization that clips a part of a frame image of a captured image data so as to reduce image blur; and

a post-processing task configured to perform post-processing on the recording image data,

wherein the post-processing task is configured to perform on the recording image data, as the post-processing, expansion processing based on the meta information including a) information on a compression rate of an anamorphic optical system that is an image capturing optical system used in the image capturing, and b) information on a clipping position of the image area in the electronic image stabilization.

14. The image processing apparatus according to claim 13 , wherein:

the information read-out task is configured to further read out, as the meta information added to the recording image data, information on at least one of a clipping magnification ratio, a roll angle and distortion of each of the frame images; and

the post-processing task is configured to perform, on the frame images, as the post-processing, correction processing including at least one of roll correction and distortion correction based on the information on the at least one of the clipping magnification ratio, the roll angle and the distortion, the information on the compression rate, and the information indicating the center position.

15. The image processing apparatus according to claim 13 , wherein, in the post-processing, a user interface for allowing a user to select one of the compression rate read out by the information read-out task and a compression rate designated separately from the read-out compression rate is displayed.

16. An image processing method comprising the steps of:

generating recording image data by performing, on each of frame images of captured image data generated by image capturing through an image capturing optical system, electronic image stabilization that clips a part of the frame image of the captured image data so as to reduce image blur; and

adding meta information to the recording image data,

wherein each frame image of the recording image data is data of image area clipped by the electronic image stabilization, and

wherein at the step of adding the information, when the image capturing optical system is an anamorphic optical system, the meta information including a) information on a compression rate of the anamorphic optical system, and b) information on a clipping position of the image area in the electronic image stabilization are added to the recording image data.

17. An image processing method comprising the steps of:

reading out meta information added to recording image data which is generated by performing electronic image stabilization that clips a part of a frame image of a captured image data so as to reduce image blur; and

performing post-processing on the recording image data,

wherein, at the step of performing the post-processing, expansion processing as the post-processing is performed on the recording image data based on the meta information including a) information on a compression rate of an anamorphic optical system that is an image capturing optical system used in the image capturing, and b) information on a clipping position of the image area in the electronic image stabilization.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2021
From: NAKAJIMA, MICHINORI; UEMURA, HIDETAKA
To: CANON KABUSHIKI KAISHA
Reel/Frame 055188/0153 →
Priority Claims (2)
JP 2019-224225 · Dec 12, 2019 · national
JP 2020-164055 · Sep 29, 2020 · national
Continuity (1)
Related Publication 20210183023A1 · Jun 17, 2021