IP Library › Granted Patent US 11,418,714
Granted Patent B2
US 11,418,714 · App. 16/924,956 · Granted Aug 16, 2022

Image processing device, method of processing image, image processing program, and imaging device

Inventors: Toshiki Ono (Tokyo, JP); Ryuji Shibata (Kanagawa, JP)
Assignee: Sony Group Corporation
H04N5/232939G06T5/003G06V10/42G06V40/161H04N5/23218H04N5/23219H04N5/232122H04N5/232123H04N5/232935
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,418,714
App. No.
16/924,956
Filed
Jul 9, 2020
Granted
Aug 16, 2022
Kind
B2
Examiner
SETH, MANAV
Art Unit
2662
USPC
382/255
Abstract

An information processing system configured to perform predetermined processing based on out-of-focus information corresponding to a first area of an image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image.

Claims (45)

1. An image capturing apparatus comprising:

an imaging element configured to generate an image;

an image memory; and

circuitry configured to

retrieve, in an absence of an image capture operation, the image temporarily stored in the image memory,

perform predetermined processing based on out-of-focus information corresponding to a first area of the image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image,

perform the image capture operation after performing the predetermined processing, and

record a captured image based on the image capture operation that is performed after performing the predetermined processing.

2. The image capturing apparatus of claim 1 , wherein the circuitry is configured to:

identify the first area of the image,

determine first focus information associated with the first area,

identify the second area of the image that is different from the first area of the image,

determine second focus information associated with the second area, and

acquire the out-of-focus information corresponding to the first area of the image by determining the difference in focus based on a difference between the first focus information and the second focus information.

3. The image capturing apparatus of claim 2 , wherein the second area of the image is an in-focus area of the image.

4. The image capturing apparatus of claim 3 , wherein the predetermined processing includes outputting a notification corresponding to the out-of-focus information.

5. The image capturing apparatus of claim 2 , wherein the predetermined processing includes controlling a display to display a notification indicating an out-of-focus amount based on the out-of-focus information.

6. The image capturing apparatus of claim 5 , wherein the circuitry is configured to control the display to display the image and the notification simultaneously.

7. The image capturing apparatus of claim 5 , wherein the circuitry is configured to control the display to display the image with the notification superimposed on the displayed image.

8. The image capturing apparatus of claim 1 , wherein the predetermined processing includes controlling a display to display a bar graph indicating an out-of-focus amount based on the out-of-focus information.

9. The image capturing apparatus of claim 8 , wherein a height of the bar graph corresponds to a range of the out-of-focus amount that may be realized based on at least one of the second area, a focal distance and a maximum aperture of a lens capturing the image.

10. The image capturing apparatus of claim 1 , wherein the predetermined processing includes controlling a display to display an enlarged version of the image including the first area and the second area.

11. The image capturing apparatus of claim 10 , wherein an enlargement range of the enlarged version of the image is set so that a first display area corresponding to the first area and a second display area corresponding to the second area are substantially similar.

12. The image capturing apparatus of claim 10 , wherein the circuitry is configured to control the display to display the image and the enlarged version of the image simultaneously.

13. The image capturing apparatus of claim 10 , wherein the circuitry is configured to control the display to display the enlarged version of the image superimposed on the image.

14. The image capturing apparatus of claim 1 , wherein the predetermined processing includes controlling a display to display the image while applying a graphical effect to the first area of the image.

15. The image capturing apparatus of claim 1 , wherein the predetermined processing includes trimming the image based on the out-of-focus information.

16. The image capturing apparatus of claim 15 , wherein the circuitry is configured to control a display to display the trimmed image.

17. The image capturing apparatus of claim 1 , wherein the predetermined processing includes generating a first trimmed version of the image and a second trimmed version of the image based on the out-of-focus information.

18. The image capturing apparatus of claim 1 , wherein the predetermined processing includes generating a first trimmed version of the image and a second trimmed version of the image based on the out-of-focus information.

19. The image capturing apparatus of claim 18 , wherein the circuitry is configured to control a display to display the first trimmed version of the image and the second trimmed version of the image.

20. An information processing method comprising:

generating, with an imaging element, an image;

retrieving, with circuitry and in an absence of an image capture operation, the image that is temporarily stored in an image memory;

identifying, with the circuitry, a first area of the image;

performing, with the circuitry, predetermined processing based on out-of-focus information corresponding to the first area of the image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image;

performing, with the circuitry, the image capture operation after performing the predetermined processing; and

recording, with the circuitry, a captured image based on the image capture operation that is performed after performing the predetermined processing.

21. A non-transitory computer-readable medium including computer-program instructions that, when executed by an electronic processor, cause the electronic processor to perform a set of operations comprising:

controlling an imaging element to generate an image;

retrieving, in an absence of an image capture operation, the image temporarily stored in an image memory;

identifying a first area of the image;

performing predetermined processing based on out-of-focus information corresponding to the first area of the image, the out-of-focus information corresponding to a difference in focus between the first area of the image and a second area of the image that is different from the first area of the image;

performing the image capture operation after performing the predetermined processing; and

recording a captured image based on the image capture operation that is performed after performing the predetermined processing.

Priority Claims (1)
JP 2013-152937 · Jul 23, 2013 · national
Continuity (3)
Continuation 16557240 · Aug 30, 2019
Continuation 14894435
Related Publication 20200344407A1 · Oct 29, 2020