IP Library Granted Patent US 9,418,436
Granted Patent B2
US 9,418,436 · App. 14/110,210 · Granted Aug 16, 2016

Image processing apparatus, imaging apparatus, and image processing method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,418,436
App. No.
14/110,210
Granted
Aug 16, 2016
Kind
B2
Abstract

An image processing apparatus includes: an image obtainment unit that obtains an image; an information obtainment unit that obtains embedment information that is to be embedded into a region within the image obtained by the image obtainment unit; a depth information obtainment unit that obtains depth information indicating a depth value of each pixel in the image obtained by the image obtainment unit; and an embedment region determination unit that determines, using the depth information, an embedment region into which the embedment information is to be embedded.

Claims (56)

1. An image processing apparatus comprising:

a microprocessor;

an image obtainment unit configured to obtain an image;

an embedment information obtainment unit configured to obtain embedment information that is to be embedded into a region within the image;

a depth information obtainment unit configured to obtain depth information indicating a depth value of each of pixels in the image;

an embedment region determination unit configured to:

set, using the depth information, a search region that is a portion of the image and made up of a plurality of the pixels each having a depth value indicating a position further back than a position indicated by a predetermined depth value; and

determine, in the portion that is the set search region, an embedment region that is the region into which the embedment information is to be embedded; and

a display unit configured to display the image,

wherein the display unit is configured to display a notification message to a user when the embedment region which meets a condition used for determining the embedment region is not present, the notification message indicating that the embedment region is not present.

2. The image processing apparatus according to claim 1 , further comprising

a subject position detection unit configured to detect a subject position in the image, to obtain subject position information indicating the subject position, the subject position being a position of a predetermined subject included in the image,

wherein the embedment region determination unit is configured to determine, using the depth information and the subject position information, the embedment region which is made up of a plurality of the pixels each having a depth value indicating a position further back than a position indicated by a depth value of a pixel at the subject position.

3. The image processing apparatus according to claim 2 ,

wherein the subject position detection unit is configured to detect, as the subject position in the image, a position of a human face included in the image, to obtain the subject position information which indicates the position of the human face as the subject position.

4. The image processing apparatus according to claim 1 ,

wherein the embedment region determination unit is configured to determine, using the depth information, the embedment region which is made up of a plurality of the pixels each having a depth value within a predetermined range from a predetermined depth value.

5. The image processing apparatus according to claim 1 ,

wherein the embedment region determination unit is configured to determine, using the depth information, the embedment region which is made up of a plurality of the pixels each having a depth value within a predetermined range from a depth value whose frequency of appearance in depth values of the pixels is at a peak.

6. The image processing apparatus according to claim 1 ,

wherein the embedment region determination unit is configured to determine, using the depth information, the embedment region which is made up of a plurality of the pixels each having a depth value indicating a position further back than a position indicated by a predetermined depth value, the depth value being within a predetermined range from a depth value whose frequency of appearance in depth values of the pixels is at a peak.

7. The image processing apparatus according to claim 1 ,

wherein the depth information obtainment unit is configured to obtain the depth information which includes information indicating reliability of the depth value of each of the pixels in the image.

8. The image processing apparatus according to claim 7 ,

wherein the embedment region determination unit is configured to determine, using the depth information, the embedment region which includes a pixel which has a depth value with reliability lower than predetermined reliability.

9. The image processing apparatus according to claim 1 ,

wherein the embedment region determination unit is configured to determine, using the depth information, the embedment region from a region excluding a subject position in the image, the subject position being a position of a predetermined subject included in the image.

10. The image processing apparatus according to claim 1 ,

wherein the embedment region determination unit is configured to set a size of the embedment region using an amount of the embedment information obtained by the embedment information obtainment unit, and determine the embedment region which has the set size.

11. The image processing apparatus according to claim 1 ,

wherein the embedment region determination unit is configured to determine the embedment region from a region excluding a subject position in the image, when the embedment region which meets a condition used for determining the embedment region using the depth information is not present, the subject position being a position of a predetermined subject included in the image.

12. The image processing apparatus according to claim 1 , further comprising:

a depth value determination unit configured to determine a depth value of the embedment information; and

an embedment unit configured to embed the embedment information into the embedment region within the image using the depth value determined by the depth value determination unit.

13. The image processing apparatus according to claim 12 ,

wherein the depth value determination unit is configured to determine the depth value of the embedment information which is to be embedded into the embedment region determined from a region excluding a subject position in the image, to be a depth value indicating a position further forward than a position indicated by a depth value at the subject position, when the embedment region which meets a condition used for determining the embedment region using the depth information is not present, the subject position being a position of a predetermined subject included in the image.

14. The image processing apparatus according to claim 12 ,

wherein the depth value determination unit is configured to determine the depth value of the embedment information to be a depth value of the same degree as a depth value at a subject position in the image, the subject position being a position of a predetermined subject included in the image.

15. The image processing apparatus according to claim 4 ,

wherein the depth value determination unit is configured to determine the depth value of the embedment information which is to be embedded into the embedment region determined from a region excluding a subject position in the image, to be a depth value indicating a position further forward than a position indicated by a depth value at the subject position, when the embedment region which meets a condition used for determining the embedment region using the depth information is not present, the subject position being a position of a predetermined subject included in the image.

16. The image processing apparatus according to claim 1 ,

wherein the embedment information obtainment unit is configured to obtain the embedment information which includes at least one of text, a decoration part, a frame, and an image.

17. The image processing apparatus according to claim 1 ,

wherein the embedment region determination unit is configured to determine, using the depth information, whether or not a predetermined subject included in the image is close, when the embedment region which meets the condition used for determining the embedment region is not present, and

the display unit is configured to display the notification message which includes a message prompting the user to shoot the subject at a greater distance from the subject, when it is determined that the subject is close.

18. An imaging apparatus comprising

the image processing apparatus according to claim 1 ,

wherein the image obtainment unit is configured to obtain the image by shooting a subject.

19. An image processing method comprising:

obtaining an image;

obtaining, using a microprocessor, embedment information that is to be embedded into a region within the image;

obtaining depth information indicating a depth value of each of pixels in the image;

setting, using the depth information, a search region that is a portion of the image and made up of a plurality of the pixels each having a depth value indicating a position further back than a position indicated by a predetermined depth value;

determining, in the portion that is the set search region, an embedment region that is the region into which the embedment information is to be embedded; and

displaying the image,

wherein in the displaying, a notification message is displayed to a user when the embedment region which meets a condition used for determining the embedment region is not present, the notification message indicating that the embedment region is not present.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED APPLICATION NUMBERS 13/384239, 13/498734, 14/116681 AND 14/301144 PREVIOUSLY RECORDED ON REEL 034194 FRAME 0143. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 24, 2020
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 056788/0362 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2018
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: SOVEREIGN PEAK VENTURES, LLC
Reel/Frame 048268/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2014
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 034194/0143 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2014
From: YAMADA, HITOSHI
To: PANASONIC CORPORATION
Reel/Frame 032261/0268 →