IP Library Granted Patent US 9,042,709
Granted Patent B2
US 9,042,709 · App. 13/714,736 · Granted May 26, 2015

Image capture device, player, and image processing method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,042,709
App. No.
13/714,736
Granted
May 26, 2015
Kind
B2
Abstract

An image capture device includes: first and second shooting sections, each of which is configured to shoot an image of a subject; a disparity calculating section configured to generate a depth map based on first and second images that have been shot by the first and second shooting sections, respectively; and an image generating section configured to generate, based on the depth map and the first image, a third image that has as high a resolution as the first image and that forms part of a 3D image. The image generating section is controlled to determine whether or not to generate the third image based on at least one of the states of the first and second images, a zoom power during shooting, and the tilt of the image capture device during shooting.

Claims (38)

1. An image capture device comprising:

a first shooting section configured to shoot an image of a subject;

a second shooting section configured to shoot an image of the subject from a different angle of view from the first shooting section;

an angle of view matching section configured to match to each other the respective angles of view of first and second images that have been shot by the first and second shooting section, respectively;

a number of pixels matching section configured to match to each other the respective numbers of pixels of the first and second images that have had their angles of view matched to each other by the angle of view matching section,

a disparity calculating section configured to generate a depth map as a piece of information indicating parallax between the first and second images that have had their numbers of pixels matched to each other by the number of pixels matching section; and

an image generating section configured to generate, based on the depth map and the first image, a third image that has as high a resolution as the first image and that forms, along with the first image, a 3D image,

wherein the image generating section is controlled to determine whether or not to generate the third image based on at least one of a zoom power during shooting and the roll angle of the image capture device during shooting.

2. The image capture device of claim 1 , wherein the image generating section complements an information missing region of the third image with information about the second image.

3. The image capture device of claim 2 , wherein the information about the second image is either edge information or texture information that has been obtained by making stereo matching between the first and second images and that is present in the first image but absent from the second image.

4. The image capture device of claim 2 , wherein the image generating section further complements the information missing region of the third image by filtering the third image, of which the information missing region has been complemented, through a filter that has a predetermined attenuation characteristic.

5. The image capture device of claim 1 , wherein the disparity calculating section generates a depth map that has a lower resolution than the first image based on the first and second images.

6. The image capture device of claim 1 , wherein the first shooting section does have an optical zoom function and the second shooting section does not have an optical zoom function.

7. The image capture device of claim 1 , wherein the second shooting section has a larger number of pixels than the first shooting section.

8. The image capture device of claim 1 , wherein the second shooting section has a smaller aperture than the first shooting section.

9. The image capture device of claim 1 , further comprising a monitor section configured to display a captured image,

wherein the optical system of the second shooting section is arranged behind the display screen of the monitor section.

10. An image capture device comprising:

a first shooting section configured to shoot an image of a subject;

a second shooting section configured to shoot an image of the subject from a different angle of view from the first shooting section;

an angle of view matching section configured to match to each other the respective angles of view of first and second images that have been shot by the first and second shooting section, respectively;

a number of pixels matching section configured to match to each other the respective numbers of pixels of the first and second images that have had their angles of view matched to each other by the angle of view matching section;

a disparity calculating section configured to generate a depth map as a piece of information indicating parallax between the first and second images that have had their numbers of pixels matched to each other by the number of pixels matching section; and

a writing section configured to write the first image and the depth map on a storage medium,

wherein the writing section is controlled to determine whether or not to write the depth map on the storage medium based on at least one of a zoom power during shooting and the roll angle of the image capture device during shooting.

11. An image capture device comprising:

first, second and third shooting sections, each of which is configured to shoot an image of a subject;

an angle of view matching section configured to match to each other the respective angles of view of first, second and third images that have been shot by the first, second and third shooting sections, respectively;

a number of pixels matching section configured to match to each other the respective numbers of pixels of the first, second and third images that have had their angles of view matched to each other by the angle of view matching section,

a disparity calculating section configured to generate a first depth map as a piece of information indicating parallax between first and second images that have had their numbers of pixels matched to each other by the number of pixels matching section, and generate a second depth map as a piece of information indicating parallax between the first and third images that have had their numbers of pixels matched to each other by the number of pixels matching section; and

a writing section configured to write the first image and the first and second depth maps on the storage medium,

wherein the writing section is controlled to determine whether or not to write the first and second depth maps on the storage medium based on at least one of a zoom power during shooting and the roll angle of the image capture device during shooting.

12. A player which generates a 3D image based on a signal that has been generated by an image capture device including: a first shooting section configured to shoot an image of a subject; a second shooting section configured to shoot an image of the subject from a different angle of view from the first shooting section; an angle of view matching section configured to match to each other the respective angles of view of first and second images that have been shot by the first and second shooting section, respectively; a number of pixels matching section configured to match to each other the respective numbers of pixels of the first and second images that have had their angles of view matched to each other by the angle of view matching section; a disparity calculating section configured to generate a depth map as a piece of information indicating parallax between the first and second images that have had their numbers of pixels matched to each other by the number of pixels matching section; and a writing section configured to write the first image and the depth map on a storage medium, the player comprising

an image generating section configured to get the first image and the depth map and generate, based on the first image and the depth map, a third image that has as high a resolution as the first image and that forms, along with the first image, a 3D image,

wherein the image generating section is controlled to determine whether or not to generate the third image based on at least one of a zoom power during shooting and the roll angle of the image capture device during shooting.

13. A player which generates a 3D image based on a signal that has been generated by an image capture device including: first, second and third shooting sections, each of which is configured to shoot an image of a subject; an angle of view matching section configured to match to each other the respective angles of view of first, second and third images that have been shot by the first, second and third shooting sections, respectively; a number of pixels matching section configured to match to each other the respective numbers of pixels of the first, second and third images that have had their angles of view matched to each other by the angle of view matching section, a disparity calculating section configured to generate a first depth map as a piece of information indicating parallax between first and second images that have had their numbers of pixels matched to each other by the number of pixels matching section, and generate a second depth map as a piece of information indicating parallax between the first and third images that have had their numbers of pixels matched to each other by the number of pixels matching section; and a writing section configured to write the first image and the first and second depth maps on the storage medium, the player comprising

an image generating section configured to get the first image and the first and second depth maps, generate one of two images that form the 3D image based on the first image and the first depth map, and generate the other of the two images that form the 3D image based on the first image and the second depth map,

wherein the image generating section is controlled to determine whether or not to generate the two images that form the 3D image based on at least one of a zoom power during shooting and the roll angle of the image capture device during shooting.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED APPLICATION NUMBERS 13/384239, 13/498734, 14/116681 AND 14/301144 PREVIOUSLY RECORDED ON REEL 034194 FRAME 0143. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 24, 2020
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 056788/0362 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2014
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 034194/0143 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2014
From: MORIOKA, YOSHIHIRO; NAGAI, TADASHI; HAMASAKI, TAKESHI; TOYOMURA, KOICHI; YABUKI, TAKANORI; MATSUURA, KENJI
To: PANASONIC CORPORATION
Reel/Frame 031956/0548 →