IP Library › Granted Patent US 8,488,868
Granted Patent B2
US 8,488,868 · App. 12/060,978 · Granted Jul 16, 2013

Generation of a depth map from a monoscopic color image for rendering stereoscopic still and video images

Inventors: Wa James Tam (Orleans, CA); Carlos Vázquez (Gatineau, CA)
Assignee: Her Majesty the Queen in Right of Canada, as represented by the Minister of Industry, through the Communications Research Centre Canada
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,488,868
App. No.
12/060,978
Granted
Jul 16, 2013
Kind
B2
Abstract

The invention relates to a method and an apparatus for generating a depth map from a digital monoscopic color image. The method includes the following general steps: a) obtaining a first color component of the MCI, said first color component corresponding to partial color information of the MCI; and, b) assigning depth values to pixels of the MCI based on values of the first color component of respective pixels for forming the depth map for the MCI. In one embodiment, the depth values are generated by adjusting and/or scaling of pixel values of the Cr chroma component of the monoscopic source color image in the Y′CbCr color system.

Claims (37)

1. A method of generating a depth map from a monoscopic color image (MCI) composed of pixels, the method comprising:

a) obtaining a first color component of the MCI, said first color component corresponding to partial color information for pixels of the MCI;

b) generating depth values from pixel values of only the first color component at corresponding pixels; and,

c) generating the depth map from the depth values.

2. A method according to claim 1 , wherein step b) comprises using scaled pixel values of the first color component as depth values at corresponding pixels.

3. A method according to claim 2 , wherein the first color component is the Cr chroma component of the MCI in the Y′CbCr color system.

4. A method according to claim 2 , wherein the first color component is one of chroma components of the MCI in the Y′CbCr color system or one of chroma components of the MCI in the CMYK color system.

5. A method according to claim 1 , wherein step (b) comprises

selectively adjusting pixel values of the first color component in a portion of the MCI for obtaining the depth values therefrom.

6. A method according to claim 5 , wherein the portion of the MCI is selected by applying a pre-determined threshold criterion to pixel values of a second color component of the MCI.

7. A method according to claim 6 , wherein the first color component is the Cr chroma component of the MCI in the Y′CbCr color system, and the second color component is one of red (R) and green (G) color components of the MCI in the RGB color system.

8. A method according to claim 7 , wherein the portion of the MCI comprises one of: first pixels having R values satisfying a pre-determined red threshold criterion, and second pixels having G values satisfying a pre-determined green threshold criterion.

9. A method according to claim 8 , wherein the pre-determined red threshold criterion comprises at least one of:

determining if the red intensity values exceed a threshold value,

determining if the red intensity values minus green intensity values exceed a threshold value, and

determining if the blue intensity values minus green intensity values exceed a threshold value,

and wherein the pre-determined green threshold criterion comprises determining if the green intensity values exceed a threshold value.

10. A method according to claim 8 , wherein step (b) comprises one of: selectively reducing values of the first color component for the first pixels, and selectively enhancing values of the first color component for the second pixels.

11. A method according to claim 1 , wherein step c) comprises smoothing the depth values to generate the depth map.

12. A method according to claim 11 , wherein the step of smoothing the depth map comprises applying a 2D Gaussian filter thereto.

13. A method of generating a multi-view image comprising

a. receiving a monoscopic color image (MCI) composed of pixels;

b. generating a depth map from the MCI based on a first color component thereof, said first color component corresponding to partial color information for pixels of the MCI;

c. utilizing a depth image based rendering (DIBR) algorithm to create at least one deviated image by processing the MCI based on the depth map, so as to form a stereoscopic image pair;

wherein step b) includes determining depth values for pixels of the MCI from pixel values of only the first color component for corresponding pixels in at least a portion of the MCI.

14. A 3D image generating apparatus comprising:

a data receiver for receiving data representing a monoscopic color image (MCI) composed of pixels;

a depth map generator for generating a depth map comprising pixel depth values obtained from pixel values of only a first color component of the MCI, said first color component corresponding to partial color information for pixels of the MCI; and,

a DIBR processor for processing the MCI based on the depth map to render at least one deviated image for forming at least one stereoscopic image pair.

15. A 3D image generating apparatus according to claim 14 , further comprising a multi-view display for generating at least one stereoscopic view from the at least one stereoscopic image pair.

16. An apparatus for generating 3D motion pictures from a sequence of monoscopic color images, comprising a 3D image generating apparatus according to claim 15 for generating and sequentially displaying at least one stereoscopic view from each monoscopic color image from the sequence of the monoscopic color images.

17. A 3D image generating apparatus according to claim 14 , wherein:

the depth map generator comprises a scaling unit for scaling pixel values of the first color component for producing the pixel depth values.

18. A 3D image generating apparatus according to claim 17 , wherein the depth map generator further comprises:

a color processor for obtaining a second color component from the MCI;

a color adjuster for selectively adjusting pixel values of the first color component based on pixel values of the second color component for respective pixels.

19. A 3D image generating apparatus according to claim 17 , wherein the color processor is for obtaining the first color component from the MCI.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2008
From: TAM, WA JAMES; VAZQUEZ, CARLOS
To: HER MAJESTY THE QUEEN IN RIGHT OF CANADA, AS REPRESENTED BY THE MINISTER OF INDUSTRY, THROUGH THE COMMUNICATIONS RESEARCH CENTRE CANADA
Reel/Frame 020742/0131 →
Continuity (2)
Provisional Application 60907475 · Apr 3, 2007
Related Publication 20080247670A1 · Oct 9, 2008