IP Library › Granted Patent US 8,977,038
Granted Patent B2
US 8,977,038 · App. 13/847,241 · Granted Mar 10, 2015

Apparatus and method for providing three dimensional media content

Inventors: Chao Tian (Madison, NJ); Vinay Anant Vaishampayan (Summit, NJ); Yifu Zhang (College Station, TX)
Assignee: AT&T Intellectual Property I, LP
H04N13/0203G06T5/005G06T2207/10012G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,977,038
App. No.
13/847,241
Granted
Mar 10, 2015
Kind
B2
Abstract

A system that incorporates teachings of the exemplary embodiments may include, for example, means for generating a disparity map based on a depth map, means for determining accuracy of pixels in the depth map where the determining means identifies the pixels as either accurate or inaccurate based on a confidence map and the disparity map, and means for providing an adjusted depth map where the providing means adjusts inaccurate pixels of the depth map using a cost function associated with the inaccurate pixels. Other embodiments are disclosed.

Claims (34)

1. A non-transitory computer-readable storage medium comprising instructions, which, responsive to being executed by a processor, cause the processor to perform operations comprising:

determining an accuracy of pixels in a depth map by identifying pixels as either accurate or inaccurate based on a confidence map and a disparity map;

adjusting the depth map by adjusting inaccurate pixels in the depth map;

generating three-dimensional media content based on images captured by a camera and the adjusted depth map; and

providing the three-dimensional media content for presentation at a display device.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the processor is part of a media processor connected with the display device.

3. The non-transitory computer-readable storage medium of claim 1 , wherein the inaccurate pixels are identified based on measuring a disparity variance for a pre-determined region surrounding each pixel of a disparity map generated from the depth map.

4. The non-transitory computer-readable storage medium of claim 1 , wherein the depth map is captured by a range camera.

5. The non-transitory computer-readable storage medium of claim 1 , wherein the adjusted depth map is based on the adjustments to the inaccurate pixels in the depth map using a graph-cut analysis.

6. The non-transitory computer-readable storage medium of claim 1 , wherein the adjusted depth map is based on the adjustments to the inaccurate pixels in the depth map using a belief-propagation analysis.

7. The non-transitory computer-readable storage medium of claim 1 , wherein the adjustments to the inaccurate pixels in the depth map are based on a cost function being applied to the inaccurate pixels.

8. The non-transitory computer-readable storage medium of claim 1 , wherein the depth map is generated based on measuring parameters associated with infrared light to obtain range data associated with an object in the images.

9. The non-transitory computer-readable storage medium of claim 1 , wherein homographic warping approximation is applied for calibration associated with the three-dimensional media content.

10. A method comprising:

receiving, by a processor, images captured by a camera;

determining an accuracy of pixels in a depth map by identifying pixels as either accurate or inaccurate based on a confidence map and a disparity map;

adjusting the depth map by adjusting inaccurate pixels in the depth map; and

generating, by the processor, three-dimensional media content based on the images and the adjusted depth map.

11. The method of claim 10 , wherein the processor is coupled to a display device, and further comprising providing the three-dimensional media content to the display device for presentation at the display device.

12. The method of claim 10 , wherein the inaccurate pixels are identified based on measuring a disparity variance for a pre-determined region surrounding each pixel of the disparity map generated from the depth map.

13. The method of claim 10 , wherein the depth map is captured by a range camera.

14. The method of claim 10 , wherein the adjusted depth map is based on the adjustments to the inaccurate pixels in the depth map using a graph-cut analysis.

15. The method of claim 10 , wherein the adjusted depth map is based on the adjustments to the inaccurate pixels in the depth map using a belief-propagation analysis.

16. The method of claim 10 , wherein the adjustments to the inaccurate pixels in the depth map are based on a cost function being applied to the inaccurate pixels.

17. The method of claim 10 , wherein the depth map is generated based on measuring parameters associated with infrared light to obtain range data associated with an object in the images.

18. The method of claim 10 , wherein homographic warping approximation is applied for calibration associated with the three-dimensional media content.

19. A device comprising:

a memory to store computer instructions; and

a processor coupled with the memory, wherein the processor, responsive to executing the computer instructions, performs operations comprising:

receiving images captured by a camera;

determining an accuracy of pixels in a depth map by identifying pixels as either accurate or inaccurate based on a confidence map and a disparity map;

adjusting the depth map by adjusting inaccurate pixels in the depth map; and

generating three-dimensional media content based on the images and an adjusted depth map, wherein the adjusted depth map is based on adjustments to inaccurate pixels in a depth map.

20. The device of claim 19 , wherein the processor is coupled to a display device, and wherein the operations further comprise providing the three-dimensional media content to the display device for presentation at the display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2013
From: TIAN, CHAO; VAISHAMPAYAN, VINAY ANANT; ZHANG, YIFU
To: AT&T INTELLECTUAL PROPERTY I, LP
Reel/Frame 030048/0105 →
Continuity (2)
Division 12855669 · Aug 12, 2010
Related Publication 20130208094A1 · Aug 15, 2013