IP Library Granted Patent US 8,810,565
Granted Patent B2
US 8,810,565 · App. 13/077,868 · Granted Aug 19, 2014

Method and system for utilizing depth information as an enhancement layer

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,810,565
App. No.
13/077,868
Granted
Aug 19, 2014
Kind
B2
Abstract

A monoscopic 3D video generation device, which comprises one or more depth sensors, may be operable to store captured 2D video image data as a base layer and store captured corresponding depth information separately as an enhancement layer. The 2D video image data may be captured via one or more image sensors and the corresponding depth information may be captured via the one or more depth sensors in the monoscopic 3D video generation device. The monoscopic 3D video generation device may determine whether to transmit the enhancement layer to a video rendering device. The monoscopic 3D video generation device may encode the base layer. The monoscopic 3D video generation device may encode the enhancement layer based on the determination of transmitting the enhancement layer. The encoded base layer and/or the encoded enhancement layer may be transmitted to the video rendering device for 3D video rendering and/or 2D video rendering.

Claims (45)

1. A method for processing video in a monoscopic three-dimensional (3D) video generation device comprising one or more depth sensors, the method comprising:

storing captured two-dimensional (2D) video image data as a base layer;

storing captured depth information corresponding to the 2D video image data as an enhancement layer in response to a request from a rendering device; and

selectively transmitting the enhancement layer in response to the request from the rendering device, wherein the request from the rendering device is based on a processor decision to limit bandwidth usage and a 3D rendering capacity of a video rendering device.

2. The method according to claim 1 , comprising capturing said 2D video image data via one or more image sensors in said monoscopic 3D video generation device.

3. The method according to claim 1 , comprising:

encoding said base layer; and

determining whether to encode said enhancement layer in response to the request from the rendering device.

4. The method according to claim 3 , comprising transmitting said encoded base layer and/or said encoded enhancement layer to said video rendering device.

5. The method according to claim 4 , wherein said video rendering device determines whether to utilize said transmitted enhancement layer.

6. The method according to claim 5 , wherein said video rendering device:

determines whether the transmitted enhancement layer is received;

decodes said transmitted base layer; and

determines whether to decode said transmitted enhancement layer in response to the 3D rendering capacity of the video rendering device and the receipt of the transmitted enhancement layer.

7. The method according to claim 6 , wherein said video rendering device generates a 3D video utilizing said decoded base layer, which comprises said 2D video image data, and said decoded enhancement layer, which comprises said depth Information.

8. The method according to claim 1 , comprising encoding an enhancement layer to transmit to the video rendering device in response to a capability of the video rendering device to render 3D video.

9. A system for processing video, the system comprising:

one or more processors and/or circuits for use in a monoscopic three-dimensional (3D) video generation device comprising one or more depth sensors, wherein said one or more processors and/or circuits are operable to:

store captured two-dimensional (2D) video Image data as a base layer in a base layer storage of a memory unit;

store captured corresponding depth Information separately as an enhancement layer stored separately in an enhancement layer storage in the memory unit, in response to a request from the video rendering device, wherein the request by the video rendering device is based on a decision by the rendering device to limit bandwidth usage; and

determine whether to transmit the enhancement layer to a video rendering device in response to the request from the video rendering device.

10. The system according to claim 9 , wherein said one or more processors and/or circuits are operable to capture said 2D video Image data via one or more image sensors In said monoscopic 3D video generation device.

11. The system according to claim 9 , wherein said one or more processors and/or circuits are operable to capture said corresponding depth information via said one or more depth sensors in said monoscopic 3D video generation device.

12. The system according to claim 9 , wherein said one or more processors and/or circuits are operable to:

encode said base layer; and

selectively encode said enhancement layer based on said determination in response to the request from the video rendering device.

13. The system according to claim 9 , wherein said video rendering device determines whether to utilize said transmitted enhancement layer.

14. The system according to claim 13 , wherein said video rendering device:

decodes said transmitted base layer; and

decodes said transmitted enhancement layer based on said determination.

15. The system according to claim 14 , wherein said, video rendering device generates a 3D video utilizing said decoded base layer, which comprises said 2D video image data, and said decoded enhancement layer, which comprises said corresponding depth information.

16. The system according to claim 14 , wherein said video rendering device generates a 2D video utilizing said decoded base layer which comprises said 2D video image data.

17. A system for processing video, the system comprising:

one or more processors and/or circuits for use in a monoscopic three-dimensional (3D) video generation device comprising one or more depth sensors,

a memory unit, wherein the one or more processors and/or circuits are operable to store a two-dimensional (2D) video image base layer and store a 3D video image enhancement layer in the memory unit;

a base layer encoder configured to encode the 2D video image base layer;

an enhancement layer encoder configured to encode the 3D video image enhancement layer;

wherein the one or more processors and/or circuits are operable to selectively:

store and encode the base layer in response to a first request from a video rendering device, or

store and encode the base layer and the enhancement layer in response to a second request from the video rendering device.

18. The system according to claim 17 , wherein the one or more processors and/or circuits are operable to determine whether to transmit the base layer, or the base layer and the enhancement layer to the video rendering device in response to the capability of the video rendering device to render 3D video.

19. The system according to claim 17 , wherein the second request from the video rendering device is based on a capacity of the video rendering to render 3D video or a determination by the video rendering device to limit a bandwidth usage.

20. The system according to claim 17 , wherein the one or more processors and/or circuits are operable to:

store and encode the base layer in response to the first request from a video rendering device, and

store and encode the base layer and the enhancement layer in response to the second request from the video rendering device.

Assignments (7)
CORRECTIVE ASSIGNMENT TO CORRECT THE ERROR IN RECORDING THE MERGER IN THE INCORRECT US PATENT NO. 8,876,094 PREVIOUSLY RECORDED ON REEL 047351 FRAME 0384. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Mar 8, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 049248/0558 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF THE MERGER PREVIOUSLY RECORDED AT REEL: 047230 FRAME: 0910. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047351/0384 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047230/0910 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2012
From: KARAOGUZ, JEYHAN; SESHADRI, NAMBI; CHEN, XUEMIN; BOROSS, CHRIS
To: BROADCOM CORPORATION
Reel/Frame 027606/0031 →