IP Library Granted Patent US 9,014,276
Granted Patent B2
US 9,014,276 · App. 12/840,557 · Granted Apr 21, 2015

Method and system for 3D video coding using SVC temporal and spatial scalabilities

Inventors: Xuemin Chen (Rancho Santa Fe, CA); Brian Heng (Irvine, CA); Wade Wan (Orange, CA); Daniel English (Salem, NH); Zhijie Yang (Lake Forest, CA)
Assignee: Broadcom Corporation
H04N19/33H04N19/597H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,014,276
App. No.
12/840,557
Granted
Apr 21, 2015
Kind
B2
Abstract

A 3-dimensional (3D) video transmitter may be operable to encode a 3D video to generate a scalable video coding (SVC) base layer and a SVC enhancement layer. A first view such as a first high-resolution view and a second view such as a second high-resolution view of the 3D video in the SVC enhancement layer may be separate frames. A first half-resolution view and a second half-resolution view of the 3D video in the SVC base layer may be packed in a single frame. The first half-resolution view in the SVC base layer may be a base-layer reference for the first high-resolution view in the SVC enhancement layer for inter-layer prediction of spatial scalable coding. The first high-resolution view in the SVC enhancement layer may be an intra-layer reference for the second high-resolution view in the SVC enhancement layer for intra-layer prediction of temporal scalable coding.

Claims (52)

1. A method for processing video, the method comprising:

in a 3-dimensional (3D) video transmitter:

encoding a 3D video to generate a scalable video coding (SVC) base layer, a frame in said SVC base layer comprising a right half-resolution view of said 3D video and a left half-resolution view of said 3D video; and

encoding said 3D video to generate an SVC enhancement layer, a first frame in said SVC enhancement layer comprising a right high-resolution view and a second frame in said SVC enhancement layer comprising a left high-resolution view, wherein said first and second frames of said SVC enhancement layer each comprises a separate frame in said SVC enhancement layer and has a higher spatial resolution than said frame in said SVC base layer;

wherein:

said right half-resolution view in said SVC base layer is a reference for said right high-resolution view in said SVC enhancement layer for interlayer prediction of spatial scalable coding; and

said right high-resolution view in said SVC enhancement layer is an intra-layer reference for said left high-resolution view in said SVC enhancement layer for intra-layer prediction of temporal scalable coding.

2. The method according to claim 1 , wherein a total number of bits for said right half-resolution view is different from a total number of bits for said left half-resolution view.

3. The method according to claim 1 , wherein a total number of bits for said right high-resolution view is different from a total number of bits for said left high resolution view.

4. The method according to claim 1 , comprising transmitting said right half-resolution view and said left half-resolution view in a single elementary stream to a 3D video receiver.

5. The method according to claim 1 , comprising transmitting said right half-resolution view in a first elementary stream and said left half-resolution view in a second elementary stream to a 3D video receiver.

6. The method according to claim 1 , comprising transmitting said right high-resolution view and said left high-resolution view in a single elementary stream to a 3D video receiver.

7. The method according to claim 1 , comprising transmitting said right high-resolution view in a first elementary stream and said left high-resolution view in a second elementary stream to a 3D video receiver.

8. The method according to claim 1 , comprising transmitting said frame in said SVC base layer comprising said right half-resolution view and said left half-resolution view, said first frame in said SVC enhancement layer comprising said right high-resolution view, and said second frame in said SVC enhancement layer comprising said left high-resolution view to a 3D video receiver, wherein said transmitted right half-resolution view is independently decoded by said 3D video receiver without a reference from other views.

9. The method according to claim 1 , wherein:

encoding said 3D video to generate said SVC base layer comprises encoding said 3D video in an interlaced format at a higher frame rate than an original frame rate of said 3D video, using pulldown;

encoding said 3D video to generate said SVC enhancement layer comprises encoding said 3D video in a progressive format at said original frame rate of said 3D video; and

said method further comprises transmitting said SVC base layer and said SVC enhancement layer to a 3D video receiver, wherein:

said SVC base layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said half-resolution in said interlaced format at said higher frame rate; and

said SVC enhancement layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said high-resolution in said progressive format at said original frame rate.

10. A system for processing video, the system comprising:

one or more processors, one or more circuits, or any combination thereof for use in a 3-dimensional (3D) video transmitter, operable to:

encode a 3D video to generate a scalable video coding (SVC) base layer, a frame in said SVC base layer comprising a right half-resolution view and a left half-resolution view; and encode said 3D video to generate a SVC enhancement layer, a first frame in said SVC enhancement layer comprising a right high-resolution view and a second frame in said SVC enhancement layer comprising a left high-resolution view, wherein said first and second frames of said SVC enhancement layer each comprises a separate frame in said SVC enhancement layer and has a higher spatial resolution than said frame in said SVC base laver;

wherein

said right half-resolution view in said SVC base layer is a base-layer reference for said right high-resolution view in said SVC enhancement layer for interlayer prediction of spatial scalable coding; and

said right high-resolution view in said SVC enhancement layer is an intra-layer reference for said left high-resolution view in said SVC enhancement layer for intra-layer prediction of temporal scalable coding.

11. The system according to claim 10 , wherein a total number of bits for said right half-resolution view is different from a total number of bits for said left half-resolution view.

12. The system according to claim 10 , wherein a total number of bits for said right high-resolution view is different from a total number of bits for said left high-resolution view.

13. The system according to claim 10 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right half-resolution view and said left half-resolution view in a single elementary stream to a 3D video receiver.

14. The system according to claim 10 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right half-resolution view in a first elementary stream and said left half-resolution view in a second elementary stream to a 3D video receiver.

15. The system according to claim 10 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right high-resolution view and said left high-resolution view in a single elementary stream to a 3D video receiver.

16. The system according to claim 10 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right high-resolution view in a first elementary stream and said left high-resolution view in a second elementary stream to a 3D video receiver.

17. The system according to claim 10 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said frame in said SVC base layer comprising said right half-resolution view and said left half-resolution view, said first frame in said SVC enhancement layer comprising said right high-resolution view, and said second frame in said SVC enhancement layer comprising said left high-resolution view to a 3D video receiver, wherein said transmitted right half-resolution view is independently decoded by said 3D video receiver without a reference from other views.

18. The system according to claim 10 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to:

encode said 3D video to generate said SVC base layer in an interlaced format at a higher frame rate than an original frame rate of said 3D video, using pulldown;

encode said 3D video to generate said SVC enhancement layer in a progressive format at said original frame rate of said 3D video; and

transmit said SVC base layer and said SVC enhancement layer to a 3D video receiver,

wherein:

said SVC base layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said half-resolution in said interlaced format at said higher frame rate; and

said SVC enhancement layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said high-resolution in said progressive format at said original frame rate.

19. A method for processing video, the method comprising:

encoding, with a 3-dimensional (3D) video encoder, a 3D video to generate a base layer, a frame in said base layer comprising a right half-resolution view and a left half-resolution view; and

encoding, with said 3D video encoder, said 3D video to generate an enhancement layer, a first frame in said enhancement layer comprising a right high-resolution view and a second frame in said enhancement layer comprising a left high-resolution view, said first and second frames of said enhancement layer each having a higher spatial resolution than said right half-resolution view and said left half-resolution view in said base layer;

wherein:

said right half-resolution view in said base layer is a reference for said right high-resolution view in said enhancement layer for interlayer prediction of spatial scalable coding; and

said right high-resolution view in said enhancement layer is an intra-layer reference for said left high-resolution view in said enhancement layer for intra-layer prediction of temporal scalable coding.

20. The method according to claim 19 , wherein:

encoding said 3D video to generate said base layer comprises encoding said 3D video in an interlaced format at a higher frame rate than an original frame rate of said 3D video;

encoding said 3D video to generate said enhancement layer comprises encoding said 3D video in a progressive format at said original frame rate of said 3D video; and

said method further comprises transmitting said base and enhancement layers to a 3D video receiver, wherein:

said transmitted base layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said half-resolution in said interlaced format at said higher frame rate; and

said transmitted enhancement layer is decoded, by with said 3D video receiver, to generate a decompressed 3D video at said high-resolution in said progressive format at said original frame rate.

Assignments (7)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 9,385,856 TO 9,385,756 PREVIOUSLY RECORDED AT REEL: 47349 FRAME: 001. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Mar 22, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 051144/0648 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE PREVIOUSLY RECORDED ON REEL 047229 FRAME 0408. ASSIGNOR(S) HEREBY CONFIRMS THE THE EFFECTIVE DATE IS 09/05/2018. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047349/0001 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047229/0408 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2010
From: CHEN, XUEMIN; HENG, BRIAN; WAN, WADE; ENGLISH, DANIEL; YANG, ZHIJIE
To: BROADCOM CORPORATION
Reel/Frame 024863/0596 →
Continuity (2)
Provisional Application 61266553 · Dec 4, 2009
Related Publication 20110134214A1 · Jun 9, 2011