IP Library › Granted Patent US 8,619,860
Granted Patent B2
US 8,619,860 · App. 11/416,851 · Granted Dec 31, 2013

System and method for scalable encoding and decoding of multimedia data using multiple layers

Inventors: Peisong Chen (San Diego, CA); Vijayalakshmi R. Raveendran (San Diego, CA)
Assignee: QUALCOMM Incorporated
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,619,860
App. No.
11/416,851
Granted
Dec 31, 2013
Kind
B2
Abstract

A method of processing multimedia data being associated with multiple layers is disclosed. The method may include determining a base layer residual and performing interlayer prediction to generate an enhancement layer residual if at least one of a number of non-zero coefficients of the base layer residual or a number of zero coefficients of the base layer residual meets a first selected condition. A method of decoding a multimedia bitstream may include receiving a multimedia bitstream having a base layer and an enhancement layer and decoding the base layer to determine whether the enhancement layer should be decoded using intralayer prediction or interlayer prediction.

Claims (68)

1. A method of processing multimedia data being associated with multiple layers comprising:

determining a base layer residual by a computer device; and

performing interlayer prediction by the computer device to generate an enhancement layer residual if a count of non-zero coefficients of the base layer residual meets a first selected condition, wherein the first selected condition is only met if all coefficients of the base layer residual are non-zero coefficients, and further wherein the computer device performing interlayer prediction includes the computer device:

determining a coefficient of a base layer reconstructed block based on a coefficient of a base layer reference block and a coefficient of the base layer residual; and

determining a coefficient of an enhancement layer reconstructed block by using the coefficient of the base layer reconstructed block.

2. The method of claim 1 wherein the first selected condition is further met if the count is greater than or equal to a threshold.

3. The method of claim 1 further comprising performing temporal prediction to generate the enhancement layer residual if at least one of a number of non-zero coefficients of the base layer residual or a number of zero coefficients of the base layer residual meets a second selected condition.

4. The method of claim 3 wherein the second selected condition is met if the number of non-zero coefficients of the base layer residual is less than or equal to a threshold.

5. The method of claim 3 wherein the second selected condition is met if the number of zero coefficients of the base layer residual is greater than or equal to a threshold.

6. The method of claim 3 wherein performing temporal prediction includes:

assigning a plurality of non-zero coefficients of the base layer residual to zero; and

determining a coefficient of an enhancement layer reconstructed block based on a coefficient of an enhancement layer reference block and a coefficient of an enhancement layer residual.

7. The method of claim 1 further comprising setting a code to indicate that the enhancement layer residual should not be transmitted.

8. A processor for processing multimedia data being associated with multiple layers, the processor being configured to:

determine a base layer residual; and

perform interlayer prediction to generate an enhancement layer residual if a count of non-zero coefficients of the base layer residual meets a first selected condition, wherein the first selected condition is only met if all coefficients of the base layer residual are non-zero coefficients, and further wherein to perform interlayer prediction includes:

determine a coefficient of a base layer reconstructed block based on a coefficient of a base layer reference block and a coefficient of the base layer residual; and

determine a coefficient of an enhancement layer reconstructed block by using the coefficient of the base layer reconstructed block.

9. The processor of claim 8 wherein the first selected condition is further met if the count is greater than or equal to a threshold.

10. The processor of claim 8 further configured to perform temporal prediction to generate the enhancement layer residual if at least one of a number of non-zero coefficients of the base layer residual or a number of zero coefficients of the base layer residual meets a second selected condition.

11. The processor of claim 10 wherein the second selected condition is met if the number of non-zero coefficients of the base layer residual is less than or equal to a threshold.

12. The processor of claim 10 wherein the second selected condition is met if the number of zero coefficients of the base layer residual is greater than or equal to a threshold.

13. The processor of claim 10 wherein to perform temporal prediction includes:

assign a plurality of non-zero coefficients of the base layer residual to zero; and

determine a coefficient of an enhancement layer reconstructed block based on a coefficient of an enhancement layer reference block and a coefficient of an enhancement layer residual.

14. The processor of claim 8 further configured to set a code to indicate that the enhancement layer residual should not be transmitted.

15. An apparatus for processing multimedia data being associated with multiple layers comprising:

a motion estimation module for determining a base layer residual; and

an interlayer prediction module for performing interlayer prediction to generate an enhancement layer residual if a count of non-zero coefficients of the base layer residual meets a first selected condition, wherein the first selected condition is only met if all coefficients of the base layer residual are non-zero coefficients, and

further wherein the interlayer prediction module:

determines a coefficient of a base layer reconstructed block based on a coefficient of a base layer reference block and a coefficient of the base layer residual; and

determines a coefficient of an enhancement layer reconstructed block by using the coefficient of the base layer reconstructed block.

16. The apparatus of claim 15 wherein the first selected condition is further met if the count is greater than or equal to a threshold.

17. The apparatus of claim 15 further comprising a temporal prediction module for performing temporal prediction to generate the enhancement layer residual if at least one of a number of non-zero coefficients of the base layer residual or a number of zero coefficients of the base layer residual meets a second selected condition.

18. The apparatus of claim 17 wherein the second selected condition is met if the number of non-zero coefficients of the base layer residual is less than or equal to a threshold.

19. The apparatus of claim 17 wherein the second selected condition is met if the number of zero coefficients of the base layer residual is greater than or equal to a threshold.

20. The apparatus of claim 17 wherein the temporal prediction module:

assigns a plurality of non-zero coefficients of the base layer residual to zero; and

determines a coefficient of an enhancement layer reconstructed block based on a coefficient of an enhancement layer reference block and a coefficient of an enhancement layer residual.

21. The apparatus of claim 15 further comprising a decision module to set a code to indicate that the enhancement layer residual should not be transmitted.

22. An apparatus for processing multimedia data being associated with multiple layers comprising:

means for determining a base layer residual; and

means for performing interlayer prediction to generate an enhancement layer residual if a count of non-zero coefficients of the base layer residual meets a first selected condition, wherein the first selected condition is only met if all coefficients of the base layer residual are non-zero coefficients, and

further wherein the means for performing interlayer prediction includes:

determining a coefficient of a base layer reconstructed block based on a coefficient of a base layer reference block and a coefficient of the base layer residual; and

determining a coefficient of an enhancement layer reconstructed block by using the coefficient of the base layer reconstructed block.

23. The apparatus of claim 22 wherein the first selected condition is further met if the count is greater than or equal to a threshold.

24. The apparatus of claim 22 further comprising means for performing temporal prediction to generate the enhancement layer residual if at least one of a number of non-zero coefficients of the base layer residual or a number of zero coefficients of the base layer residual meets a second selected condition.

25. The apparatus of claim 24 wherein the second selected condition is met if the number of non-zero coefficients of the base layer residual is less than or equal to a threshold.

26. The apparatus of claim 24 wherein the second selected condition is met if the number of zero coefficients of the base layer residual is greater than or equal to a threshold.

27. The apparatus of claim 24 wherein the means for performing temporal prediction includes:

assigning a plurality of non-zero coefficients of the base layer residual to zero; and

determining a coefficient of an enhancement layer reconstructed block based on a coefficient of an enhancement layer reference block and a coefficient of an enhancement layer residual.

28. The apparatus of claim 22 further comprising means for setting a code to indicate that the enhancement layer residual should not be transmitted.

29. A non-transitory computer-readable storage medium storing instructions for causing a computer to process multimedia data associated with multiple layers, comprising:

instructions for causing a computer to determine a base layer residual; and

instructions for causing a computer to perform interlayer prediction to generate an enhancement layer residual if a count of non-zero coefficients of the base layer residual meets a first selected condition, wherein the first selected condition is only met if all coefficients of the base layer residual are non-zero coefficients, and

further wherein the instructions for causing a computer to perform interlayer prediction further comprise:

instructions for causing a computer to determine a coefficient of a base layer reconstructed block based on a coefficient of a base layer reference block and a coefficient of the base layer residual; and

instructions for causing a computer to determine a coefficient of an enhancement layer reconstructed block by using the coefficient of the base layer reconstructed block.

30. The non-transitory computer-readable storage medium of claim 29 wherein the first selected condition is further met if the count is greater than or equal to a threshold.

31. The non-transitory computer-readable storage medium of claim 29 further comprising instructions for causing a computer to perform temporal prediction to generate the enhancement layer residual if at least one of a number of non-zero coefficients of the base layer residual or a number of zero coefficients of the base layer residual meets a second selected condition.

32. The non-transitory computer-readable storage medium of claim 31 wherein the second selected condition is met if the number of non-zero coefficients of the base layer residual is less than or equal to a threshold.

33. The non-transitory computer-readable storage medium of claim 31 wherein the second selected condition is met if the number of zero coefficients of the base layer residual is greater than or equal to a threshold.

34. The non-transitory computer-readable storage medium of claim 31 further comprising:

instructions for causing a computer to assign a plurality of non-zero coefficients of the base layer residual to zero; and

instructions for causing a computer to determine a coefficient of an enhancement layer reconstructed block based on a coefficient of an enhancement layer reference block and a coefficient of an enhancement layer residual.

35. The non-transitory computer-readable storage medium of claim 29 further comprising instructions for causing a computer to set a code to indicate that the enhancement layer residual should not be transmitted.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2006
From: CHEN, PEISONG; RAVEENDRAN, VIJAYALAKSHMI R.
To: QUALCOMM INCORPORATED
Reel/Frame 018044/0692 →
Continuity (6)
Provisional Application 60677607 · May 3, 2005
Provisional Application 60677609 · May 3, 2005
Provisional Application 60677610 · May 3, 2005
Provisional Application 60677611 · May 3, 2005
Provisional Application 60789271 · Apr 4, 2006
Related Publication 20060262985A1 · Nov 23, 2006