IP Library Granted Patent US 9,762,920
Granted Patent B2
US 9,762,920 · App. 14/294,913 · Granted Sep 12, 2017

Dynamic range control of intermediate data in resampling process

Inventors: Jianle Chen (San Diego, CA); Xiang Li (San Diego, CA); Wei Pu (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/31H04N19/33H04N19/42H04N19/615H04N19/64H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,762,920
App. No.
14/294,913
Granted
Sep 12, 2017
Kind
B2
Abstract

An apparatus for coding video information according to certain aspects includes a memory and a processor. The memory unit is configured to store video information. The processor is configured to: obtain reference layer video information; upsample the reference layer video information in a first dimension to generate an intermediate output; constrain the intermediate output to a predetermined bit depth; and upsample the constrained intermediate output in a second dimension, wherein the second dimension is orthogonal to the first dimension.

Claims (84)

1. An apparatus configured to code video information, the apparatus comprising:

a memory configured to store video information associated with a reference layer and an enhancement layer; and

a processor operationally coupled to the memory and configured to:

obtain a reference layer picture from the reference layer;

upsample the reference layer picture in a first spatial dimension to generate an intermediate output;

determine a bit depth of the reference layer picture;

determine a number of bits to shift the intermediate output based upon the bit depth of the reference layer picture;

shift the intermediate output by the number of bits to obtain a constrained intermediate output;

upsample the constrained intermediate output in a second spatial dimension to generate an upsampled version of the reference layer picture, wherein the second spatial dimension is orthogonal to the first spatial dimension: and

predict a current picture from the enhancement layer using the upsampled version of the reference layer picture in order to perform inter layer prediction.

2. The apparatus of claim 1 , wherein to shift the intermediate output by the number of bits, the processor is configured to:

determine whether to shift the intermediate output based on the number of bits; and

shift the intermediate output by the number of bits in response to determining to shift the intermediate output.

3. The apparatus of claim 1 , wherein the processor is configured to determine the number of bits to shift the intermediate output as the bit depth of the reference layer picture minus 8 bits.

4. The apparatus of claim 1 , wherein the processor is configured to shift the intermediate output by the number of bits using a right shift operation.

5. The apparatus of claim 1 , wherein the first spatial dimension is a horizontal dimension and the second spatial dimension is a vertical dimension.

6. The apparatus of claim 1 , wherein the reference layer picture comprises luma values.

7. The apparatus of claim 1 , wherein the processor is configured to upsample the reference layer picture in the first spatial dimension and upsample the constrained intermediate output in the second spatial dimension by applying a resampling filter to the reference layer picture.

8. The apparatus of claim 1 , wherein the predetermined bit depth is 16 bits.

9. The apparatus of claim 1 , wherein the processor is further configured to:

generate a second intermediate output from the upsampled, constrained intermediate output; and

constrain the second intermediate output to a second predetermined bit depth.

10. The apparatus of claim 9 , wherein the processor is further configured to generate the upsampled version of the obtained reference layer picture from the constrained second intermediate output.

11. The apparatus of claim 9 , wherein the processor is configured to:

determine a second number of bits to shift the second intermediate output based upon the bit depth of the reference layer picture;

determine whether to shift the second intermediate output based on the second number of bits; and

shift the second intermediate output by the second number of bits in response to determining to shift the second intermediate output to constrain the second intermediate output to the second predetermined bit depth.

12. The apparatus of claim 9 , wherein the processor is configured to:

determine a second number of bits to shift the second intermediate output based upon the bit depth of the enhancement layer picture; and

shift the second intermediate output by the second number of bits to constrain the second intermediate output to the second predetermined bit depth.

13. The apparatus of claim 12 , wherein the processor is configured to shift the second intermediate output by the second number of bits using a right shift operation.

14. The apparatus of claim 12 , wherein the processor is further configured to determine the second number of bits to shift the second intermediate output as: 20 bits minus the bit depth of the enhancement layer picture.

15. The apparatus of claim 1 , wherein the apparatus is comprises one or more of: a desktop computer, a notebook computer, a laptop computer, a tablet computer, a set-top box, a telephone handset, a smart phone, a wireless communication device, a smart pad, a television, a camera, a display device, a digital media player, a video gaming console, or a video streaming device.

16. A method of coding video information, the method comprising:

obtaining a reference layer picture from a reference layer;

upsampling the reference layer picture in a first spatial dimension to generate an intermediate output;

constraining the intermediate output to a predetermined bit depth by:

determining a bit depth of the reference layer picture;

determining a number of bits to shift the intermediate output based upon the bit depth of the reference layer picture; and

shifting the intermediate output by the number of bits; and

upsampling the constrained intermediate output in a second spatial dimension to generate an upsampled version of the reference layer picture, wherein the second spatial dimension is orthogonal to the first spatial dimension: and

predicting a current picture from an enhancement layer using the upsampled version of the reference layer picture in order to perform inter layer prediction.

17. The method of claim 16 , wherein said shifting the intermediate output by the number of bits comprises:

determining whether to shift the intermediate output based on the number of bits; and

in response to determining to shift the intermediate output, shifting the intermediate output by the number of bits.

18. The method of claim 16 , wherein the number of bits to shift the intermediate output is determined as the bit depth of the reference layer picture minus 8 bits.

19. The method of claim 16 , wherein said shifting the intermediate output by the number of bits is performed using a right shift operation.

20. The method of claim 16 , wherein the first spatial dimension is a horizontal dimension and the second spatial dimension is a vertical dimension.

21. The method of claim 16 , wherein the reference layer picture video information comprises luma values.

22. The method of claim 16 , wherein said upsampling the reference layer picture in the first spatial dimension and said upsampling the constrained intermediate output in the second spatial dimension are performed by applying a resampling filter to the reference layer picture.

23. The method of claim 16 , wherein the predetermined bit depth is 16 bits.

24. The method of claim 16 , further comprising:

generating a second intermediate output from the upsampled, constrained intermediate output; and

constraining the second intermediate output to a second predetermined bit depth.

25. The method of claim 24 , further comprising generating the upsampled version of the obtained reference layer picture from the constrained second intermediate output.

26. The method of claim 24 , wherein said constraining the second intermediate output to the second predetermined bit depth comprises:

determining a second number of bits to shift the second intermediate output based upon the bit depth of the reference layer picture;

determining whether to shift the second intermediate output based on the second number of bits; and

in response to determining to shift the second intermediate output, shifting the second intermediate output by the second number of bits.

27. The method of claim 24 , wherein said constraining the second intermediate output to the second predetermined bit depth comprises:

determining a second number of bits to shift the second intermediate output based upon the bit depth of the enhancement layer picture; and

shifting the second intermediate output by the second number of bits.

28. The method of claim 27 , wherein said shifting the second intermediate output by the second number of bits is performed using a right shift operation.

29. The method of claim 27 , wherein the second number of bits to shift the second intermediate output is determined as: 20 bits minus the bit depth of the enhancement layer picture.

30. A non-transitory computer readable medium comprising instructions that when executed on a processor comprising computer hardware cause the processor to:

store video information associated with a reference layer and an enhancement layer;

obtain a reference layer picture from the reference layer;

upsample the reference layer picture in a first spatial dimension to generate an intermediate output;

determine a bit depth of the reference layer picture;

determine a number of bits to shift the intermediate output based upon the bit depth of the reference layer picture;

shift the intermediate output by the number of bits to obtain a constrained intermediate output;

upsample the constrained intermediate output in a second spatial dimension, to generate an upsampled version of the reference layer picture, wherein the second spatial dimension is orthogonal to the first spatial dimension; and

predict a current picture from the enhancement layer using the upsampled version of the reference layer picture in order to perform inter layer prediction.

31. An apparatus configured to code video information, the apparatus comprising:

means for storing video information associated with a reference layer and an enhancement layer;

means for obtaining a reference layer picture from the reference layer;

means for upsampling the reference layer picture in a first spatial dimension to generate an intermediate output;

means for determining a bit depth of the reference layer picture;

means for determining a number of bits to shift the intermediate output based upon the bit depth of the reference layer picture

means for shifting the intermediate output by the number of bits to obtain a constrained intermediate output;

means for upsampling the constrained intermediate output in a second spatial dimension to generate an upsampled version of the reference layer picture, wherein the second spatial dimension is orthogonal to the first spatial dimension; and

means for predicting a current picture from the enhancement layer using the upsampled version of the reference layer picture in order to perform inter layer prediction.

32. The apparatus of claim 1 , further comprising a camera configured to capture video data.

33. The apparatus of claim 1 , further comprising a display configured to display decoded video data.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE FIRST NAME OF FIRST ASSIGNOR PREVIOUSLY RECORDED AT REEL: 033374 FRAME: 0413. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 28, 2014
From: CHEN, JIANLE; LI, XIANG; PU, WEI; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 033429/0368 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2014
From: CHEN, JINALE; LI, XIANG; PU, WEI; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 033374/0413 →
Continuity (2)
Provisional Application 61832648 · Jun 7, 2013
Related Publication 20140362909A1 · Dec 11, 2014