IP Library Granted Patent US 10,643,305
Granted Patent B2
US 10,643,305 · App. 16/069,185 · Granted May 5, 2020

Compression method and apparatus for panoramic stereo video system

Inventors: Jingyi Yu (Shanghai, CN); Yi Ma (Shanghai, CN)
Assignee: SHANGHAITECH UNIVERSITY
G06T3/4038G06K9/6202G06T3/0093G06T3/40G06T7/337G06T7/74G06T7/85H04N5/23238H04N13/106H04N13/128H04N13/239H04N13/243H04N13/246H04N13/282H04N19/126H04N19/159H04N19/176H04N19/523G06T2207/10021H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,643,305
App. No.
16/069,185
Granted
May 5, 2020
Kind
B2
Abstract

A method of compressing a stereoscopic video including a left view frame and a right view frame is provided, the method including: determining a texture saliency value for a first block in the left view frame by intra prediction ( 1101 ); determining a motion saliency value for the first block by motion estimation ( 1102 ); determining a disparity saliency value between the first block and a corresponding second block in the right view frame ( 1103 ); determining a quantization parameter based on the disparity saliency value, the texture saliency value, and the motion saliency value ( 1104 ); and performing quantization of the first block in accordance with the quantization parameter ( 1105 ).

Claims (52)

1. A method of compressing a stereoscopic video comprising a left view frame and a right view frame, the method comprising:

determining a texture saliency value for a first block in the left view frame by intra prediction;

determining a motion saliency value for the first block by motion estimation in inter prediction;

determining a disparity saliency value between the first block and a corresponding second block in the right view frame;

determining a quantization parameter based on the disparity saliency value, the texture saliency value, and the motion saliency value;

performing quantization of the first block in accordance with the quantization parameter;

determining a hybrid stereo saliency value for the first block by superposing the disparity saliency value, the texture saliency value, and the motion saliency value with weighting parameters;

determining a hybrid stereo saliency map for the left view frame;

in response to a size of the first block is different from a size of a transform unit, downscaling the hybrid stereo saliency map to match the dimensions of the transform unit;

determining a second quantization parameter for the transform unit; and

performing quantization of the transform unit in accordance with the second quantization parameter.

2. The method of claim 1 , further comprising:

determining the texture saliency value based on output of a DC mode intra prediction in high efficiency video coding (HEVC).

3. The method of claim 1 , further comprising:

determining a motion saliency value for the first block based on output of motion estimation in high efficiency video coding (HEVC).

4. The method of claim 1 , wherein the left view frame and the right view frame are rectified in a first direction, and the method further comprising:

searching the disparity saliency value in a second direction perpendicular to the first direction.

5. The method of claim 4 , wherein the disparity saliency value comprises a non-integer value.

6. The method of claim 5 , further comprising:

determining the disparity saliency value based on quarter-pixel samples generated by sub-pixel motion estimation in high efficiency video coding (HEVC).

7. A method of compressing a stereoscopic video comprising a left view frame and a right view frame, the method comprising:

determining a texture saliency value for a first block in the left view frame by intra prediction;

determining a motion saliency value for the first block by motion estimation in inter prediction;

determining a disparity saliency value between the first block and a corresponding second block in the right view frame;

determining a quantization parameter based on the disparity saliency value, the texture saliency value, and the motion saliency value;

performing quantization of the first block in accordance with the quantization parameter,

wherein the left view frame is divided into a plurality of non-overlapping blocks, and the motion estimation is based on a same size as the first block;

determining a hybrid stereo saliency map for the left view frame;

in response to a size of the first block is different from a size of a transform unit, downscaling the hybrid stereo saliency map to match the dimensions of the transform unit;

determining a second quantization parameter for the transform unit; and

performing quantization of the transform unit in accordance with the second quantization parameter.

8. A non-transitory computer-readable medium having stored thereon computer-executable instructions, said computer-executable instructions comprising a method of compressing a stereoscopic video comprising a left view frame and a right view frame, the method comprising:

determining a texture saliency value for a first block in the left view frame by intra prediction;

determining a motion saliency value for the first block by motion estimation;

determining a disparity saliency value between the first block and a corresponding second block in the right view frame;

determining a quantization parameter based on the disparity saliency value, the texture saliency value, and the motion saliency value;

performing quantization of the first block in accordance with the quantization parameter;

determining a hybrid stereo saliency value for the first block by superposing the disparity saliency value, the texture saliency value, and the motion saliency value with weighting parameters;

determining a hybrid stereo saliency map for the left view frame;

in response to a size of the first block is different from a size of a transform unit, downscaling the hybrid stereo saliency map to match the dimensions of the transform unit;

determining a second quantization parameter for the transform unit; and

performing quantization of the transform unit in accordance with the second quantization parameter.

9. The computer-readable medium of claim 8 , the method further comprising:

determining the texture saliency value based on output of a DC mode intra prediction in high efficiency video coding (HEVC).

10. The computer-readable medium of claim 8 , the method further comprising:

determining a motion saliency value for the first block based on output of motion estimation in high efficiency video coding (HEVC).

11. The computer-readable medium of claim 8 , wherein the left view frame is divided into a plurality of non-overlapping blocks, and the motion estimation is based on a same size as the first block.

12. The computer-readable medium of claim 8 , wherein the left view frame and the right view frame are rectified in a first direction, and the method further comprising:

searching the disparity saliency value in a second direction perpendicular to the first direction.

13. The computer-readable medium of claim 12 , wherein the disparity saliency value comprises a non-integer value.

14. The computer-readable medium of claim 13 , the method further comprising:

determining the disparity saliency value based on quarter-pixel samples generated by sub-pixel motion estimation in high efficiency video coding (HEVC).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2018
From: YU, JINGYI; MA, YI
To: SHANGHAITECH UNIVERSITY
Reel/Frame 046657/0950 →
Priority Claims (2)
WO PCT/CN2016/070712 · Jan 12, 2016 · international
WO PCT/CN2016/070823 · Jan 13, 2016 · international
Continuity (1)
Related Publication 20190028707A1 · Jan 24, 2019
Cited By (1)
US 12,647,597