IP Library Granted Patent US 11,206,405
Granted Patent B2
US 11,206,405 · App. 16/988,513 · Granted Dec 21, 2021

Video encoding method and apparatus, video decoding method and apparatus, computer device, and storage medium

Inventors: Xinwei Gao (Shenzhen, CN); Xunan Mao (Shenzhen, CN); Chenchen Gu (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
H04N19/132H04N19/124H04N19/147H04N19/176H04N19/513H04N19/523H04N19/59
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,206,405
App. No.
16/988,513
Granted
Dec 21, 2021
Kind
B2
Abstract

This application relates to a video decoding method performed at a computer device. The method includes: obtaining encoded data corresponding to a current video frame; obtaining a processing parameter corresponding to the current video frame; determining a target processing manner corresponding to the current video frame according to the processing parameter, the target processing manner being one of candidate processing manners, the candidate processing manners comprising at least one of a full resolution processing manner and a downsampling processing manner, and the processing parameter being consistent with a corresponding processing parameter in an encoding process; and decoding the encoded data corresponding to the current video frame according to the target processing manner, to obtain a corresponding decoded video frame. In the encoding method, a processing manner for a video frame can be flexibly selected, thereby improving video encoding quality in the case of limited bandwidth.

Claims (87)

1. A video decoding method, applied to a computer device having a processor and memory storing a plurality of computer programs to be executed by the processor, the method comprising:

obtaining encoded data corresponding to a current video frame;

obtaining a processing parameter corresponding to the current video frame, including:

obtaining bit rate information corresponding to the current video frame; and

obtaining original resolution information and a first threshold that correspond to the current video frame;

determining a target processing manner corresponding to the current video frame according to the processing parameter, the target processing manner being one of a plurality of candidate processing manners, the candidate processing manners comprising at least one of a full resolution processing manner and a downsampling processing manner, and the processing parameter is consistent with a corresponding processing parameter in an encoding process, the determining including:

calculating a first ratio between the bit rate information and the original resolution information; and

determining the target processing manner corresponding to the current video frame according to the first ratio and the first threshold; and

decoding the encoded data corresponding to the current video frame according to the target processing manner, to obtain a corresponding decoded video frame.

2. The method according to claim 1 , wherein the obtaining a processing parameter corresponding to the current video frame comprises:

obtaining a frame type corresponding to the current video frame, and obtaining the processing parameter corresponding to the current video frame according to the frame type.

3. The method according to claim 1 , wherein the determining a target processing manner corresponding to the current video frame according to the processing parameter further includes:

calculating a second ratio of encoded blocks of a target prediction type in a forward decoded video frame corresponding to the current video frame, the second ratio being a ratio of the encoded blocks of the target prediction type to encoded blocks of other prediction types, or the second ratio being a ratio of a quantity of the encoded blocks of the target prediction type to a total quantity of encoded blocks; and

determining the target processing manner corresponding to the current video frame according to the second ratio.

4. The method according to claim 3 , wherein the encoded blocks of the target prediction type are intra-coded blocks;

the calculating a second ratio of encoded blocks of a target prediction type in a forward decoded video frame corresponding to the current video frame comprises:

calculating a second ratio of the intra-coded blocks in the forward decoded video frame in the forward decoded video frame; and

the determining the target processing manner corresponding to the current video frame according to the second ratio comprises:

determining, in a case that the second ratio is greater than a second threshold, that the target processing manner is a downsampling processing manner.

5. The method according to claim 4 , further comprising:

obtaining a processing manner corresponding to a reference frame corresponding to the current video frame; and

determining the second threshold according to the processing manner.

6. The method according to claim 1 , wherein the obtaining a processing parameter corresponding to the current video frame, and determining a target processing manner corresponding to the current video frame according to the processing parameter comprises:

obtaining a current quantization parameter corresponding to the current video frame;

obtaining a quantization parameter threshold corresponding to the current video frame; and

determining a processing manner corresponding to the current video frame according to a magnitude relationship between the current quantization parameter and the quantization parameter threshold.

7. The method according to claim 1 , wherein the decoding the encoded data corresponding to the current video frame according to the target processing manner, to obtain a corresponding decoded video frame comprises:

determining resolution information corresponding to the current video frame according to the target processing manner;

decoding the encoded data according to the resolution information corresponding to the current video frame, to obtain a reconstructed video frame corresponding to the current video frame; and

processing the reconstructed video frame according to the resolution information corresponding to the current video frame, to obtain the corresponding decoded video frame.

8. The method according to claim 1 , wherein the processing parameter comprises:

encoded data transmitted to a decoder side; or

processing data obtained according to the encoded data transmitted to the decoder side; or

the encoded data and the processing data.

9. The method according to claim 1 , wherein the determining a target processing manner corresponding to the current video frame according to the processing parameter further includes:

obtaining a forward encoded block in a forward decoded video frame corresponding to the current video frame;

calculating a module gradient corresponding to the forward encoded block;

classifying the forward encoded block into a target module class in a module class set according to the module gradient, candidate module classes in the module class set being respectively corresponding to different module gradient ranges;

obtaining a correspondence between the candidate module classes and the candidate processing manners; and

determining the target processing manner corresponding to the current video frame according to the target module class and the correspondence between the candidate module classes and the candidate processing manners.

10. The method according to claim 1 , wherein the determining a target processing manner corresponding to the current video frame according to the processing parameter further includes:

calculating a target image content complexity corresponding to a forward reconstruction frame corresponding to the current video frame;

obtaining a correspondence between the candidate image content complexity and the candidate processing manners; and

determining the target processing manner corresponding to the target image content complexity according to the correspondence.

11. A computer device, comprising:

a processor; and

memory, the memory storing a plurality of computer programs that, when executed by the processor, cause the processor to perform a plurality of operations including:

obtaining encoded data corresponding to a current video frame;

obtaining a processing parameter corresponding to the current video frame, including:

obtaining bit rate information corresponding to the current video frame; and

obtaining original resolution information and a first threshold that correspond to the current video frame;

determining a target processing manner corresponding to the current video frame according to the processing parameter, the target processing manner being one of a plurality of candidate processing manners, the candidate processing manners comprising at least one of a full resolution processing manner and a downsampling processing manner, and the processing parameter is consistent with a corresponding processing parameter in an encoding process, the determining including:

calculating a first ratio between the bit rate information and the original resolution information; and

determining the target processing manner corresponding to the current video frame according to the first ratio and the first threshold; and

decoding the encoded data corresponding to the current video frame according to the target processing manner, to obtain a corresponding decoded video frame.

12. The computer device according to claim 11 , wherein the obtaining a processing parameter corresponding to the current video frame comprises:

obtaining a frame type corresponding to the current video frame, and obtaining the processing parameter corresponding to the current video frame according to the frame type.

13. The computer device according to claim 11 , wherein the determining a target processing manner corresponding to the current video frame according to the processing parameter further includes:

calculating a second ratio of encoded blocks of a target prediction type in a forward decoded video frame corresponding to the current video frame, the second ratio being a ratio of the encoded blocks of the target prediction type to encoded blocks of other prediction types, or the second ratio being a ratio of a quantity of the encoded blocks of the target prediction type to a total quantity of encoded blocks; and

determining the target processing manner corresponding to the current video frame according to the second ratio.

14. The computer device according to claim 11 , wherein the obtaining a processing parameter corresponding to the current video frame, and determining a target processing manner corresponding to the current video frame according to the processing parameter comprises:

obtaining a current quantization parameter corresponding to the current video frame;

obtaining a quantization parameter threshold corresponding to the current video frame; and

determining a processing manner corresponding to the current video frame according to a magnitude relationship between the current quantization parameter and the quantization parameter threshold.

15. The computer device according to claim 11 , wherein the decoding the encoded data corresponding to the current video frame according to the target processing manner, to obtain a corresponding decoded video frame comprises:

determining resolution information corresponding to the current video frame according to the target processing manner;

decoding the encoded data according to the resolution information corresponding to the current video frame, to obtain a reconstructed video frame corresponding to the current video frame; and

processing the reconstructed video frame according to the resolution information corresponding to the current video frame, to obtain the corresponding decoded video frame.

16. The computer device according to claim 11 , wherein the determining a target processing manner corresponding to the current video frame according to the processing parameter further includes:

obtaining a forward encoded block in a forward decoded video frame corresponding to the current video frame;

calculating a module gradient corresponding to the forward encoded block;

classifying the forward encoded block into a target module class in a module class set according to the module gradient, candidate module classes in the module class set being respectively corresponding to different module gradient ranges;

obtaining a correspondence between the candidate module classes and the candidate processing manners; and

determining the target processing manner corresponding to the current video frame according to the target module class and the correspondence between the candidate module classes and the candidate processing manners.

17. The computer device according to claim 11 , wherein the determining a target processing manner corresponding to the current video frame according to the processing parameter comprises:

calculating a target image content complexity corresponding to a forward reconstruction frame corresponding to the current video frame;

obtaining a correspondence between the candidate image content complexity and the candidate processing manners; and

determining the target processing manner corresponding to the target image content complexity according to the correspondence.

18. A non-transitory computer-readable storage medium, storing a plurality of computer programs, the computer programs, when executed by a processor of a computer device, causing the computer device to perform a plurality of operations including:

obtaining encoded data corresponding to a current video frame;

obtaining a processing parameter corresponding to the current video frame, including:

obtaining bit rate information corresponding to the current video frame; and

obtaining original resolution information and a first threshold that correspond to the current video frame;

determining a target processing manner corresponding to the current video frame according to the processing parameter, the target processing manner being one of a plurality of candidate processing manners, the candidate processing manners comprising at least one of a full resolution processing manner and a downsampling processing manner, and the processing parameter is consistent with a corresponding processing parameter in an encoding process, the determining including:

calculating a first ratio between the bit rate information and the original resolution information; and

determining the target processing manner corresponding to the current video frame according to the first ratio and the first threshold; and

decoding the encoded data corresponding to the current video frame according to the target processing manner, to obtain a corresponding decoded video frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2020
From: GAO, XINWEI; MAO, XUNAN; GU, CHENCHEN
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 054021/0070 →
Priority Claims (1)
CN 201810636200.4 · Jun 20, 2018 · national
Continuity (2)
Continuation PCTCN2019090277 · Jun 6, 2019
Related Publication 20200396460A1 · Dec 17, 2020
Cited By (1)
US 12,425,464