IP Library › Granted Patent US 11,412,228
Granted Patent B2
US 11,412,228 · App. 16/992,032 · Granted Aug 9, 2022

Method and apparatus for video encoding and decoding

Inventors: Xinwei Gao (Shenzhen, CN); Xunan Mao (Shenzhen, CN); Chenchen Gu (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
H04N19/139H04N19/124H04N19/176H04N19/61H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,412,228
App. No.
16/992,032
Granted
Aug 9, 2022
Kind
B2
Abstract

A video coding method includes: obtaining a current frame from a plurality of video frames to be encoded, the plurality of video frames having different resolutions; determining a target motion vector (MV) corresponding to each block in the current frame at a target resolution represented by selected target MV resolution information; obtaining a motion vector prediction (MVP) corresponding to each block and at the target resolution; and encoding the current frame according to a motion vector difference (MVD) between each target MV and the MVP of each block to obtain encoded data. The encoded data includes identification information representing the target resolution.

Claims (69)

1. A method, performed by a computer device, the method comprising:

obtaining a current frame from a plurality of video frames to be encoded, the plurality of video frames having different resolutions;

determining a target motion vector (MV) corresponding to each block in the current frame at a target resolution represented by target MV resolution information, by:

determining an initial MV corresponding to the each block in the current frame at a current resolution of the current frame; and

upon detecting that the target resolution is inconsistent with the current resolution of the current frame, transforming the initial MV to the target MV at the target resolution;

obtaining a motion vector prediction (MVP) corresponding to the each block and at the target resolution; and

encoding the current frame according to a motion vector difference (MVD) between the target MV and the MVP of the each block to obtain encoded data, the encoded data comprising identification information representing the target resolution.

2. The method according to claim 1 ,

wherein the target MV resolution information is selected from first MV resolution information and second MV resolution information, a first resolution represented by the first MV resolution information being an original resolution of an original video frame corresponding to the current frame, and a second resolution represented by the second MV resolution information being a current resolution of the current frame.

3. The method according to claim 2 , wherein the target MV resolution information is selected from the first MV resolution information and the second MV resolution information by:

determining a reference frame corresponding to the current frame;

obtaining encoding costs corresponding to the reference frame respectively at the first resolution and the second resolution; and

selecting the target MV resolution information from the first MV resolution information and the second MV resolution information according to the obtained encoding costs.

4. The method according to claim 1 , wherein obtaining the MVP corresponding to the each block and at the target resolution comprises:

determining a reference frame in which a reference block corresponding to a current block is located;

determining, in the reference frame, an image block corresponding to the current block; and

obtaining a target MV corresponding to the image block and at the target resolution as an MVP of the current block.

5. The method according to claim 4 , wherein obtaining the target MV corresponding to the image block and at the target resolution as the MVP of the current block comprises:

obtaining an initial MV corresponding to the image block; and

transforming the initial MV of the image block to the target MV as the MVP of the current block.

6. The method according to claim 1 , wherein obtaining the current frame comprises:

obtaining an original video frame;

and

processing the original video frame in a processing manner, to obtain the current frame, the processing manner being a full resolution processing manner or a down-sampling processing manner.

7. A method, performed by a computer device, the method comprising:

obtaining encoded data corresponding to a current frame to be decoded;

extracting a motion vector difference (MVD) corresponding to each block in the current frame from the encoded data, the MVD corresponding to a target resolution represented by identification information comprised in the encoded data;

determining a motion vector prediction (MVP) corresponding to the each block;

processing the MVD and the MVP corresponding to the each block at the same resolution upon detecting that the target resolution is inconsistent with a resolution of the current frame, to obtain a motion vector (MV) of the corresponding block and at the resolution of the current frame;

determining a reference block corresponding to the each block according to an MV corresponding to the each block; and

reconstructing the current frame according to each reference block and the encoded data.

8. The method according to claim 7 , wherein processing the MVD and the MVP corresponding to the each block comprises:

transforming an MVD corresponding to a current block to a target MVD at the resolution of the current frame; and

obtaining an MV corresponding to the current block and at the resolution of the current frame according to the target MVD and the MVP corresponding to the current block.

9. The method according to claim 7 , wherein processing the MVD and the MVP corresponding to the each block comprises:

obtaining an initial MV corresponding to the current block according to an MVD and an MVP corresponding to the current block; and

transforming the initial MV to an MV at the resolution of the current frame.

10. The method according to claim 9 , further comprising:

respectively transforming the MVD and the MVP corresponding to the current block to a target MVD and a target MVP at the resolution of the current frame; and

obtaining, according to the target MVD and the target MVP, the MV corresponding to the current block and at the resolution of the current frame.

11. The method according to claim 7 , wherein determining the MVP corresponding to the each block comprises:

determining a reference frame in which a reference block corresponding to a current block is located;

determining, in the reference frame, an image block corresponding to the current block; and

using an MV corresponding to the image block as an MVP of the current block.

12. The method according to claim 7 , wherein the target resolution is a resolution of an original video frame corresponding to the encoded data or the resolution of the current frame.

13. A non-transitory computer-readable storage medium, storing a computer program, the computer program, when executed by a processor, causing the processor to perform:

obtaining a current frame from a plurality of video frames to be encoded having different resolutions;

determining a target motion vector (MV) corresponding to each block in the current frame at a target resolution represented by target MV resolution information, by:

determining an initial MV corresponding to the each block in the current frame at a current resolution of the current frame; and

upon detecting that the target resolution is inconsistent with the current resolution of the current frame, transforming the initial MV to the target MV at the target resolution;

obtaining a motion vector prediction (MVP) corresponding to the each block and at the target resolution; and

encoding the current frame according to a motion vector difference (MVD) between the target MV and the MVP of the each block to obtain encoded data, the encoded data comprising identification information representing the target resolution.

14. The storage medium according to claim 13 ,

wherein the target MV resolution information is selected from first MV resolution information and second MV resolution information, a first resolution represented by the first MV resolution information being an original resolution of an original video frame corresponding to the current frame, and a second resolution represented by the second MV resolution information being a current resolution of the current frame.

15. The storage medium according to claim 14 , wherein the target MV resolution information is selected from first MV resolution information and second MV resolution information comprises:

determining a reference frame corresponding to the current frame;

obtaining encoding costs corresponding to the reference frame respectively at the first resolution and the second resolution; and

selecting the target MV resolution information from the first MV resolution information and the second MV resolution information according to the obtained encoding costs.

16. The storage medium according to claim 13 , wherein obtaining the MVP corresponding to the each block and at the target resolution comprises:

determining a reference frame in which a reference block corresponding to a current block is located;

determining, in the reference frame, an image block corresponding to the current block; and

obtaining a target MV corresponding to the image block and at the target resolution as an MVP of the current block.

17. The storage medium according to claim 16 , wherein obtaining the target MV corresponding to the image block and at the target resolution as the MVP of the current block comprises:

obtaining an initial MV corresponding to the image block; and

transforming the initial MV of the image block to the target MV as the MVP of the current block.

18. The storage medium according to claim 13 , wherein obtaining the current frame comprises:

obtaining an original video frame;

and

processing the original video frame in a processing manner, to obtain the current frame, the processing manner being a full resolution processing manner or a down-sampling processing manner.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2020
From: GAO, XINWEI; MAO, XUNAN; GU, CHENCHEN
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 053479/0648 →
Priority Claims (1)
CN 201810636182.X · Jun 20, 2018 · national
Continuity (2)
Continuation PCTCN2019091165 · Jun 13, 2019
Related Publication 20200374525A1 · Nov 26, 2020