IP Library › Granted Patent US 12,267,525
Granted Patent B2
US 12,267,525 · App. 17/950,619 · Granted Apr 1, 2025

Video processing method and apparatus, device, and storage medium

Inventors: Ying Hu (Shenzhen, CN); Xiaozhong Xu (State College, PA); Shan Liu (San Jose, CA)
Assignee: Tencent Technology (Shenzhen) Company Limited
H04N19/573H04N19/136
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,525
App. No.
17/950,619
Granted
Apr 1, 2025
Kind
B2
Abstract

A video processing method is provided. In the method, a video bit stream is obtained. Configuration information of the video bit stream is determined. The configuration information includes reference image information. The reference image information indicates (i) whether a video track corresponding to the video bit stream includes a reference image and (ii) whether the video track requires reference to the reference image. The video bit stream and the configuration information are encapsulated to obtain the video track.

Claims (64)

1. A video processing method, comprising:

obtaining a video bit stream;

determining, by processing circuitry, configuration information of the video bit stream, the configuration information including reference image information, the reference image information indicating (i) whether a first video track corresponding to the video bit stream includes a first reference image and (ii) whether the first video track requires reference to a second reference image in a second video track; and

encapsulating the video bit stream and the configuration information to obtain the first video track, wherein

a value of the reference image information being a first value indicates that the first video track does not include the first reference image and the first video track does not require reference to the second reference image;

the value of the reference image information being a second value indicates that the first video track does not include the first reference image and the first video track requires reference to the second reference image;

the value of the reference image information being a third value indicates that the first video track includes the first reference image and the first video track does not require reference to the second reference image; and

the value of the reference image information being a fourth value indicates that the first video track includes the first reference image and the first video track requires reference to the second reference image.

2. The method according to claim 1 , wherein the reference image information is included in an Audio Video Coding Standard (AVS) configuration data box.

3. The method according to claim 1 , wherein the determining the configuration information comprises:

determining the reference image information based on a video content of the video bit stream.

4. The method according to claim 1 , wherein the configuration information further includes at least one of:

profile label information that indicates a profile that the video bit stream conforms to;

level label information that indicates a level that the video bit stream conforms to;

chroma format information that indicates a chroma format of the video bit stream;

sample precision information that indicates precision of a luminance sample and a chroma sample of the video bit stream; or

frame rate indication information that indicates a frame rate of the video bit stream.

5. The method according to claim 1 , wherein the configuration information further includes version configuration information that indicates a current configuration version of the video bit stream.

6. The method according to claim 1 , wherein before the obtaining the video bit stream, the method further comprises:

obtaining coding capability information indicating a coding capability of a coding device for a video sequence;

determining a coding policy according to the coding capability information; and

coding the video sequence according to the coding policy to obtain the video bit stream.

7. The method according to claim 1 , further comprising:

receiving, from a client device, a video obtaining request to obtain a video file of a target video;

determining playback capability information of the client device;

obtaining a video track that matches the playback capability information according to configuration information in each video track of the target video;

encapsulating the video track that matches the playback capability information to obtain the video file; and

transmitting the video file to the client device.

8. The method according to claim 7 , wherein the obtaining the video track that matches the playback capability information comprises:

obtaining a configuration mapping relationship that indicates a correspondence between the configuration information and the playback capability information; and

determining the video track associated with the configuration information corresponding to the playback capability information as the video track that matches the playback capability information based on the configuration mapping relationship.

9. The method according to claim 7 , wherein the playback capability information includes at least one of:

decoding capability information indicating a capability of the client device to decode the video file;

presentation capability information indicating a capability of the client device to present the video file; or

network status information indicating a network status of the client device.

10. A video processing method, comprising:

obtaining a video file of a target video;

decapsulating the video file to obtain a first video track of the target video;

decapsulating, by processing circuitry, the first video track to obtain a video bit stream of the target video and configuration information of the video bit stream, the configuration information including reference image information, the reference image information indicating (i) whether the first video track includes a first reference image and (ii) whether the first video track requires reference to a second reference image in a second video track; and

decoding the video bit stream to obtain a video sequence of the target video, wherein

a value of the reference image information being a first value indicates that the first video track does not include the first reference image and the first video track does not require reference to the second reference image;

the value of the reference image information being a second value indicates that the first video track does not include the first reference image and the first video track requires reference to the second reference image;

the value of the reference image information being a third value indicates that the first video track includes the first reference image and the first video track does not require reference to the second reference image; and

the value of the reference image information being a fourth value indicates that the first video track includes the first reference image and the first video track requires reference to the second reference image.

11. The method according to claim 10 , wherein the reference image information is included in an Audio Video Coding Standard (AVS) configuration data box.

12. The method according to claim 10 , wherein the configuration information further comprises at least one of:

profile label information that indicates a profile that the video bit stream conforms to;

level label information that indicates a level that the video bit stream conforms to;

chroma format information that indicates a chroma format of the video bit stream;

sample precision information that indicates precision of a luminance sample and a chroma sample of the video bit stream; or

frame rate indication information that indicates a frame rate of the video bit stream.

13. The method according to claim 10 , wherein the configuration information further includes version configuration information, the version configuration information indicating a current configuration version of the video bit stream.

14. A video processing apparatus, comprising:

processing circuitry configured to:

obtain a video file of a target video;

decapsulate the video file to obtain a first video track of the target video;

decapsulate the first video track to obtain a video bit stream of the target video and configuration information of the video bit stream, the configuration information including reference image information, the reference image information indicating (i) whether the first video track includes a first reference image and (ii) whether the first video track requires reference to a second reference image in a second video track; and

decode the video bit stream to obtain a video sequence of the target video, wherein

a value of the reference image information being a first value indicates that the first video track does not include the first reference image and the first video track does not require reference to the second reference image;

the value of the reference image information being a second value indicates that the first video track does not include the first reference image and the first video track requires reference to the second reference image;

the value of the reference image information being a third value indicates that the first video track includes the first reference image and the first video track does not require reference to the second reference image; and

the value of the reference image information being a fourth value indicates that the first video track includes the first reference image and the first video track requires reference to the second reference image.

15. A non-transitory computer-readable storage medium, storing instructions which when executed by a processor cause the processor to perform the video processing method according to claim 1 .

16. A non-transitory computer-readable storage medium, storing instructions which when executed by a processor cause the processor to perform the video processing method according to claim 10 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2022
From: HU, YING; XU, XIAOZHONG; LIU, SHAN
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 061184/0824 →
Priority Claims (1)
CN 202010853261.3 · Aug 23, 2020 · national
Continuity (2)
Continuation PCTCN2021112353 · Aug 12, 2021
Related Publication 20230022526A1 · Jan 26, 2023
References Cited (16)
US 20120033743A1 · Basso et al. · 2012 [cited by applicant]
US 20140280303A1 · Jain et al. · 2014 [cited by applicant]
US 20210344903A1 · Yu · 2021 [cited by examiner]
CN 109005426A · 2018 [cited by applicant]
CN 110876051A · 2020 [cited by applicant]
CN 110876083A · 2020 [cited by applicant]
CN 110876084A · 2020 [cited by applicant]
CN 110996137A · 2020 [cited by applicant]
CN 111416976A · 2020 [cited by applicant]
CN 111526368A · 2020 [cited by applicant]
EP 3866478A1 · 2021 [cited by examiner]
WO 2020143594A1 · 2020 [cited by applicant]
International Search Report and Written Opinion issued Nov. 1, 2021 in International Application No. PCT/CN2021/112353 with English Translation (8 pages). [cited by applicant]
Chinese Office Action issued Jul. 14, 2022 in Application No. 202010853261.3 with Concise English Translation (10 pages). [cited by applicant]
Supplementary European Search Report issued Dec. 1, 2023 in Application No. 21860164.9 (11 pages). [cited by applicant]
Xuehui Wang et al: “Carriage of AVS video in the ISO Base Media File Format”, 127. MPEG Meeting; Jul. 8, 2019-Jul. 12, 2019; Gothenburg; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m49649, Jul. 6, 2019,… [cited by applicant]