IP Library Granted Patent US 12,047,571
Granted Patent B2
US 12,047,571 · App. 17/311,200 · Granted Jul 23, 2024

Tile group partitioning

Inventor: Yong He (San Diego, CA)
Assignee: VID SCALE, Inc.
H04N19/119H04N19/105H04N19/167H04N19/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,047,571
App. No.
17/311,200
Granted
Jul 23, 2024
Kind
B2
Abstract

A system may identify a defined rectangular picture area and render video corresponding to the defined rectangular picture area. The system may receive a video bitstream comprising a picture having a header and may receive data specifying a structure of the picture. The system may parse the data specifying the structure of the picture for an identifier corresponding to a defined rectangular area in the first picture and for a tile index of a top left tile in the defined rectangular area. The system may determine one or more tiles comprised in the defined rectangular area based on the identifier corresponding to the defined rectangular area and the tile index of the top left tile. The system may reconstruct the picture including a sub-picture that comprises the defined rectangular area based upon the identifier corresponding to the defined rectangular area. The computing system may render the sub-picture in the defined rectangular area.

Claims (71)

1. A method of video decoding, comprising:

receiving video data comprising a picture and a picture parameter set;

identifying, based on the picture parameter set, structure data regarding structure of the picture;

determining, based on the structure data regarding structure of the picture, an identifier corresponding to a defined rectangular area comprised in the picture;

determining one or more tiles comprised in the defined rectangular area based upon a width of the defined rectangular area and a height of the defined rectangular area, wherein the width of the defined rectangular area is indicated as a number of tile columns in the structure data regarding structure of the picture and the height of the defined rectangular area is indicated as a number of tile rows in the structure data regarding structure of the picture;

parsing the structure data regarding structure of the picture to identify an identifier associated with a sub-picture that comprises the defined rectangular area;

identifying a sub-bitstream associated with the sub-picture based upon the identifier corresponding to the defined rectangular area matching the identifier associated with the sub-picture; and

reconstructing the sub-picture based on the sub-bitstream.

2. The method of claim 1 , further comprising:

rendering the sub-picture in the defined rectangular area.

3. The method of claim 1 ,

wherein the picture comprises a plurality of sub-pictures, and

wherein the method further comprising:

determining, in the structure data regarding structure of the picture in the picture parameter set, a second identifier corresponding to a second defined rectangular area;

identifying a second sub-bitstream associated with a second sub-picture based upon the second identifier corresponding to the second defined rectangular area; and

reconstructing the second sub-picture based on the second sub-bitstream, wherein the picture is reconstructed having the sub-picture that comprises the defined rectangular area and the second sub-picture that comprises the second defined rectangular area.

4. The method of claim 1 , wherein the video data comprises Versatile Video Coding (VVC) formatted data.

5. The method of claim 1 , wherein the video data comprises omnidirectional video data.

6. A video decoding device comprising:

a processor configured to:

receive video data comprising a picture and a picture parameter set;

identify, based on the picture parameter set, structure data regarding structure of the picture;

determine, based on the structure data regarding structure of the picture, an identifier corresponding to a defined rectangular area comprised in the picture;

determine one or more tiles comprised in the defined rectangular area based upon a width of the defined rectangular area and a height of the defined rectangular area, wherein the width of the defined rectangular area is indicated as a number of tile columns in the structure data regarding structure of the picture and the height of the defined rectangular area is indicated as a number of tile rows in the structure data regarding structure of the picture;

parse the structure data regarding structure of the picture to identify an identifier associated with a sub-picture that comprises the defined rectangular area;

identify sub-bitstream associated with the sub-picture based upon the identifier corresponding to the defined rectangular area matching the identifier associated with the sub-picture; and

reconstruct the sub-picture based on the sub-bitstream.

7. The video decoding device of claim 6 ,

wherein the processor is further configured to:

render the sub-picture in the defined rectangular area.

8. The video decoding device of claim 6 ,

wherein the picture comprises a plurality of sub-pictures, and

wherein the processor is further configured to:

determine, in the structure data regarding structure of the picture in the picture parameter set, a second identifier corresponding to a second defined rectangular area;

identify a second sub-bitstream associated with a second sub-picture based upon the second identifier corresponding to the second defined rectangular area; and

reconstruct the second sub-picture based on the second sub-bitstream, wherein the picture is reconstructed having the sub-picture that comprises the defined rectangular area and the second sub-picture that comprises the second defined rectangular area.

9. The video decoding device of claim 6 , wherein the video data comprises Versatile Video Coding (VVC) formatted data.

10. The video decoding device of claim 6 , wherein the video data comprises omnidirectional video data.

11. A non-transitory computer readable medium having stored thereon instructions executable by a processor to:

receive video data comprising a picture and a picture parameter set;

identify, based on the picture parameter set, structure data regarding structure of the picture;

determine, based on the structure data regarding structure of the picture, an identifier corresponding to a defined rectangular area comprised in the picture;

determine one or more tiles comprised in the defined rectangular area based upon a width of the defined rectangular area and a height of the defined rectangular area, wherein the width of the defined rectangular area is indicated as a number of tile columns in the structure data regarding structure of the picture and the height of the defined rectangular area is indicated as a number of tile rows in the structure data regarding structure of the picture;

parse the structure data regarding structure of the picture to identify an identifier associated with a sub-picture that comprises the defined rectangular area;

identify sub-bitstream associated with the sub-picture based upon the identifier corresponding to the defined rectangular area matching the identifier associated with the sub-picture; and

reconstruct the sub-picture based on the sub-bitstream.

12. A method of video encoding comprising:

determining a picture;

determining a picture parameter set, the picture parameter set comprising structure data regarding structure of the picture;

determining an identifier associated with a defined rectangular area in the picture, the defined rectangular area comprising one or more tiles;

determining a width of the defined rectangular area and a height of the defined rectangular area; and

generating video data, the video data comprising the picture, the picture parameter set, the identifier associated with the defined rectangular area, the width of the defined rectangular area indicated as a number of tile columns, and the height of the defined rectangular area indicated as a number of tile rows,

wherein an identifier associated with a sub-picture that comprises the defined rectangular area is identifiable from parsing the structure data regarding structure of the picture, and

wherein a sub-bitstream associated with the sub-picture is identifiably based upon the identifier corresponding to the defined rectangular area matching the identifier associated with the sub-picture.

13. A video encoding device, comprising:

a computing processor configured to:

determine a picture;

determine a picture parameter set, the picture parameter set comprising structure data regarding structure of the picture;

determine an identifier associated with a defined rectangular area in the picture, the defined rectangular area comprising one or more tiles;

determine a width of the defined rectangular area and a height of the defined rectangular area; and

generate video data, the video data comprising the picture, the picture parameter set, the identifier associated with the defined rectangular area, the width of the defined rectangular area indicated as a number of tile columns, and the height of the defined rectangular area indicated as a number of tile rows,

wherein an identifier associated with a sub-picture that comprises the defined rectangular area is identifiable from parsing the structure data regarding structure of the picture, and

wherein a sub-bitstream associated with the sub-picture is identifiably based upon the identifier corresponding to the defined rectangular area matching the identifier associated with the sub-picture.

14. A non-transitory computer readable medium having stored thereon instructions executable by a processor to:

determine a picture;

determine a picture parameter set, the picture parameter set comprising structure data regarding structure of the picture;

determine an identifier associated with a defined rectangular area in the picture, the defined rectangular area comprising one or more tiles;

determine a width of the defined rectangular area and a height of the defined rectangular area; and

generate video data, the video data comprising the picture, the picture parameter set, the identifier associated with the defined rectangular area, the width of the defined rectangular area indicated as a number of tile columns, and the height of the defined rectangular area indicated as a number of tile rows,

wherein an identifier associated with a sub-picture that comprises the defined rectangular area is identifiable from parsing the structure data regarding structure of the picture, and

wherein a sub-bitstream associated with the sub-picture is identifiably based upon the identifier corresponding to the defined rectangular area matching the identifier associated with the sub-picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
Continuity (3)
Provisional Application 62775130 · Dec 4, 2018
Provisional Application 62781749 · Dec 19, 2018
Related Publication 20220007019A1 · Jan 6, 2022
Cited By (1)
US 12,477,136