Granted Patent B2

US 12,244,816 · App. 17/465,007 · Granted Mar 4, 2025

Inventors: Adam Wieckowski (Berlin, DE); Robert Skupin (Berlin, DE); Yago Sánchez De La Fuente (Berlin, DE); Cornelius Hellge (Berlin, DE); Thomas Schierl (Berlin, DE); Detlev Marpe (Berlin, DE); Karsten Sühring (Berlin, DE); Thomas Wiegand (Berlin, DE)

Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

H04N19/137H04N19/176H04N19/186H04N19/189

Abstract

Claims (126)

1. A video decoder for decoding a picture of a video, wherein the video decoder comprises:

an input interface configured to receive the encoded video signal; and

a data decoder configured to:

decode chroma format information, the chroma format information indicating that luma subblocks and chroma subblocks are sampled in a 4:2:0 format or a 4:2:2 format;

determine, based on the chroma format information, a sub-height parameter and a sub-width parameter;

determine a motion vector for the chroma subblock based on a first luma motion vector and a second luma motion vector, the first luma motion vector corresponding to a first luma subblock of a plurality of luma subblocks at a first position and the second luma motion vector corresponding to a second luma subblock of the plurality of luma subblocks at a second position, wherein:

the first position is represented by [(xSbIdx>>SubWidthC<<SubWidthC)] [(ySbIdx>>SubHeightC<<SubHeightC)] and

the second position is represented by (xSbIdx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbIdx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbIdx is an x-index of one of the plurality of luma subblocks,

ySbIdx is an y-index of one of the plurality of luma subblocks

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

reconstruct a portion of the picture based on the first luma motion vector, the second luma motion vector, and the motion vector for the chroma subblock.

2. The video decoder of claim 1 , wherein:

when the chroma subblocks are sampled in a 4:2:0 format, the sub-width param and the sub-Height parameter are the same.

3. The video decoder of claim 2 , wherein:

when the chroma subblocks are sampled in a 4:2:2 format, the sub-width param and the sub-Height parameter are different.

4. The video decoder of claim 1 , wherein when the luma subblocks and chroma subblocks are sampled in a 4:2:0 format or a 4:2:2 format the data decoder is configured to determine the motion vector for said chroma subblock depending on each motion vector of exactly two of the luma subblocks.

5. The video decoder of claim 4 ,

wherein the data decoder is configured to determine the motion vector for said chroma subblock based on:

mvAvgLX = ( mvLX[ ( xSbIdx >> SubWidthC << SubWidthC) ]

  [ (ySbIdx>> SubHeightC << SubHeightC) ] +

  mvLX[ ( xSbIdx >> SubWidthC << SubWidthC ) + Sub

 WidthC ]

  [ (ySbIdx>> SubHeightC <<

SubHeightC) + SubHeightC ] )

wherein mvAvgLX is the motion vector for said chroma subblock,

wherein mvLX [ ] [ ] is the motion vector of one of the luma subblocks,

wherein mvAvgLX [0] is defined according to

mvAvgLX[ 0 ] = ( mvAvgLX[ 0 ] >= 0 ?

   ( mvAvgLX[ 0 ] + 1) >> 1 :

   - ( (- mvAvgLX[ 0 ] + 1 ) >>1 ) )

wherein mvAvgLX [1] is defined according to

mvAvgLX[ 1 ] = ( mvAvgLX[ 1 ] >= 0 ?

   ( mvAvgLX[ 1 ] + 1) >> 1 :

   - ( (- mvAvgLX[ 1 ] + 1 ) >> 1 ) ).

wherein SubWidthC and SubHeightC are defined according to:

Chroma Format

SubWidthC

SubHeightC

4:2:0

1

1

4:2:2

1

0.

6. A method for decoding a picture of a video, wherein the method comprises:

receiving the encoded video signal, and

decoding chroma format information the chroma format information indicating that luma subblocks and chroma subblocks are sampled in a 4:2:0 format or a 4:2:2 format;

determining, based on the chroma format information, a sub-height parameter and a sub-width parameter;

determining a motion vector for the chroma subblock based on a first luma motion vector and a second luma motion vector, the first luma motion vector corresponding to a first luma subblock of a plurality of luma subblocks the plurality of luma subblocks at a second position, wherein:

the first position is represented by [(xSbIdx>>SubWidthC<<SubWidthC)] [(ySbIdx>>SubHeightC<<SubHeightC)] and

the second position is represented by (xSbIdx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbIdx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbIdx is an x-index of one of the plurality of luma subblocks,

ySbIdx is an y-index of one of the plurality of luma subblocks

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

reconstructing a portion of the picture based on the first luma motion vector, the second luma motion vector, and the motion vector for the chroma subblock.

7. A non-transitory digital storage medium containing instructions, that when executed by a processor of an electronic device, cause the electronic device to:

receive the encoded video signal, and

decode chroma format information, the chroma format information indicating that luma subblocks and chroma subblocks are sampled in a 4:2:0 format or a 4:2:2 format;

determine, based on the chroma format information, a sub-height parameter and a sub-width parameter;

determine a motion vector for the chroma subblock based on a first luma motion vector and a second luma motion vector, the first luma motion vector corresponding to a first luma subblock of a plurality of luma subblocks at a first position and the second luma motion vector corresponding to a second luma subblock of the plurality of luma subblocks at a second position, wherein:

the first position is represented by [(xSbIdx>>SubWidthC<<SubWidthC)] [(ySbIdx>>SubHeightC<<SubHeightC)] and

the second position is represented by (xSbIdx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbIdx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbIdx is an x-index of one of the plurality of luma subblocks,

ySbIdx is an y-index of one of the plurality of luma subblocks

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

reconstruct a portion of a picture based on the first luma motion vector, the second luma motion vector, and the motion vector for the chroma subblock.

8. A video decoder for decoding a picture of a video, wherein

the video decoder is configured to:

receive the encoded video signal;

decode chroma format information encoded, the chroma format information indicating how luma subblocks and chroma subblocks are sampled;

determine, based on the chroma format information, a sub-height parameter and a subwidth parameter;

determine a motion vector for the chroma subblock based in part on the sub-height parameter, the sub-width parameter, and motion vector information of at least one luma subblock depending on the chroma format information, wherein when the chroma format information indicates a first format, the motion vector for the chroma subblock is determined based on a motion vector of exactly one luma subblock, of the at least one luma subblock, and when the chroma format information indicates a second format, different from the first format, the motion vector for the chroma subblock is determined based on a motion vector of two luma subblocks of the at least one luma subblock, a position of the two luma subblocks is based in part on the sub-height parameter and the sub-width parameter, such that:

a first position of a first of the two luma subblocks is represented by [(xSbldx>>SubWidthC<<SubWidthC)] [(ySbldx>>SubHeightC<<SubHeightC)] and a second position of a second of the two luma subblocks is represented by the second position is represented by (xSbldx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbldx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbldx is an x-index of one of the plurality of luma subblocks,

ySbldx is an y-index of one of the plurality of luma subblocks

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

reconstruct a picture of the plurality of pictures of the video based on the motion vector information of the at least one luma subblock and the motion vector for the chroma subblock.

9. A method for decoding a picture of a video, the method comprising:

receiving the encoded video signal;

decoding chroma format information encoded, the chroma format information indicating how luma subblocks and chroma subblocks are sampled;

determining, based on the chroma format information, a sub-height parameter and a subwidth parameter;

determining a motion vector for the chroma subblock based in part on the sub-height parameter, the sub-width parameter, and motion vector information of at least one luma subblock depending on the chroma format information, wherein when the chroma format information indicates a first format, the motion vector for the chroma subblock is determined based on a motion vector of exactly one luma subblock of the at least one luma subblock, and when the chroma format information indicates a second format, different from the first format, the motion vector for the chroma subblock is determined based on a motion vector of two luma subblocks of the at least one luma subblock, a position of the two luma subblocks is based in part on the sub-height parameter and the sub-width parameter, such that:

a first position of a first of the two luma subblocks is represented by [(xSbldx>>SubWidthC<<SubWidthC)] [(ySbldx>>SubHeightC<<SubHeightC)] and a second position of a second of the two luma subblocks is represented by the second position is represented by (xSbldx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbldx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbldx is an x-index of one of the plurality of luma subblocks,

ySbldx is an y-index of one of the plurality of luma subblocks

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

reconstructing a picture of the plurality of pictures of the video based on the motion vector information of the at least one luma subblock and the motion vector for the chroma subblock.

10. A video encoder for encoding a picture of a video, wherein the video encoder is configured to:

encode chroma format information indicating that luma subblocks and chroma subblocks are sampled in a 4:2:0 format or a 4:2:2 format;

determine, based on the chroma format information, a sub-height parameter and a sub-width parameter;

determine a motion vector for the chroma subblock based on a first luma motion vector and a second luma motion vector, the first luma motion vector corresponding to a first luma subblock of a plurality of luma subblocks at a first position and the second luma motion vector corresponding to a second luma subblock of the plurality of luma subblocks at a second position, wherein:

the first position is represented by [(xSbIdx>>SubWidthC<<SubWidthC)] [(ySbIdx>>SubHeightC<<SubHeightC)] and

the second position is represented by (xSbIdx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbIdx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbIdx is an x-index of one of the plurality of luma subblocks,

ySbIdx is an y-index of one of the plurality of luma subblocks,

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

encode a portion of the picture based on the first luma motion vector, the second luma motion vector, and the motion vector for the chroma subblock.

11. A method of encoding a plurality of pictures of a video, wherein the method comprises:

encoding chroma format information indicating that luma subblocks and chroma subblocks are sampled in a 4:2:0 format or a 4:2:2 format;

determining, based on the chroma format information, a sub-height parameter and a sub-width parameter;

determining a motion vector for the chroma subblock based on a first luma motion vector and a second luma motion vector, the first luma motion vector corresponding to a first luma subblock of a plurality of luma subblocks at a first position and the second luma motion vector corresponding to a second luma subblock of the plurality of luma subblocks at a second position, wherein:

the first position is represented by [(xSbIdx>>SubWidthC<<SubWidthC)] [(ySbIdx>>SubHeightC<<SubHeightC)] and

the second position is represented by (xSbIdx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbIdx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbIdx is an x-index of one of the plurality of luma subblocks,

ySbIdx is an y-index of one of the plurality of luma subblocks,

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

encoding a portion of the picture based on the first luma motion vector, the second luma motion vector, and the motion vector for the chroma subblock.

12. A non-transitory digital storage medium containing instructions, that when executed by a processor of an electronic device, cause the electronic device to:

encode chroma format information indicating that luma subblocks and chroma subblocks are sampled in a 4:2:0 format or a 4:2:2 format;

determine, based on the chroma format information, a sub-height parameter and a sub-width parameter;

determine a motion vector for the chroma subblock based on a first luma motion vector and a second luma motion vector, the first luma motion vector corresponding to a first luma subblock of a plurality of luma subblocks at a first position and the second luma motion vector corresponding to a second luma subblock of the plurality of luma subblocks at a second position, wherein:

the first position is represented by [(xSbIdx>>SubWidthC<<SubWidthC)] [(ySbIdx>>SubHeightC<<SubHeightC)] and

the second position is represented by (xSbIdx>>SubWidthC<<SubWidthC)+SubWidthC] [(ySbIdx>>SubHeightC<<SubHeightC)+SubHeightC], where

xSbIdx is an x-index of one of the plurality of luma subblocks,

ySbIdx is an y-index of one of the plurality of luma subblocks,

SubWidthC is the sub-width parameter, and

SubHeightC is the sub-height parameter; and

encode a portion of the picture based on the first luma motion vector, the second luma motion vector, and the motion vector for the chroma subblock.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (33)