Method and device for subpicture-based image encoding/decoding, and method for transmitting bitstream
View Patent ↗An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method comprises determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) applies to a current block, based on BDOF or PROF applying to the current block, fetching a prediction sample of the current block from a reference picture of the current block based on motion information of the current block, and deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the fetched prediction sample.
1. An image decoding method performed by an image decoding apparatus, the image decoding method comprising:
determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) is applied to a current block;
based on BDOF or PROF being applied to the current block, generating a prediction sample of the current block from a reference picture of the current block based on motion information of the current block; and
deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the generated prediction sample,
wherein the generating the prediction sample of the current block is performed based on whether a current subpicture including the current block is treated as a picture,
wherein the generating the prediction sample of the current block comprises obtaining a reference sample specified by a position inside the reference picture and left-shifting a value of the reference sample,
wherein the position inside the reference picture is clipped in a predetermined range,
wherein, based on the current subpicture being treated as the picture, the predetermined range is specified by a boundary position of the current subpicture,
wherein the position inside the reference picture comprises an x-coordinate and a y-coordinate,
wherein the x-coordinate is clipped in a range of a left boundary position and right boundary position of the current subpicture,
wherein the y-coordinate is clipped in a range of a top boundary position and bottom boundary position of the current subpicture,
wherein the left boundary position of the current subblock is derived as a product of a left position of the current subpicture in a unit of a predetermined size and the predetermined size,
wherein the right boundary position of the current subpicture is derived by performing “−1” operation on a product of a right position of the current subpicture in a unit of the predetermined size and the predetermined size,
wherein the top boundary position of the current subpicture is derived as a product of a top position of the current subpicture in a unit of the predetermined size and the predetermined size, and
wherein the bottom boundary position of the current subpicture is derived by performing “−1” operation on a product of a bottom position of the current subpicture in a unit of the predetermined size and the predetermined size.
2. The image decoding method of claim 1 , wherein whether the current subpicture is treated as the picture is determined based on flag information signaled through a bitstream.
3. The image decoding method of claim 2 , wherein the flag information is signaled through a sequence parameter set (SPS).
4. The image decoding method of claim 1 , wherein the predetermined unit is a grid or a CTU.
5. The image decoding method of claim 1 , wherein, based on the current subpicture being not treated as the picture, the predetermined range is a range of a current picture including the current block.
6. An image encoding method performed by an image encoding apparatus, the image encoding method comprising:
determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) is applied to a current block;
based on BDOF or PROF being applied to the current block, generating a prediction sample of the current block from a reference picture of the current block based on motion information of the current block; and
deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the generated prediction sample,
wherein the generating the prediction sample of the current block is performed based on whether a current subpicture including the current block is treated as a picture,
wherein the generating the prediction sample of the current block comprises obtaining a reference sample specified by a position inside the reference picture and left-shifting a value of the reference sample,
wherein the position inside the reference picture is clipped in a predetermined range,
wherein, based on the current subpicture being treated as the picture, the predetermined range is specified by a boundary position of the current subpicture,
wherein the position inside the reference picture comprises an x-coordinate and a y-coordinate,
wherein the x-coordinate is clipped in a range of a left boundary position and right boundary position of the current subpicture,
wherein the y-coordinate is clipped in a range of a top boundary position and bottom boundary position of the current subpicture,
wherein the left boundary position of the current subblock is derived as a product of a left position of the current subpicture in a unit of a predetermined size and the predetermined size,
wherein the right boundary position of the current subpicture is derived by performing “−1” operation on a product of a right position of the current subpicture in a unit of the predetermined size and the predetermined size,
wherein the top boundary position of the current subpicture is derived as a product of a top position of the current subpicture in a unit of the predetermined size and the predetermined size, and
wherein the bottom boundary position of the current subpicture is derived by performing “−1” operation on a product of a bottom position of the current subpicture in a unit of the predetermined size and the predetermined size.
7. A method of transmitting a bitstream generated by the image encoding method of claim 6 .
8. A non-transitory computer readable recording medium storing a bitstream generated by the image encoding method, the image encoding method comprising:
determining whether bi-directional optical flow (BDOF) or prediction refinement with optical flow (PROF) is applied to a current block;
based on BDOF or PROF being applied to the current block, generating a prediction sample of the current block from a reference picture of the current block based on motion information of the current block; and
deriving a refined prediction sample for the current block, by applying BDOF or PROF to the current block based on the generated prediction sample,
wherein the generating the prediction sample of the current block is performed based on whether a current subpicture including the current block is treated as a picture,
wherein the generating the prediction sample of the current block comprises obtaining a reference sample specified by a position inside the reference picture and left-shifting a value of the reference sample,
wherein the position inside the reference picture is clipped in a predetermined range,
wherein, based on the current subpicture being treated as the picture, the predetermined range is specified by a boundary position of the current subpicture,
wherein the position inside the reference picture comprises an x-coordinate and a y-coordinate,
wherein the x-coordinate is clipped in a range of a left boundary position and right boundary position of the current subpicture,
wherein the y-coordinate is clipped in a range of a top boundary position and bottom boundary position of the current subpicture,
wherein the left boundary position of the current subblock is derived as a product of a left position of the current subpicture in a unit of a predetermined size and the predetermined size,
wherein the right boundary position of the current subpicture is derived by performing “−1” operation on a product of a right position of the current subpicture in a unit of the predetermined size and the predetermined size,
wherein the top boundary position of the current subpicture is derived as a product of a top position of the current subpicture in a unit of the predetermined size and the predetermined size, and
wherein the bottom boundary position of the current subpicture is derived by performing “−1” operation on a product of a bottom position of the current subpicture in a unit of the predetermined size and the predetermined size.