Granted Patent B2

US 12,206,893 · App. 18/090,340 · Granted Jan 21, 2025

Inventors: Robert Skupin (Berlin, DE); Cornelius Hellge (Berlin, DE); Valeri George (Berlin, DE); Thomas Schierl (Berlin, DE); Yago Sánchez De La Fuente (Berlin, DE); Karsten Sühring (Berlin, DE); Thomas Wiegand (Berlin, DE)

Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEW ANDTEN FORSCHUNG E.V.

H04N19/587H04N19/119H04N19/132H04N19/172H04N19/423H04N19/70

Abstract

Claims (104)

1. A method for video decoding, the method comprising:

decoding, from a bitstream of encoded video data, a flag that indicates whether reference picture resampling is enabled and whether a reference picture has a parameter that may be different from a corresponding parameter of a current picture, wherein a portion of the current picture refers to a portion of the reference picture and the parameter includes at least one of picture height in luma samples and picture width in luma samples, and wherein the reference picture and the current picture are in the same layer;

determining, based on the flag, that reference picture resampling is enabled, that the parameter of the reference picture may be different from the corresponding parameter of the current picture, and that spatial resolution is allowed to change within a coded video sequence;

resampling a portion of the reference picture to generate a resampled portion of the reference picture; and

predicting the current picture using the resampled portion of the reference picture;

wherein a distance between a random-access frame and the current picture is larger than a distance between the reference picture and the current picture.

2. The method of claim 1 , further comprising:

determining that the parameter of the reference picture is different from the corresponding parameter of the current picture; and

in response to the determination that the parameter of the reference picture is different from the corresponding parameter of the current picture, resampling a portion of the reference picture.

3. The method of claim 1 , wherein:

the flag is a first flag; and

the method further comprises decoding, from the bitstream, a second flag that indicates whether spatial resolution changes.

4. The method of claim 1 , further comprising:

determining whether a size of the reference picture and a size of the current picture are different;

in response to a determination that the reference picture size and the current picture size are different, deriving a ratio representing the reference picture size and the current picture size; and

resampling the portion of the reference picture based on the ratio.

5. The method of claim 1 , wherein resampling the portion of the reference picture comprises:

up-sampling the portion of the reference picture to correspond to a spatial resolution of the current picture, when the spatial resolution of the current picture is larger than the spatial resolution of the reference picture; and

down-sampling the portion of the reference picture to correspond to the spatial resolution of the current picture, when the spatial resolution of the current picture is less than the spatial resolution of the reference picture.

6. The method of claim 1 , further comprising:

determining that a temporal distance between the reference picture and the current picture is less than a random access distance, such that a random access point is not positioned between the reference picture and the current picture.

7. An electronic device video decoding, the electronic device comprising:

a processor configured to:

decode, from a bitstream of encoded video data, a flag that indicates whether reference picture resampling is enabled and whether a reference picture has a parameter that may be different from a corresponding parameter of a current picture, wherein a portion of the current picture refers to a portion of the reference picture and the parameter includes at least one of picture height in luma samples and picture width in luma samples, and wherein the reference picture and the current picture are in the same layer;

determine, based on the flag, that reference picture resampling is enabled, that the parameter of the reference picture may be different from the corresponding parameter of the current picture, and that spatial resolution is allowed to change within a coded video sequence;

resample a portion of the reference picture to generate a resampled portion of the reference picture; and

predict the current picture using the resampled portion of the reference picture;

wherein a distance between a random-access frame and the current picture is larger than a distance between the reference picture and the current picture.

8. The electronic device of claim 7 , wherein the processor is further configured to:

determine that the parameter of the reference picture is different from the corresponding parameter of the current picture; and

in response to the determination that the parameter of the reference picture is different from the corresponding parameter of the current picture, resample a portion of the reference picture.

9. The electronic device of claim 7 , wherein:

the flag is a first flag; and

the processor is further configured to decode, from the bitstream, a second flag that indicates whether spatial resolution changes.

10. The electronic device of claim 7 , wherein the processor is further configured to:

determine whether a size of the reference picture and a size of the current picture are different;

in response to a determination that the reference picture size and the current picture size are different, derive a ratio representing the reference picture size and the current picture size; and

resample the portion of the reference picture based on the ratio.

11. The electronic device of claim 7 , wherein to resample the portion of the reference picture, the processor is configured to:

up-sample the portion of the reference picture to correspond to a spatial resolution of the current picture, when the spatial resolution of the current picture is larger than the spatial resolution of the reference picture; and

down-sample the portion of the reference picture to correspond to the spatial resolution of the current picture, when the spatial resolution of the current picture is less than the spatial resolution of the reference picture.

12. The electronic device of claim 7 , wherein the processor is further configured to:

determine that a temporal distance between the reference picture and the current picture is less than a random access distance, such that a random access point is not positioned between the reference picture and the current picture.

13. A non-transitory, computer-readable medium storing instructions that, when executed cause at least one processor of an electronic device to:

decode, from a bitstream of encoded video data, a flag that indicates whether reference picture resampling is enabled and whether a reference picture has a parameter that may be different from a corresponding parameter of a current picture, wherein a portion of the current picture refers to a portion of the reference picture and the parameter includes at least one of picture height in luma samples and picture width in luma samples, and wherein the reference picture and the current picture are in the same layer;

determine, based on the flag, that reference picture resampling is enabled, that the parameter of the reference picture may be different from the corresponding parameter of the current picture, and that spatial resolution is allowed to change within a coded video sequence;

resample a portion of the reference picture to generate a resampled portion of the reference picture; and

predict the current picture using the resampled portion of the reference picture;

wherein a distance between a random-access frame and the current picture is larger than a distance between the reference picture and the current picture.

14. The non-transitory, computer-readable medium of claim 13 , further containing instructions that when executed cause the at least one processor to:

determine that the parameter of the reference picture is different from the corresponding parameter of the current picture; and

in response to the determination that the parameter of the reference picture is different from the corresponding parameter of the current picture, resample a portion of the reference picture.

15. The non-transitory, computer-readable medium of claim 13 , wherein:

the flag is a first flag; and

the instructions that when executed further cause the at least one processor to: decode, from the bitstream, a second flag that indicates whether spatial resolution changes.

16. The non-transitory, computer-readable medium of claim 13 , further containing instructions that when executed cause the at least one processor to:

determine whether a size of the reference picture and a size of the current picture are different;

in response to a determination that the reference picture size and the current picture size are different, derive a ratio representing the reference picture size and the current picture size; and

resample the portion of the reference picture based on the ratio.

17. The non-transitory, computer-readable medium of claim 13 , wherein the instructions that when executed cause the at least one processor to resample the portion of the reference picture, comprise instructions that when executed cause the at least one processor to:

up-sample the portion of the reference picture to correspond to a spatial resolution of the current picture, when the spatial resolution of the current picture is larger than the spatial resolution of the reference picture; and

down-sample the portion of the reference picture to correspond to the spatial resolution of the current picture, when the spatial resolution of the current picture is less than the spatial resolution of the reference picture.

18. The non-transitory, computer-readable medium of claim 13 , further containing instructions that when executed cause the at least one processor to:

determine that a temporal distance between the reference picture and the current picture is less than a random access distance, such that a random access point is not positioned between the reference picture and the current picture.

19. A method for video encoding, the method comprising:

generating a flag with a value indicating:

that reference picture resampling is enabled;

that a reference picture has a parameter that may be different from a corresponding parameter of a current picture, wherein a portion of the current picture refers to a portion of the reference picture and the parameter includes at least one of picture height in luma samples and picture width in luma samples, and wherein the reference picture and the current picture are in the same layer; and

that spatial resolution is allowed to change within a coded video sequence;

resampling a portion of the reference picture to generate a resampled portion of the reference picture; and

encoding the current picture using the resampled portion of the reference picture;

wherein a distance between a random-access frame and the current picture is larger than a distance between the reference picture and the current picture.

20. The method of claim 19 , further comprising:

determining that a temporal distance between the reference picture and the current picture is less than a random access distance, such that a random access point is not positioned between the reference picture and the current picture.

21. The method of claim 19 , wherein:

the flag is a first flag, and

the method further comprises generating a second flag indicating whether pictures included in a sequence parameter set are allowed to be different with respect to respective spatial resolutions thereof.

22. An electronic device video encoding, the electronic device comprising:

a processor configured to:

generate a flag with a value indicating:

that reference picture resampling is enabled;

that a reference picture has a parameter that may be different from a corresponding parameter of a current picture, wherein a portion of the current picture refers to a portion of the reference picture and the parameter includes at least one of picture height in luma samples and picture width in luma samples, and wherein the reference picture and the current picture are in the same layer; and

that spatial resolution is allowed to change within a coded video sequence;

resample a portion of the reference picture to generate a resampled portion of the reference picture; and

encode the current picture using the resampled portion of the reference picture;

wherein a distance between a random-access frame and the current picture is larger than a distance between the reference picture and the current picture.

23. The electronic device of claim 22 , wherein the processor is further configured to:

determine that a temporal distance between the reference picture and the current picture is less than a random access distance, such that a random access point is not positioned between the reference picture and the current picture.

24. The electronic device of claim 22 , wherein:

the flag is a first flag, and

the processor is further configured to generate a second flag indicating whether pictures included in a sequence parameter set are allowed to be different with respect to respective spatial resolutions thereof.

25. A non-transitory, computer-readable medium storing instructions that, when executed cause at least one processor of an electronic device to:

generate a flag with a value indicating:

that reference picture resampling is enabled;

that a reference picture has a parameter that may be different from a corresponding parameter of a current picture, wherein a portion of the current picture refers to a portion of the reference picture and the parameter includes at least one of picture height in luma samples and picture width in luma samples, and wherein the reference picture and the current picture are in the same layer; and

that spatial resolution is allowed to change within a coded video sequence;

resample a portion of the reference picture to generate a resampled portion of the reference picture; and

encode the current picture using the resampled portion of the reference picture;

wherein a distance between a random-access frame and the current picture is larger than a distance between the reference picture and the current picture.

26. The non-transitory, computer-readable medium of claim 25 , further containing instructions that when executed cause the at least one processor to:

determine that a temporal distance between the reference picture and the current picture is less than a random access distance, such that a random access point is not positioned between the reference picture and the current picture.

27. The non-transitory, computer-readable medium of claim 25 , wherein:

the flag is a first flag, and

the instructions that when executed further cause the at least one processor to generate a second flag indicating whether pictures included in a sequence parameter set are allowed to be different with respect to respective spatial resolutions thereof.

Assignments (1)

Priority Claims (1)

Continuity (3)

References Cited (44)