A method of encoding a video signal representing a sequence of pictures, the method comprising receiving a current picture for encoding, forming a temporal prediction of the current picture from a default reference picture for the current picture, comparing the default reference picture with at least one further reference picture, calculating a measure of the similarity between the default reference picture and each further reference picture and, if the measure of similarity meets a pre-determined criterion, outputting an indicator identifying the further reference picture.
1. A method of operating an apparatus for encoding a video signal to form an encoded video signal, the video signal representing a sequence of pictures, the method comprising:
obtaining a local default reference picture by encoding and decoding a picture of the sequence;
forming a motion compensated prediction for a current picture of the sequence or a part of a current picture from the local default reference picture;
generating an indicator for use in error concealment of the current picture or respectively for said part of a current picture, the indicator configured to identify an alternative reference picture, which is sufficiently similar to the local default reference picture so that it can be used in a corresponding decoding process, instead of a corresponding default reference picture, in forming a motion compensated prediction for the current picture or respectively for said part of a current picture when the corresponding default reference picture cannot be reconstructed in the corresponding decoding process; and
providing the indicator for use in the corresponding decoding process to identify the alternative reference picture for use in error concealment.
2. A method according to claim 1 , comprising:
identifying the alternative reference picture for the current picture or said part of a current picture by comparing the local default reference picture with a further reference picture to calculate a measure of similarity between the two;
comparing the measure of similarity against a pre-determined similarity criterion; and
generating the indicator based on the comparison.
3. A method according to claim 1 , comprising:
forming a motion compensated prediction for at least part of the current picture from a first local default reference picture and a second local default reference picture, the first local default reference picture corresponding to a picture of the sequence occurring temporally before the current picture and the second local default reference picture corresponding to a picture of the sequence occurring temporally after the current picture;
comparing the first local default reference picture with a further reference picture corresponding to a picture of the sequence occurring temporally before the current picture to calculate a measure of similarity between the two;
comparing the measure of similarity against a pre-determined similarity criterion; and
generating the indicator based on the comparison.
4. A method according to claim 2 , comprising:
identifying more than one alternative reference picture for the current picture or respectively for said part of a current picture by comparing the local default reference picture with a plurality of further reference pictures to calculate respective measures of similarity; and
providing an indicator for each further reference picture that meets the predetermined similarity criterion to provide more than one indicator for the current picture or respectively for said part of a current picture.
5. A method according to claim 1 , comprising providing the indicator in a picture header of the encoded video signal.
6. A method according to claim 1 , comprising encoding the sequence of pictures according to the H.263 video compression standard and providing the indicator in the Supplemental Enhancement Information in accordance with the H.263 video compression standard.
7. A method of operating an apparatus for decoding an encoded video signal representing a sequence of pictures, the method comprising:
determining that a default reference picture, for use in forming a motion compensated prediction for a current picture or a part of a current picture, cannot be reconstructed;
examining an indicator provided for error concealment of the current picture or respectively for said part of a current picture to identify an alternative reference picture for use in forming a motion compensated prediction for the current picture or respectively for said part of a current picture; and
using the alternative reference picture, instead of the default reference picture, to form a motion compensated prediction for the current picture or respectively for said part of a current picture in response to determining that the default reference picture cannot be reconstructed, thereby providing error concealment for the current picture or respectively for said part of a current picture.
8. An encoder for encoding a video signal to form an encoded video signal, the video signal representing a sequence of pictures, wherein the encoder is configured to:
obtain a local default reference picture by encoding and decoding a picture of the sequence;
form a motion compensated prediction for a current picture of the sequence or a part of a current picture using the local default reference picture;
generate an indicator for use in error concealment of the current picture or respectively for said part of a current picture, the indicator configured to identify an alternative reference picture, which is sufficiently similar to the local default reference picture so that it can be used in a corresponding decoding process, instead of a corresponding default reference picture, in forming a motion compensated prediction for the current picture or respectively for said part of a current picture when the corresponding default reference picture cannot be reconstructed in the corresponding decoding process; and
provide the indicator for use in the corresponding decoding process to identify the alternative reference picture for use in error concealment.
9. A decoder for decoding an encoded video signal representing a sequence of pictures, wherein the decoder is configured to:
determine that a default reference picture, for use in forming a motion compensated prediction for a current picture or a part of a current picture, cannot be reconstructed;
examine an indicator provided for error concealment of the current picture or respectively for said part of a current picture, to identify an alternative reference picture for use in forming a motion compensated prediction for the current picture or respectively for said part of a current picture; and
use the alternative reference picture, instead of the default reference picture, to form a motion compensated prediction for the current picture or respectively for said part of a current picture in response to determining that the default reference picture cannot be reconstructed, thereby providing error concealment for the current picture or respectively for said part of a current picture.
10. A radio telecommunications device comprising an encoder for encoding a video signal to form an encoded video signal, the video signal representing a sequence of pictures, wherein the encoder is configured to:
obtain a local default reference picture by encoding and decoding a picture of the sequence;
form a motion compensated prediction for a current picture of the sequence or a part of a current picture from the local default reference picture;
generate an indicator for use in error concealment of the current picture or respectively for said part of a current picture, the indicator configured to identify an alternative reference picture, which is sufficiently similar to the local default reference picture so that it can be used in a corresponding decoding process, instead of a corresponding default reference picture, in forming a motion compensated prediction for the current picture or respectively for said part of a current picture when the corresponding default reference picture cannot be reconstructed in the corresponding decoding process; and
provide the indicator for use in the corresponding decoding process to identify the alternative reference picture for use in error concealment.
11. A method according to claim 1 , comprising providing the indicator in one of a picture segment header or a macroblock header of the encoded video signal when the indicator is associated with a part of a current picture.
12. A method according to claim 1 , comprising generating the indicator to indicate one of a temporal reference of the alternative reference picture or a picture number of the alternative reference picture.
13. A method according to claim 1 , comprising providing respective indicators to indicate corresponding alternative reference pictures for B pictures and P pictures.
14. A method according to claim 1 , comprising providing indicators to indicate alternative reference pictures only for P pictures.
15. A method according to claim 2 , comprising calculating the measure of similarity as a sum of absolute differences using differences in pixel values between the local default reference picture and the further reference picture.
16. A method according to claim 2 , comprising calculating the measure of similarity between the local default reference picture and the further reference picture using picture histograms.
17. A method according to claim 1 , comprising scalably encoding the video signal and providing respective indicators to indicate corresponding alternative reference pictures for predictively encoded enhancement layer pictures of the scalably encoded video signal.
18. A method according to claim 1 , comprising providing the indicator with the current picture or respectively with said part of a current picture.
19. A method according to claim 7 , comprising:
examining a ranking order of more than one indicator provided for the current picture or respectively for said part of a current picture;
selecting an indicator based on the ranking order; and
using the alternative reference picture identified by the selected indicator to form a motion compensated prediction for the current picture or respectively for said part of a current picture.
20. A method according to claim 7 , comprising obtaining the indicator from a picture header of the encoded video signal.
21. A method according to claim 7 , comprising obtaining the indicator from one of a picture segment header or a macroblock header of the encoded video signal.
22. A method according to claim 7 , comprising obtaining the indicator from Supplemental Enhancement Information of an encoded video signal encoded according to the H.263 video compression standard.
23. A method according to claim 7 , comprising using the indicator to identify one of a temporal reference of the alternative reference picture or a picture number of the alternative reference picture.
24. A method according to claim 7 , comprising using respective indicators to identify corresponding alternative reference pictures for B pictures and P pictures.
25. A method according to claim 7 , comprising using respective indicators to identify corresponding alternative reference pictures for predictively encoded enhancement layer pictures of a scalably encoded video signal.
26. An encoder according to claim 8 , wherein the encoder is configured to:
identify the alternative reference picture for the current picture or said part of a current picture by comparing the local default reference picture with a further reference picture to calculate a measure of similarity between the two;
compare the measure of similarity against a pre-determined similarity criterion; and
generate the indicator based on the comparison.
27. An encoder according to claim 8 , wherein the encoder is configured to:
form a motion compensated prediction for at least part of a current picture from a first local default reference picture and a second local default reference picture, the first local default reference picture corresponding to a picture of the sequence occurring temporally before the current picture and the second local default reference picture corresponding to a picture of the sequence occurring temporally after the current picture;
compare the first local default reference picture with a further reference picture corresponding to a picture of the sequence occurring temporally before the current picture to calculate a measure of similarity between the two;
comparing the measure of similarity against a predetermined similarity criterion; and
generate the indicator based on the comparison.
28. An encoder according to claim 26 , wherein the encoder is configured to:
identify more than one alternative reference picture for the current picture or respectively for said part of a current picture by comparing the local default reference picture with a plurality of further reference pictures to calculate respective measures of similarity; and
provide an indicator for each further reference picture that meets a predetermined similarity criterion to provide more than one indicator for the current picture or respectively for said part of a current picture.
29. An encoder according to claim 8 , wherein the encoder is configured to provide the indicator in a picture header of the encoded video signal.
30. An encoder according to claim 8 , wherein the encoder is configured to provide the indicator in one of a picture segment header or a macroblock header of the encoded video signal when the indicator is associated with a part of a current picture.
31. An encoder according to claim 8 , wherein the encoder is configured to encode the video signal according to the H.263 video compression standard and to provide the indicator in the Supplemental Enhancement Information in accordance with the H.263 video compression standard.
32. An encoder according to claim 8 , wherein the encoder is configured to generate the indicator to indicate one of a temporal reference of the alternative reference picture or a picture number of the alternative reference picture.
33. An encoder according to claim 8 , wherein the encoder is configured to provide respective indicators to indicate corresponding alternative reference pictures for B pictures and P pictures.
34. An encoder according to claim 8 , wherein the encoder is configured to provide indicators to indicate alternative reference pictures only for P pictures.
35. An encoder according to claim 26 , wherein the encoder is configured to calculate the measure of similarity as a sum of absolute differences using differences in pixel values between the local default reference picture and the further reference picture.
36. An encoder according to claim 26 , wherein the encoder is configured to calculate the measure of similarity between the local default reference picture and the further reference picture using picture histograms.
37. An encoder according to claim 8 , wherein the encoder is configured to encode the video signal as a scalable video sequence and to provide respective indicators to indicate corresponding alternative reference pictures for predictively encoded enhancement layer pictures of the scalable video sequence.
38. An encoder according to claim 8 , wherein the encoder is configured to provide the indicator with the current picture or respectively with said part of a current picture.
39. A decoder according to claim 9 , wherein the decoder is configured to:
examine a ranking order of more than one indicator provided for the current picture or respectively for said part of a current picture; and
select an indicator based on the ranking order; and
use the alternative reference picture identified by the selected indicator to form a motion compensated prediction for the current picture or respectively for said part of a current picture.
40. A decoder according to claim 9 , wherein the decoder is configured to obtain the indicator from a picture header of the encoded video signal.
41. A decoder according to claim 9 , wherein the decoder is configured to obtain the indicator from one of a picture segment header or a macroblock header of the encoded video signal.
42. A decoder according to claim 9 , wherein the decoder is configured to obtain the indicator from Supplemental Enhancement Information of an encoded video signal encoded according to the H.263 video compression standard.
43. A decoder according to claim 9 , wherein the decoder is configured to use the indicator to identify one of a temporal reference of the alternative reference picture or a picture number of the alternative reference picture.
44. A decoder according to claim 9 , wherein the decoder is configured to use respective indicators to identify corresponding alternative reference pictures for predictively encoded enhancement layer pictures of a scalably encoded video signal.
45. A multimedia terminal device comprising an encoder for encoding a video signal to form an encoded video signal, the video signal representing a sequence of pictures, wherein the encoder is configured to:
obtain a local default reference picture by encoding and decoding a picture of the sequence;
form a motion compensated prediction for a current picture of the sequence or a part of a current picture from the local default reference picture;
generate an indicator for use in error concealment of the current picture or respectively for said part of a current picture, the indicator configured to identify an alternative reference picture, which is sufficiently similar to the local default reference picture so that it can be used in a corresponding decoding process, instead of a corresponding default reference picture, in forming a motion compensated prediction for the current picture or respectively for said part of a current picture when the corresponding default reference picture cannot be reconstructed in the corresponding decoding process; and
provide the indicator for use in the corresponding decoding process to identify the alternative reference picture for use in error concealment.
46. A method according to claim 1 , comprising identifying the alternative reference picture for the current picture or said part of the current picture by comparing the current picture with a reference picture to calculate a measure of similarity between the two, comparing the measure of similarity against a pre-determined similarity criterion, and generating the indicator based on the comparison.
47. A method according to claim 4 , comprising ranking the further reference pictures based on said comparison and providing said more than one indicator for the current picture or respectively for said part of a current picture in a ranking order, the indicator associated with the further reference picture having the closest similarity to the local default reference picture being placed first in the ranking order.
48. A radio telecommunications device comprising a decoder for decoding an encoded video signal representing a sequence of pictures, wherein the decoder is configured to:
determine that a default reference picture, for use in forming a motion compensated prediction for a current picture or a part of a current picture, cannot be reconstructed;
examine an indicator provided for error concealment of the current picture or respectively for said part of a current picture, to identify an alternative reference picture for use in forming a motion compensated prediction for the current picture or respectively for said part of a current picture; and
use the alternative reference picture, instead of the default reference picture, to form a motion compensated prediction for the current picture or respectively for said part of a current picture in response to determining that the default reference picture cannot be reconstructed, thereby providing error concealment for the current picture or respectively for said part of a current picture.
49. An encoder according to claim 28 , wherein the encoder is configured to rank the further reference pictures based on said comparison and to provide said more than one indicator for the current picture or respectively for said part of a current picture in a ranking order, the indicator associated with the further reference picture having the closest similarity to the local default reference picture being placed first in the ranking order.
50. A multimedia terminal device comprising a decoder for decoding an encoded video signal representing a sequence of pictures, wherein the decoder is configured to:
determine that a default reference picture, for use in forming a motion compensated prediction for a current picture or a part of a current picture, cannot be reconstructed;
examine an indicator provided for error concealment of the current picture or respectively for said part of a current picture to identify an alternative reference picture for use in forming a motion compensated prediction for the current picture or respectively for said part of a current picture; and
use the alternative reference picture, instead of the default reference picture, to form a motion compensated prediction for the current picture or respectively for said part of a current picture in response to determining that the default reference picture cannot be reconstructed, thereby providing error concealment for the current picture or respectively for said part of a current picture.
51. An apparatus for encoding a video signal to form an encoded video signal, the video signal representing a sequence of pictures, wherein the apparatus is configured to:
obtain a local default reference picture by encoding and decoding a picture of the sequence;
form a motion compensated prediction for a current picture of the sequence or a part of a current picture from the local default reference picture;
generate an indicator for use in error concealment of the current picture or respectively for said part of a current picture, the indicator configured to identify an alternative reference picture, which is sufficiently similar to the local default reference picture so that it can be used in a corresponding decoding process, instead of a corresponding default reference picture, in forming a motion compensated prediction for the current picture or respectively for said part of a current picture when a the corresponding default reference picture cannot be reconstructed in the corresponding decoding process; and
provide the indicator for use in the corresponding decoding process to identify the alternative reference picture for use in error concealment.
52. An apparatus for decoding an encoded video signal representing a sequence of pictures, wherein the apparatus is configured to:
determine that a default reference picture, for use in forming a motion compensated prediction for a current picture or a part of a current picture, cannot be reconstructed;
examine an indicator provided for error concealment of the current picture or respectively for said part of a current picture to identify an alternative reference picture for use in forming a motion compensated prediction for the current picture or respectively for said part of a current picture; and
use the alternative reference picture, instead of the default reference picture, to form a motion compensated prediction for the current picture or respectively for said part of a current picture in response to determining that the default reference picture cannot be reconstructed, thereby providing error concealment for the current picture or respectively for said part of a current picture.