Segment-based encoding system using exposed area filling performed by an encoder and a decoder
View Patent ↗An encoding system encodes and decodes video data using an exposed area fill processor. A nonkey frame is encoded as a set of kinetic information relating segments of a reference frame to the nonkey frame and the nonkey frame is decoded from segments of at least one reference frame, the kinetic information and results of an exposed area fill process that estimates contents of the nonkey frame not already covered by the segments and the kinetic information. The exposed area fill results can be determined at the encoder and conveyed to the decoder or the decoder can determine the results independently. The encoded video data can include an indication of which of a plurality of fill schemes are used, or the decoder can determine the indication by itself. The exposed area fill information might include bounds of areas to be filled and/or pixel values of pixels therein.
1. A decoder for decoding video data from compressed video data, wherein the video data comprises a sequence of a plurality of image frames comprising key frames and nonkey frames, the decoder comprising:
a nonkey frame generator that regenerates a nonkey frame using kinetic information about the nonkey frame from the compressed video data and the segmentation of the reference frame;
an exposed area fill processor that determines an exposed area fill information for filling exposed areas in the nonkey frame that are not associated with segments of the reference frame according to the predetermined exposed area fill process; and
a residue processor that corrects for differences in a generated frame and a reconstructed nonkey frame, where the generated frame is generated from the segmentation, the reference frame content and the kinetic information and altered based on results of the exposed area fill processor.
2. The decoder of claim 1 , wherein the decoder is adapted to generate difference frame information based on the exposed area fill information.
3. The decoder of claim 1 , wherein the decoder is adapted to generate a segmentation and use the generated segmentation to generate exposed area fill information.
4. The decoder of claim 1 , wherein the decoder is adapted to extract a segmentation from the compressed video data and uses the extracted segmentation to generate exposed area fill information.
5. The decoder of claim 1 , wherein exposed area fill information includes bounds of areas to be filled.
6. The decoder of claim 1 , wherein exposed area fill information includes pixel values of pixels in areas to be filled.
7. The decoder of claim 1 , wherein the decoder is adapted to extract from the compressed video data an indication of which of a plurality of fill schemes is used.
8. The decoder of claim 1 , wherein the exposed area fill includes bounds of areas to be filled.
9. The decoder of claim 1 , wherein the exposed area fill includes pixel values of pixels in areas to be filled.
10. The decoder of claim 1 , wherein the decoder is adapted to extract from the compressed video data results of an exposed area fill process performed by an encoder.