Device, method and program for generating interpolation frame
View Patent ↗An interpolation frame generation device that generates an interpolation frame that interpolates image frames that are obtained by decoding a coded image signal that is coded by motion compensation, includes a motion vector deriving unit and an interpolation frame generating unit. The motion vector deriving unit acquires a motion compensation vector of a coded block that forms the coded image signal. The interpolation frame generating unit generates the interpolation frame in accordance with the motion vector of the image block that forms an image frame by using the motion compensation vector of the coded block as the motion vector of the image block.
1. An interpolation frame generation device for generating an interpolation frame for interpolating image frames, the device comprising:
a movement associated information acquisition unit operable to acquire movement associated information about movements of image blocks that form an image frame;
an interpolation vector derivation unit operable to derive a global motion vector for generating an interpolation frame in accordance with the movement associated information; and
an interpolation frame generation unit operable to generate the interpolation frame in accordance with the global motion vector, wherein
(1) when an image area corresponding to an image area obtained by moving an image frame to be a base for generating the interpolation frame in accordance with the global motion vector exists in an image area of the interpolation frame, the interpolation frame generation unit derives the image area of the interpolation frame from the image area obtained by moving the image frame to be a base for generating the interpolation frame in accordance with the global motion vector, and
(2) when an image area corresponding to an image area obtained by moving an image frame to be a base for generating the interpolation frame in accordance with the global motion vector does not exist in an image area of the interpolation frame,
(i) the interpolation frame generation unit derives the image area of the interpolation frame from the image area obtained by pasting a pixel having the coordinates (x 1 , y 1 ) in the image area of the image frame to be a base for generating the interpolation frame on a pixel having the same coordinates (x 1 , y 1 ) in the image area of the interpolation frame,
(ii) the interpolation frame generation unit derives the image area of the interpolation frame by repeating pixel data at an edge of the image frame to be a base after a moving process, or
(iii) the interpolation frame generation unit derives the image area of the interpolation frame by pasting pixel data using a pixel area at a periphery of the image frame to be a base after the moving process while compensating a smoothness of the pixel-pasted image area.
2. The interpolation frame generation device according to claim 1 , wherein
the global motion vector is derived from movement associated information of image blocks partially selected from all of image blocks.
3. The interpolation frame generation device according to claim 1 , wherein
the movement associated information is motion compensation vectors of coded blocks that form a coded image signal for decoding the image frames; and
the interpolation frame generation unit generates the interpolation frame by utilizing the global motion vector derived for an image frame that is located either before or after an intra coded image frame in the display order.
4. An interpolation frame generation method, which is executed using a processor, for generating an interpolation frame for interpolating image frames, the method comprising:
a movement associated information acquisition step of acquiring movement associated information about movements of image blocks that form an image frame;
an interpolation vector derivation step of deriving a global motion vector for generating an interpolation frame in accordance with the movement associated information; and
an interpolation frame generation step of generating the interpolation frame in accordance with the global motion vector, wherein
(1) when an image area corresponding to an image area obtained by moving an image frame to be a base for generating the interpolation frame in accordance with the global motion vector exists in an image area of the interpolation frame, the interpolation frame generation step derives the image area of the interpolation frame from the image area obtained by moving the image frame to be a base for generating the interpolation frame in accordance with the global motion vector, and
(2) when an image area corresponding to an image area obtained by moving an image frame to be a base for generating the interpolation frame in accordance with the global motion vector does not exist in an image area of the interpolation frame,
(i) the interpolation frame generation step derives the image area of the interpolation frame from the image area obtained by pasting a pixel having the coordinates (x 1 , y 1 ) in the image area of the image frame to be a base for generating the interpolation frame on a pixel having the same coordinates (x 1 , y 1 ) in the image area of the interpolation frame,
(ii) the interpolation frame generation step derives the image area of the interpolation frame by repeating pixel data at an edge of the image frame to be a base after a moving process, or
(iii) the interpolation frame generation step derives the image area of the interpolation frame by pasting pixel data using a pixel area at a periphery of the image frame to be a base after the moving process while compensating a smoothness of the pixel-pasted image area.
5. A non-transitory computer-readable storage medium storing an interpolation frame generation program for performing an interpolation frame generation method for generating an interpolation frame for interpolating image frames by using a processor,
the interpolation frame generation method comprising:
a movement associated information acquisition step of acquiring movement associated information about movements of image blocks that form an image frame;
an interpolation vector derivation step of deriving a global motion vector for generating an interpolation frame in accordance with the movement associated information; and
an interpolation frame generation step of generating the interpolation frame in accordance with the global motion vector, wherein
(1) when an image area corresponding to an image area obtained by moving an image frame to be a base for generating the interpolation frame in accordance with the global motion vector exists in an image area of the interpolation frame, the interpolation frame generation step derives the image area of the interpolation frame from the image area obtained by moving the image frame to be a base for generating the interpolation frame in accordance with the global motion vector, and
(2) when an image area corresponding to an image area obtained by moving an image frame to be a base for generating the interpolation frame in accordance with the global motion vector does not exist in an image area of the interpolation frame,
(i) the interpolation frame generation step derives the image area of the interpolation frame from the image area obtained by pasting a pixel having the coordinates (x 1 , y 1 ) in the image area of the image frame to be a base for generating the interpolation frame on a pixel having the same coordinates (x 1 , y 1 ) in the image area of the interpolation frame,
(ii) the interpolation frame generation step derives the image area of the interpolation frame by repeating pixel data at an edge of the image frame to be a base after a moving process, or
(iii) the interpolation frame generation step derives the image area of the interpolation frame by pasting pixel data using a pixel area at a periphery of the image frame to be a base after the moving process while compensating a smoothness of the pixel-pasted image area.