Method, an apparatus and a computer program product for video encoding and video decoding
The embodiments relate to a method and a technical equipment for implementing the method. The method comprises receiving encoded omnidirectional video content for displaying, wherein the encoded omnidirectional video content comprises a viewport region, a margin region outside the viewport region and a background region ( 801 ); defining image regions to be included in the margin region, wherein the definition is based on a margin speed threshold ( 802 ); determining a head speed and a direction of motion ( 803 ); determining when the head speed is greater than or equal to the margin speed threshold, and as a response to the determining, adding negative margins in one or more direction with respect to the viewport ( 804 ); downloading the viewport with a first quality; and downloading the negative margins at a quality lower than the first quality ( 805 ).
1 . An apparatus comprising at least one processor, memory including computer program code, the memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:
receiving encoded omnidirectional video content for displaying, wherein the encoded omnidirectional video content comprises a viewport region corresponding to a viewport, a margin region outside the viewport region and a background region;
defining image regions to be included in the margin region, wherein the definition is based on a margin speed threshold;
determining a head speed and a direction of motion;
determining when the head speed is greater than or equal to the margin speed threshold;
adding negative margins in one or more directions with respect to the viewport;
downloading the viewport with a first quality;
downloading the negative margins at a quality lower than the first quality; and
setting a limit for a negative margin dynamically based on one or more of the following: omnidirectional video content, metadata, head motion traces, eye gaze, network performance, or speed of pose change.
2 . The apparatus according to claim 1 , wherein the apparatus is further caused to add margins in the direction of motion, and adding the negative margins in a direction opposite to the direction of motion.
3 . The apparatus according to claim 1 , wherein the apparatus is further caused to download the background with a second quality, wherein the second quality is less than the first quality, and other than the quality for downloading the negative margins.
4 . The apparatus according to claim 1 wherein the apparatus is further caused to determine a blur speed threshold for a head motion speed above which a user is not able to focus on the omnidirectional video content; and determine when the head speed is greater than the blur speed threshold, whereupon all the image regions are downloaded with a low quality.
5 . The apparatus according to claim 1 , wherein the apparatus is further caused to determine a margin limit, which is a range of a margin with respect to a size of the viewport, that the margin should not exceed from; and/or determine quality of image regions in the margin.
6 . The apparatus according to claim 5 , wherein the apparatus is further caused to determine distance of margin image regions from a center of the viewport; for sorting the margin image regions based on the distance and a direction of motion; and when negative margins have been inserted, complement margin in the direction of motion with an equivalent set of margins until a margin limit is met.
7 . The apparatus according to claim 1 , wherein the limit for the negative margin is proportional to retrieved media segment duration.
8 . A method, comprising:
receiving encoded omnidirectional video content for displaying, wherein the encoded omnidirectional video content comprises a viewport region corresponding to a viewport, a margin region outside the viewport region and a background region;
defining image regions to be included in the margin region, wherein the definition is based on a margin speed threshold;
determining a head speed and a direction of motion;
determining when the head speed is greater than or equal to the margin speed threshold, and as a response to the determining, adding negative margins in one or more directions with respect to the viewport;
downloading the viewport with a first quality;
downloading the negative margins at a quality lower than the first quality; and
setting a limit for a negative margin dynamically based on one or more of the following: omnidirectional video content, metadata, head motion traces, eye gaze, network performance, or speed of pose change.
9 . The method according to claim 8 , further comprising adding margins in the direction of motion, and adding the negative margins in a direction opposite to the direction of motion.
10 . The method according to claim 8 , further comprising downloading the background with a second quality, wherein the second quality is less than the first quality, and other than the quality for downloading the negative margins.
11 . The method according to claim 8 , further comprising determining a blur speed threshold for a head motion speed above which a user is not able to focus on the omnidirectional video content, and determining when the head speed is greater than the blur speed threshold, whereupon all the image regions are downloaded with a low quality.
12 . The method according to claim 8 , further comprising determining a margin limit, which is a range of a margin with respect to a size of the viewport, that the margin should not exceed from; and/or determining quality of image regions in the margin.
13 . The method according to claim 12 , further comprising determining distance of margin image regions from a center of the viewport; sorting the margin image regions based on the distance and a direction of motion; and when negative margins have been inserted, complementing margin in the direction of motion with an equivalent set of margins until a margin limit is met.
14 . The method according to claim 8 , wherein the limit for the negative margin is proportional to retrieved media segment duration.
15 . A non-transitory program storage device readable by a machine, tangibly embodying a program of instructions executable with the machine for performing operations, the operations comprising:
receiving encoded omnidirectional video content for displaying, wherein the encoded omnidirectional video content comprises a viewport region corresponding to a viewport, a margin region outside the viewport region and a background region;
defining image regions to be included in the margin region, wherein the definition is based on a margin speed threshold;
determining a head speed and a direction of motion;
determining when the head speed is greater than or equal to the margin speed threshold, and as a response to the determining, adding negative margins in one or more directions with respect to the viewport;
downloading the viewport with a first quality;
downloading the negative margins at a quality lower than the first quality; and
setting a limit for a negative margin dynamically based on one or more of the following: omnidirectional video content, metadata, head motion traces, eye gaze, network performance, or speed of pose change.