Technology to encode 360 degree video content
Systems, apparatuses and methods may determine, on a per camera basis, an interest level with respect to panoramic video content, identify a subset of cameras in a plurality of cameras for which the interest level is below a threshold, and reduce power consumption in the subset of cameras. Additionally, technology may determine a projection format associated with panoramic video content, identify one or more discontinuous boundaries in the projection format, and modify an encoding scheme associated with the panoramic video content based on the discontinuous boundaries. Moreover, an encoded frame may be assigned to a temporal scalability layer that has a higher priority than a layer to which an asynchronous space warp frame is assigned. Additionally, technology may reduce the encoding complexity of a boundary between an active region and an inactive region in fisheye content.
1. A system comprising:
a plurality of cameras to capture panoramic video content;
a memory including a set of instructions; and
a processor coupled to the plurality of cameras and the memory, wherein when executed by the processor, the instructions cause the system to:
determine, on a per camera basis, an interest level with respect to the panoramic video content,
identify a subset of cameras in the plurality of cameras for which the interest level is below a threshold,
determine a projection format associated with the panoramic video content,
identify one or more discontinuous boundaries in the projection format,
modify an encoding scheme associated with the panoramic video content based on the one or more discontinuous boundaries, and
reduce power consumption in the subset and reduce a quantization parameter variation across the one or more discontinuous boundaries.
2. The system of claim 1 , wherein the instructions, when executed, cause the system to one or more of:
reduce a frame rate of the subset of cameras,
reduce a resolution of the subset of cameras,
reduce an audio sample rate of one or more microphones corresponding to the subset of cameras, or
disable the subset of cameras.
3. The system of claim 2 , wherein disablement of the subset of cameras reduces an active field of view of the plurality of cameras from 360 degrees to 180 degrees.
4. The system of claim 1 , wherein the instructions, when executed, cause the system to reduce power consumption in the processor by virtue of a bypass of one or more of a transmission, a stitching or an encoding of frames corresponding to the subset of cameras.
5. The system of claim 1 , further including:
a directional microphone;
a physiological sensor;
a motion sensor, wherein the interest level is to be determined based on one or more of a signal from the directional microphone, a signal from the physiological sensor, a signal from the motion sensor or a semantic feature extraction from the panoramic video content.
6. The system of claim 1 , wherein the projection format is to be a cube map including a plurality of faces and the one or more discontinuous boundaries are to be one or more seams between the plurality of faces.
7. The system of claim 1 , wherein the instructions, when executed, cause the system to align encoding block partition boundaries with the one or more discontinuous boundaries.
8. The system of claim 1 , wherein the instructions, when executed, cause the system to reduce motion searches across the one or more discontinuous boundaries.
9. The system of claim 1 , wherein the instructions, when executed, cause the system to reduce intra prediction across the one or more discontinuous boundaries.
10. The system of claim 1 , wherein the instructions, when executed, cause the system to increase a bit allocation to a distortion portion of rate distortion optimization at the one or more discontinuous boundaries.
11. An apparatus comprising:
a substrate; and
logic coupled to the substrate, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to:
determine a projection format associated with panoramic video content,
identify one or more discontinuous boundaries in the projection format, and
modify an encoding scheme associated with the panoramic video content based on the one or more discontinuous boundaries, wherein the logic is to reduce a quantization parameter variation across the one or more discontinuous boundaries.
12. The apparatus of claim 11 , wherein the projection format is to be a cube map including a plurality of faces and the one or more discontinuous boundaries are to be one or more seams between the plurality of faces.
13. The apparatus of claim 11 , wherein the logic is to align encoding block partition boundaries with the one or more discontinuous boundaries.
14. The apparatus of claim 11 , wherein the logic is to reduce motion searches across the one or more discontinuous boundaries.
15. The apparatus of claim 11 , wherein the logic is to reduce intra prediction across the one or more discontinuous boundaries.
16. The apparatus of claim 11 , wherein the logic is to increase a bit allocation to a distortion portion of rate distortion optimization at the one or more discontinuous boundaries.