Generating and displaying a video stream by omitting or replacing an occluded part
An encoder system and computer-implemented method may be provided for generating a video stream for a streaming client. The system and method may determine a part of the video which is or would be occluded during display of the video by the streaming client, for example on the basis of signaling data received from the streaming client. A video stream may be generated by, before or as part of encoding of the video, omitting the part of the video, or replacing video data in the part by replacement video data having a lower entropy than said video data. The video stream may be provided to the streaming client, for example via a network. Accordingly, a better compressible version of the video may be obtained, which when displayed by the streaming client, may still contain all or most non-occluded parts visible to a user.
1. An encoder system for generating a video stream for a streaming client, the encoder system comprising:
a communication interface to the streaming client;
an input interface for accessing the video which is to be streamed to the streaming client; and
a processor configured to:
via the communication interface, obtain signaling data which is indicative of a part of the video which is or would be occluded by another video or a computer-graphics based object during display of the video;
determine the part of the video which is or would be occluded during display of the video by the streaming client based on the signaling data;
generate a video stream by, before or as part of encoding of the video, i) omitting the part of the video, or ii) replacing video data in the part by replacement video data having a lower entropy than said video data; and
via the communication interface, provide the video stream to the streaming client, wherein, as provided from the encoder system, the part of the video which is or would be occluded during display of the video by the streaming client, i) is omitted from the video stream, or ii) the video data in the part of the video which is or would be occluded during display of the video by the streaming client is replaced by the replacement video data.
2. The encoder system according to claim 1 , wherein the signaling data is received from the streaming client, or from a processor system which at least in part determines the display of the video by the streaming client.
3. A receiver system representing a streaming client for displaying a streamed video, the receiver system comprising:
a communication interface;
a processor configured to:
determine a part of the video which is or would be occluded by another video or a computer-graphics based object during display of the video;
and via the communication interface:
provide signaling data to an encoder system which is indicative of the part of the video which is or would be occluded during display of the video; and
receive a video stream from the encoder system in which i) the part of the video which is or would be occluded during display of the video has been omitted by the encoder system, or ii) video data of the part which is or would be occluded during display of the video has been replaced by replacement video data having a lower entropy than said video data by the encoder system.
4. A computer-implemented method for generating a video stream for a streaming client by an encoder system, the method comprising:
accessing the video which is to be streamed to the streaming client;
obtaining signaling data which is indicative of a part of the video which is or would be occluded by another video or a computer-graphics based object during display of the video;
determining the part of the video which is or would be occluded during display of the video by the streaming client based on the signaling data;
generating a video stream by, before or as part of encoding of the video, i) omitting the part of the video, or ii) replacing video data in the part by replacement video data having a lower entropy than said video data; and
providing the video stream to the streaming client, wherein, as provided from the encoder system, the part of the video which is or would be occluded during display of the video by the streaming client, i) is omitted from the video stream, or ii) the video data in the part of the video which is or would be occluded during display of the video by the streaming client is replaced by the replacement video data.
5. A computer-implemented method for displaying a streamed video, the method comprising:
determining a part of the video which is or would be occluded by another video or a computer-graphics based object during display of the video;
providing signaling data to an encoder system which is indicative of the part of the video to be occluded during display of the video; and
receiving a video stream from the encoder system in which i) the part of the video which is or would be occluded during display of the video has been omitted by the encoder system, or ii) video data of the part which is would be occluded during display of the video has been replaced by replacement video data having a lower entropy than said video data by the encoder system.
6. A non-transitory computer-readable medium comprising a computer program, the computer program comprising instructions for causing a processor system to perform the method according to claim 4 .