Electronic device and method for tiled video multi-channel playback
An electronic device and a method for a tiled video multi-channel playback are disclosed. The electronic device includes a device communication unit and a device controller. The device communication unit establishes a communication channel with a streaming server. The device controller can detect a region of interest (ROI) of an image related to a media presentation description (MPD) tile provided by the streaming server, transmit ROI information to the streaming server and receive tiles of a tiled video having a first resolution and corresponding to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2D videos from the streaming server. The device controller can also generate a 360-degree VR video by synthesizing the video tiles and the full video, and control a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.
1. An electronic device for a tiled video multi-channel playback, comprising:
a device communication unit configured to establish a communication channel with a streaming server; and
a device controller configured to:
detect a region of interest (ROI) of an image related to a media presentation description (MPD) file provided by the streaming server,
transmit ROI information to the streaming server,
receive tiles of a tiled video having a first resolution and corresponding to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2-dimesional (2D) videos from the streaming server,
generate a 360-degree virtual reality (VR) video by synthesizing the video tiles and the full video, and
control a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.
2. The electronic device of claim 1 , wherein the device controller is further configured to:
distinguish a main object and a background object by using data parsed from the MPD file, and to detect a region of the main object as the ROI.
3. The electronic device of claim 1 , further comprising:
a sensor unit configured to sense a user's viewpoint looking at the MPD file,
wherein the device controller is further configured to:
detect, as the ROI, a region corresponding to the user's viewpoint sensed by the sensor unit.
4. The electronic device of claim 1 , wherein the device controller is further configured to:
control the simultaneous playback of the 360-degree VR video and the plurality of 2D videos by using two decoders.
5. The electronic device of claim 4 , wherein the device controller is further configured to:
control one of the MD decoders to decode the 360-degree VR video, and control the other decoder to decode the plurality of 2D videos and audio information.
6. The electronic device of claim 1 , wherein the device controller is further configured to:
perform rendering such that the 360-degree VR video is disposed in an entire screen and the plurality of 2D videos are disposed in non-ROIs of the 360-degree VR video.
7. The electronic device of claim 1 , wherein the device controller is further configured to perform the rendering in a stereo format.
8. A method of a tiled video multi-channel playback, comprising:
at an electronic device, receiving a media presentation description (MPD) file from a streaming server;
at the electronic device, detecting a region of interest (ROI) of an image related to the MPD file;
at the electronic device, transmitting ROI information to the streaming server;
at the electronic device, receiving tiles of a tiled video having a first resolution and corresponding, to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2D videos from the streaming server;
at the electronic device, generating a 360-degree VR video by synthesizing the video tiles and the full video; and
at the electronic device, performing a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.
9. The method of claim 8 , wherein the simultaneous playback of the 360-degree VR video and the plurality of 2D videos is performed by using two decoders.
10. The method of claim 8 , wherein the simultaneous playback includes rendering performed such that the 360-degree VR video is disposed in an entire screen and the plurality of 2D videos are disposed in non-ROIs of the 360-degree VR video.