Method and apparatus for transmitting and receiving virtual reality content
A method for transmitting virtual reality (VR) content by a device is provided. The method includes obtaining at least two images captured from a target, arranging the at least two images and projecting the at least two images onto a planar surface to configure a 360-degree image corresponding to the VR content, detecting an overlapped region of the at least two images projected and generating rearrangement information about the overlapped region, and transmitting the rearrangement information and the at least two images.
1. A method for transmitting metadata related to a fisheye omnidirectional image by a device, the method comprising:
generating metadata related to a coded picture including at least two circular images captured by fisheye cameras; and
transmitting the generated metadata,
wherein if local field of view (FOV) parameters are present in the metadata, the metadata comprises:
information for specifying an FOV of a part of a circular image among the at least two circular images for displaying,
information for specifying an FOV of a part of the circular image which is overlapped with at least one circular image other than the circular image among the at least two circular images,
information for specifying a number of local fitting regions which have different FOV's, and
information for specifying each of the local fitting regions,
wherein the information for specifying each of the local fitting regions comprises:
information indicating a start radius of each of the local fitting regions,
information indicating an end radius of each of the local fitting regions,
information indicating a start angle of each of the local fitting regions, and
information indicating an end angle of each of the local fitting regions.
2. The method of claim 1 , wherein if the FOV parameters are present in the metadata, the metadata further comprises:
information indicating a delta radius value for representing a different FOV for each radius,
information indicating a delta angle value for representing a different FOV for each angle,
information indicating a weighting value for an FOV of a region specified by the information for specifying each of the local fitting regions.
3. The method of claim 1 , wherein if dead zone parameters are present in the metadata, the metadata further comprises:
information for specifying a number of dead zones in the coded picture, and
information for specifying a position and size of a deadzone rectangular area in which pixels are not usable, and
wherein the information for specifying the position and the size of the deadzone rectangular area comprises:
information for specifying a horizontal coordinate of an upper left corner of a dead zone in the coded picture, in luma samples,
information for specifying a vertical coordinate of the upper left corner of the dead zone in the coded picture, in the luma samples,
information for specifying a width of the dead zone in the coded picture, in the luma samples, and
information for specifying a height of the dead zone in the coded picture, in the luma samples.
4. The method of claim 1 , wherein the metadata further comprises:
information for specifying a number of circular images in the coded picture,
information for specifying a horizontal coordinate, in luma samples, of a center of a circular image in the coded picture,
information for specifying a vertical coordinate, in luma samples, of the center of the circular image in the coded picture,
information for specifying a radius, in luma samples, form the center of the circular image to an edge of the circular image,
information for specifying a radius, in luma samples, form the center of the circular image to a closest edge of an area in the circular image where there are no obstructions from a camera body, and
information for specifying an FOV of a fisheye lens corresponding to the circular image.
5. The method of claim 1 , wherein if image flipping region information is present in the metadata, the metadata further comprises information for specifying whether and how a circular image has been flipped and a reverse flipping operation needs to be applied, and
wherein if image scale and lens shading compensation camera intrinsic parameters are present in the metadata, the metadata further comprises information for specifying whether and how the circular image has been scaled along an axis.
6. A method for processing data related to a fisheye omnidirectional image, the method comprising:
receiving metadata related to a coded picture including at least two circular images captured by fisheye cameras; and
processing data related to the fisheye omnidirectional image based on the received metadata,
wherein if local field of view (FOV) parameters are present in the metadata, the metadata comprises:
information for specifying an FOV of a part of a circular image among the at least two circular images for displaying,
information for specifying an FOV of a part of the circular image which is overlapped with at least one circular image other than the circular image among the at least two circular images,
information for specifying a number of local fitting regions which have different FOV's, and
information for specifying each of the local fitting regions,
wherein the information for specifying each of the local fitting regions comprises:
information indicating a start radius of each of the local fitting regions,
information indicating an end radius of each of the local fitting regions,
information indicating a start angle of each of the local fitting regions, and
information indicating an end angle of each of the local fitting regions.
7. The method of claim 6 , wherein if the local FOV parameters are present in the metadata, the metadata further comprises:
information indicating a delta radius value for representing a different FOV for each radius,
information indicating a delta angle value for representing a different FOV for each angle,
information indicating a weighting value for an FOV of a region specified by the information for specifying each of the local fitting regions.
8. The method of claim 6 , wherein if dead zone parameters are present in the metadata, the metadata further comprises:
information for specifying a number of dead zones in the coded picture, and
information for specifying a position and size of a deadzone rectangular area in which pixels are not usable, and
wherein the information for specifying the position and the size of the deadzone rectangular area comprises:
information for specifying a horizontal coordinate of an upper left corner of a dead zone in the coded picture, in luma samples,
information for specifying a vertical coordinate of the upper left corner of the dead zone in the coded picture, in the luma samples,
information for specifying a width of the dead zone in the coded picture, in the luma samples, and
information for specifying a height of the dead zone in the coded picture, in the luma samples.
9. The method of claim 6 , wherein the metadata further comprises:
information for specifying a number of circular images in the coded picture,
information for specifying a horizontal coordinate, in luma samples, of a center of a circular image in the coded picture,
information for specifying a vertical coordinate, in luma samples, of the center of the circular image in the coded picture,
information for specifying a radius, in luma samples, form the center of the circular image to an edge of the circular image,
information for specifying a radius, in luma samples, form the center of the circular image to a closest edge of an area in the circular image where there are no obstructions from a camera body, and
information for specifying an FOV of a fisheye lens corresponding to the circular image.
10. The method of claim 6 , wherein if image flipping region information is present in the metadata, the metadata further comprises information for specifying whether and how a circular image has been flipped and a reverse flipping operation needs to be applied, and
wherein if image scale and lens shading compensation camera intrinsic parameters are present in the metadata, the metadata further comprises information for specifying whether and how the circular image has been scaled along an axis.
11. A device for transmitting metadata related to a fisheye omnidirectional image, comprising:
a controller configured to generate metadata related to obtaining a coded picture including at least two circular images captured by fisheye cameras; and
a transceiver configured to transmit the generated metadata,
wherein if local field of view (FOV) parameters are present in the metadata, the metadata comprises:
information for specifying an FOV of a part of a circular image among the at least two circular images for displaying,
information for specifying an FOV of a part of the circular image which is overlapped with at least one circular image other than the circular image among the at least two circular images,
information for specifying a number of local fitting regions which have different FOV's, and
information for specifying each of the local fitting regions,
wherein the information for specifying each of the local fitting regions comprises:
information indicating a start radius of each of the local fitting regions,
information indicating an end radius of each of the local fitting regions,
information indicating a start angle of each of the local fitting regions, and
information indicating an end angle of each of the local fitting regions.
12. The device of claim 11 , wherein if the local FOV parameters are present in the metadata, the metadata further comprises:
information indicating a delta radius value for representing a different FOV for each radius,
information indicating a delta angle value for representing a different FOV for each angle,
information indicating a weighting value for an FOV of a region specified by the information for specifying each of the local fitting regions.
13. The device of claim 11 , wherein if dead zone parameters are present in the metadata, the metadata further comprises:
information for specifying a number of dead zones in the coded picture, and
information for specifying a position and size of a deadzone rectangular area in which pixels are not usable, and
wherein the information for specifying the position and the size of the deadzone rectangular area comprises:
information for specifying a horizontal coordinate of an upper left corner of a dead zone in the coded picture, in luma samples,
information for specifying a vertical coordinate of the upper left corner of the dead zone in the coded picture, in the luma samples,
information for specifying a width of the dead zone in the coded picture, in the luma samples, and
information for specifying a height of the dead zone in the coded picture, in the luma samples.
14. The device of claim 11 , wherein the metadata further comprises:
information for specifying a number of circular images in the coded picture,
information for specifying a horizontal coordinate, in luma samples, of a center of a circular image in the coded picture,
information for specifying a vertical coordinate, in luma samples, of the center of the circular image in the coded picture,
information for specifying a radius, in luma samples, form the center of the circular image to an edge of the circular image,
information for specifying a radius, in luma samples, form the center of the circular image to a closest edge of an area in the circular image where there are no obstructions from a camera body, and
information for specifying an FOV of a fisheye lens corresponding to the circular image.
15. The device of claim 11 , wherein if image flipping region information is present in the metadata, the metadata further comprises information for specifying whether and how a circular image has been flipped and a reverse flipping operation needs to be applied, and
wherein if image scale and lens shading compensation camera intrinsic parameters are present in the metadata, the metadata further comprises information for specifying whether and how the circular image has been scaled along an axis.
16. A device for processing data related to a fisheye omnidirectional image, comprising:
a transceiver configured to receive metadata related to a coded picture including at least two circular images captured by fisheye cameras; and
a controller configured to process data related to the fisheye omnidirectional image based on the received metadata,
wherein if local field of view (FOV) parameters are present in the metadata, the metadata comprises:
information for specifying an FOV of a part of a circular image among the at least two circular images for displaying,
information for specifying an FOV of a part of the circular image which is overlapped with at least one circular image other than the circular image among the at least two circular images,
information for specifying a number of local fitting regions which have different FOV's, and
information for specifying each of the local fitting regions,
wherein the information for specifying each of the local fitting regions comprises:
information indicating a start radius of each of the local fitting regions,
information indicating an end radius of each of the local fitting regions,
information indicating a start angle of each of the local fitting regions, and
information indicating an end angle of each of the local fitting regions.
17. The device of claim 16 , wherein if the local FOV parameters are present in the metadata, the metadata further comprises:
information indicating a delta radius value for representing a different FOV for each radius,
information indicating a delta angle value for representing a different FOV for each angle,
information indicating a weighting value for an FOV of a region specified by the information for specifying each of the local fitting regions.
18. The device of claim 16 , wherein if dead zone parameters are present in the metadata, the metadata further comprises:
information for specifying a number of dead zones in the coded picture, and
information for specifying a position and size of a deadzone rectangular area in which pixels are not usable, and
wherein the information for specifying the position and the size of the deadzone rectangular area comprises:
information for specifying a horizontal coordinate of an upper left corner of a dead zone in the coded picture, in luma samples,
information for specifying a vertical coordinate of the upper left corner of the dead zone in the coded picture, in the luma samples,
information for specifying a width of the dead zone in the coded picture, in the luma samples, and
information for specifying a height of the dead zone in the coded picture, in the luma samples.
19. The device of claim 16 , wherein the metadata further comprises:
information for specifying a number of circular images in the coded picture,
information for specifying a horizontal coordinate, in luma samples, of a center of a circular image in the coded picture,
information for specifying a vertical coordinate, in luma samples, of the center of the circular image in the coded picture,
information for specifying a radius, in luma samples, form the center of the circular image to an edge of the circular image,
information for specifying a radius, in luma samples, form the center of the circular image to a closest edge of an area in the circular image where there are no obstructions from a camera body, and
information for specifying an FOV of a fisheye lens corresponding to the circular image.
20. The device of claim 16 , wherein if image flipping region information is present in the metadata, the metadata further comprises information for specifying whether and how a circular image has been flipped and a reverse flipping operation needs to be applied, and
wherein if image scale and lens shading compensation camera intrinsic parameters are present in the metadata, the metadata further comprises information for specifying whether and how the circular image has been scaled along an axis.