Method and apparatus for creating, streaming, and rendering HDR images
A user equipment includes a modem receives a compressed bitstream and metadata. The UE also includes a decoder that decodes the compressed bitstream to generate an HDR image, an inertial measurement unit that determines viewpoint information based on an orientation of the UE, and a graphics processing unit (GPU). The GPU maps the HDR image onto a surface and renders a portion of the HDR image based on the metadata and the viewpoint information. A display displays the portion of the HDR image.
1. A user equipment (UE) for rendering a high dynamic range (HDR) image comprising:
a modem configured to receive a compressed bitstream and metadata, wherein the compressed bitstream includes a first standard dynamic range (SDR) image and a second SDR image and wherein the metadata includes a plurality of blend factors corresponding to view directions;
a decoder configured to decode the compressed bitstream to generate the first SDR image and the second SDR image;
an inertial measurement unit configured to determine viewpoint information based on an orientation of the UE;
a graphics processing unit (GPU) configured to:
combine the first SDR image and the second SDR image to generate a view dependent HDR image based on the blend factors and the viewpoint information;
map the HDR image onto a surface; and
render a portion of the mapped HDR image based on the metadata and the viewpoint information; and
a display configured to display the portion of the mapped HDR image.
2. The UE of claim 1 , wherein the plurality of blend factors further correspond to weights applied to the first SDR image and the second SDR image.
3. The UE of claim 1 , wherein the first SDR image is a low exposure image and the second SDR image is a high exposure image.
4. The UE of claim 1 , wherein the first SDR image and the second SDR image included in the compressed bitstream are included in a frame packed image.
5. A method for rendering a high dynamic range (HDR) image in a user equipment (UE), the method comprising:
receiving a compressed bitstream and metadata, wherein the compressed bitstream includes a first standard dynamic range (SDR) image and a second SDR image and wherein the metadata includes a plurality of blend factors corresponding to view directions;
decoding the compressed bitstream to generate the first SDR image and the second SDR image;
determining viewpoint information based on an orientation of the UE;
combining the first SDR image and the second SDR image to generate a view dependent HDR image based on the blend factors and the viewpoint information;
mapping the HDR image onto a surface;
rendering a portion of the mapped HDR image based on the metadata and the viewpoint information; and
displaying the portion of the mapped HDR image.
6. The method of claim 5 , wherein the surface is at least one of a spherical surface or a cylindrical surface.
7. The method of claim 5 , wherein the first SDR image and the second SDR image included in the compressed bitstream are included in a frame packed image.
8. The method of claim 5 , wherein the first SDR image is a low exposure image and the second SDR image is a high exposure image.
9. The method of claim 5 , wherein the plurality of blend factors further correspond to weights applied to the first SDR image and the second SDR image.
10. The method of claim 5 , wherein the viewpoint information includes pitch and yaw information.
11. The method of claim 7 , wherein the frame packed image is packed in a top-bottom method or a left-right method.
12. The method of claim 11 , further comprising unpacking the first SDR image and the second SDR image from the frame packed image.
13. The UE of claim 1 , wherein the surface is at least one of a spherical surface or a cylindrical surface.
14. The UE of claim 1 , wherein the viewpoint information includes pitch and yaw information.
15. The UE of claim 4 , wherein the frame packed image is packed in a top-bottom method or a left-right method.
16. The UE of claim 15 , wherein the GPU is further configured to unpack the first SDR image and the second SDR image from the frame packed image.