Method for transmitting reduced depth information and electronic device
The embodiments of the disclosure provide a method for transmitting reduced depth information and an electronic device. The method includes: obtaining a first depth map of an image frame, wherein the first depth map includes a plurality of first depth pixels corresponding to multiple image pixels in the image frame; downscaling the first depth map as a second depth map, wherein the second depth map includes multiple second depth pixels, and each second depth pixel has a depth value; adjusting the second depth map as a third depth map by scaling up the depth value of each second depth pixel based on a specific ratio; dividing the third depth map into multiple fourth depth maps; appending the fourth depth maps to the image frame; encoding the image frame appended with the fourth depth maps; and transmitting the encoded image frame to a client device.
1. A method for transmitting reduced depth information, comprising:
obtaining, by a remote server, a first depth map of an image frame, wherein the first depth map comprises a plurality of first depth pixels corresponding to a plurality of image pixels in the image frame;
downscaling, by the remote server, the first depth map as a second depth map, wherein the second depth map comprises a plurality of second depth pixels, and each second depth pixel has a depth value;
adjusting, by the remote server, the second depth map as a third depth map by scaling up the depth value of each second depth pixel based on a specific ratio;
dividing, by the remote server, the third depth map into a plurality of fourth depth maps;
appending, by the remote server, the fourth depth maps to the image frame;
encoding, by the remote server, the image frame appended with the fourth depth maps; and
transmitting, by the remote server, the encoded image frame to a client device.
2. The method according to claim 1 , wherein before the step of obtaining the first depth map of the image frame, the method further comprises:
generating, by the remote server, the image frame for the client device by rendering a specific part of a visual content.
3. The method according to claim 1 , wherein a size of the first depth map is W×H, W is a width of the first depth map, H is a height of the first depth map, and the step of downscaling the first depth map as the second depth map comprises:
downscaling, by the remote server, a resolution of the first depth map to
W
a
×
H
b
,
wherein a and b are scaling factors.
4. The method according to claim 1 , wherein the depth value of each second depth pixel is a normalized depth value ranged between a lower limit and an upper limit, and the step of adjusting the second depth map as the third depth map by scaling up the depth value of each second depth pixel based on the specific ratio comprises:
determining, by the remote server, a reference upper limit via multiplying the upper limit with a predetermined factor, wherein the predetermined factor ranges between 0 and 1;
determining, by the remote server, the specific ratio based on the predetermined factor; and
generating, by the remote server, the third depth map by multiplying the depth value of each second depth pixel by the specific ratio.
5. The method according to claim 4 , wherein the lower limit is 0.0f and the upper limit is 1.0f, wherein f stands for a floating number.
6. The method according to claim 4 , wherein the specific ratio is a reciprocal of the predetermined factor.
7. The method according to claim 1 , wherein the third depth map comprises a first region and a second region respectively corresponding to a left-eye frame part and a right-eye frame part of the image frame, each image pixel is characterized as N bits, and the depth value of each second pixel in the third depth map is characterized as N/2 bits.
8. The method according to claim 1 , wherein a size of the third depth map is
W
a
×
H
b
,
and a size of each fourth depth map is
W
a
×
H
b
×
c
,
wherein a and b are scaling factors, c is a dividing factor.
9. The method according to claim 8 , wherein a size of the image frame is W′×H′, a size of the image frame appended with the fourth depth maps is
W
′
×
(
H
′
+
H
b
×
c
)
.
10. The method according to claim 1 , further comprising:
receiving, by the client device, the encoded image frame from the remote server;
obtaining, by the client device, the image frame appended with the fourth depth maps by decoding the encoded image frame;
constructing, by the client device, the third depth map based on the fourth depth maps;
generating, by the client device, a visual content based on the image frame and the third depth map.
11. An electronic system comprising a remote server and a client device, wherein the remote server is configured to perform:
obtaining a first depth map of an image frame, wherein the first depth map comprises a plurality of first depth pixels corresponding to a plurality of image pixels in the image frame;
downscaling the first depth map as a second depth map, wherein the second depth map comprises a plurality of second depth pixels, and each second depth pixel has a depth value;
adjusting the second depth map as a third depth map by scaling up the depth value of each second depth pixel based on a specific ratio;
dividing the third depth map into a plurality of fourth depth maps;
appending the fourth depth maps to the image frame;
encoding the image frame appended with the fourth depth maps; and
transmitting the encoded image frame to the client device.
12. The electronic system according to claim 11 , wherein before obtaining the first depth map of the image frame, the remote server further performs:
generating the image frame for the client device by rendering a specific part of a visual content.
13. The electronic system according to claim 11 , wherein a size of the first depth map is W×H, W is a width of the first depth map, H is a height of the first depth map, and the remote server performs:
downscaling a resolution of the first depth map to
W
a
×
H
b
,
wherein a and b are scaling factors.
14. The electronic system according to claim 11 , wherein the depth value of each second depth pixel is a normalized depth value ranged between a lower limit and an upper limit, and the remote server performs:
determining a reference upper limit via multiplying the upper limit with a predetermined factor, wherein the predetermined factor ranges between 0 and 1;
determining the specific ratio based on the predetermined factor; and
generating the third depth map by multiplying the depth value of each second depth pixel by the specific ratio.
15. The electronic system according to claim 14 , wherein the lower limit is 0.0f and the upper limit is 1.0f, wherein f stands for a floating number.
16. The electronic system according to claim 14 , wherein the specific ratio is a reciprocal of the predetermined factor.
17. The electronic system according to claim 11 , wherein the third depth map comprises a first region and a second region respectively corresponding to a left-eye frame part and a right-eye frame part of the image frame, each image pixel is characterized as N bits, and the depth value of each second pixel in the third depth map is characterized as N/2 bits.
18. The electronic system according to claim 11 , wherein a size of the third depth map is
W
a
×
H
b
,
and a size of each fourth depth map is
W
a
×
H
b
×
c
,
wherein a and b are scaling factors, c is a dividing factor.
19. The electronic system according to claim 18 , wherein a size of the image frame is W′×H′, a size of the image frame appended with the fourth depth maps is
W
′
×
(
H
′
+
H
b
×
c
)
.
20. The electronic system according to claim 11 , wherein the client device performs:
receiving the encoded image frame from the remote server;
obtaining the image frame appended with the fourth depth maps by decoding the encoded image frame;
constructing the third depth map based on the fourth depth maps; and
generating a visual content based on the image frame and the third depth map.