SLICED ENCODING AND DECODING FOR REMOTE RENDERING
Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.
1 . A first device comprising:
at least one processor configured to:
encode a first slice of a plurality of slices of an artificial reality image, starting at a first time and completing at a second time,
encode a second slice of the plurality of slices starting at a third time and completing at a fourth time, wherein the third time is after the first time and before the second time;
transmit, via a transmitter, the encoded first slice to a second device starting at a fifth time after the second time, and completing at the sixth time; and
transmit, via the transmitter, the encoded second slice to the second device starting at a seventh time that is after the fifth time and before the sixth time.
2 . The first device of claim 1 , wherein:
a content generator comprising the at least one processor is configured to encode the first slice and the second slice; and
a communication interface coupled to the content generator is configured to transmit the encoded first slice and the encoded second slice.
3 . The first device of claim 1 , wherein the at least one processor is further configured to:
partition an image of an artificial reality space into the plurality of slices; and
transmit the encoded first slice and the encoded second slice to a head wearable display.
4 . The first device of claim 1 , wherein:
the first slice and the second slice are separated by a boundary; and
the at least one processor is further configured to generate motion vectors of the artificial reality image, wherein the motion vectors do not traverse the boundary between the first slice and the second slice.
5 . The first device of claim 1 , wherein the at least one processor is configured to transmit a portion of the encoded first slice, while the at least one processor encodes a portion of the second slice.
6 . The first device of claim 1 , wherein the at least one processor is configured to:
encode a third slice, starting at a ninth time and completing at a tenth time, wherein the ninth time is before the second time; and
transmit the encoded third slice starting at an eleventh time before the sixth time.
7 . The first device of claim 6 , wherein the at least one processor is configured to transmit a portion of the encoded second slice, while encoding a portion of the third slice.
8 . The device of claim 1 , wherein the at least one processor is further configured to:
receive sensor measurements indicating a location or an orientation of a head wearable display; and
generate a space of the artificial reality image according to the location or the orientation of the head wearable display.
9 . A method comprising:
encoding, by a device, a first slice of a plurality of slices of an artificial reality image, starting at a first time and completing at a second time,
encoding, by the device a second slice of the plurality of slices starting at a third time and completing at a fourth time, wherein the third time is after the first time and before the second time;
transmitting, by the device, the encoded first slice to a second device starting at a fifth time after the second time, and completing at the sixth time; and
transmitting, by the device, the encoded second slice to the second device starting at a seventh time that is after the fifth time and before the sixth time.
10 . The method of claim 9 , further comprising:
partitioning, by the device, an image of an artificial reality space into the plurality of slices; and
transmitting, by the device, the encoded first slice and the encoded second slice to a head wearable display.
11 . The method of claim 9 , further comprising:
generating, by the device, motion vectors of the artificial reality image, wherein the motion vectors do not traverse a boundary between the first slice and the second slice separating the first slice and the second slice.
12 . The method of claim 9 , further comprising:
transmitting, by the device, a portion of the encoded first slice, while the at least one processor encodes a portion of the second slice.
13 . The method of claim 9 , further comprising:
encoding, by the device, a third slice, starting at a ninth time and completing at a tenth time, wherein the ninth time is before the second time; and
transmitting, by the device, the encoded third slice starting at an eleventh time before the sixth time.
14 . The method of claim 13 , further comprising:
transmitting, by the device, a portion of the encoded second slice, while encoding a portion of the third slice.
15 . The method of claim 9 , further comprising:
receiving, by the device, sensor measurements indicating a location or an orientation of a head wearable display; and
generating, by the sensor device, a space of the artificial reality image according to the location or the orientation of the head wearable display.
16 . A non-transitory computer readable medium storing program instructions for causing at least one processor of a device to:
encode a first slice of a plurality of slices of an artificial reality image, starting at a first time and completing at a second time,
encode a second slice of the plurality of slices starting at a third time and completing at a fourth time, wherein the third time is after the first time and before the second time;
transmit, via a transmitter, the encoded first slice to a second device starting at a fifth time after the second time, and completing at the sixth time; and
transmit, via the transmitter, the encoded second slice to the second device starting at a seventh time that is after the fifth time and before the sixth time.
17 . The non-transitory computer readable medium of claim 15 , wherein the program instructions cause the at least one processor to:
partition an image of an artificial reality space into the plurality of slices; and
transmit the encoded first slice and the encoded second slice to a head wearable display.
18 . The non-transitory computer readable medium of claim 15 , wherein the program instructions cause the at least one processor to:
separate the first slice and the second slice by a boundary; and
generate motion vectors of the artificial reality image, wherein the motion vectors do not traverse the boundary between the first slice and the second slice.
19 . The non-transitory computer readable medium of claim 15 , wherein the program instructions cause the at least one processor to:
encode a third slice, starting at a ninth time and completing at a tenth time, wherein the ninth time is before the second time; and
transmit the encoded third slice starting at an eleventh time before the sixth time.
20 . The non-transitory computer readable medium of claim 15 , wherein the program instructions cause the at least one processor to:
receive sensor measurements indicating a location or an orientation of a head wearable display; and
generate a space of the artificial reality image according to the location or the orientation of the head wearable display.