Rendering and displaying data
Systems and techniques are described herein for wireless communication. For instance, a method for wireless communication is provided. The method may include determining a first predicted pose of the device, the first predicted pose corresponding to a first time instance; transmitting, to a server, a request to process first data based on the first predicted pose; determining a change in a communication characteristic between the device and the server; and transmitting, to the server, in response to the change in the communication characteristic, a request to cease processing the first data.
1 . An apparatus for wireless communication at a device, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
determine a first predicted pose of the device, the first predicted pose corresponding to a first time instance;
cause at least one transmitter to transmit, to a server, a request to render a first frame of image data based on the first predicted pose;
determine a change in a communication characteristic between the device and the server; and
cause the at least one transmitter to transmit, to the server, in response to the change in the communication characteristic, a request for the server to cease rendering the first frame of image data.
2 . The apparatus of claim 1 , wherein the at least one processor is further configured to:
determine a second predicted pose of the device, the second predicted pose corresponding to a second time instance; and
cause the at least one transmitter to transmit, to the server, a request to render a second frame of image data based on the second predicted pose.
3 . The apparatus of claim 1 , wherein, to determine the first predicted pose of the device, the at least one processor is configured to predict the first predicted pose of the device based on at least one of:
motion data from an inertial measurement unit (IMU) of the device; or
a simultaneous localization and mapping (SLAM) technique based on images captured by the device.
4 . The apparatus of claim 1 , wherein, to determine the first predicted pose, the at least one processor is configured to predict the first predicted pose of the device at the first time instance, and wherein the first time instance is after a current time.
5 . The apparatus of claim 4 , wherein the first time instance is after a current time by a duration and wherein the duration is determined based on at least one of:
a communication time between the device and the server;
a rendering time associated with rendering the first frame of image data;
an encoding time associated with encoding the first frame of image data;
a communication time between the server and the device; or
a decoding time associated with decoding the first frame of image data.
6 . The apparatus of claim 1 , wherein the request to process the first frame of image data comprises an indication of the first predicted pose.
7 . The apparatus of claim 1 , wherein the request to process the first frame of image data comprises at least one of:
an indication of the first predicted pose;
an identifier of the first predicted pose; or
a timestamp indicative of the first time instance.
8 . The apparatus of claim 7 , wherein the request to cease rendering the first frame of image data comprises at least one of:
the indication of the first predicted pose;
the identifier of the first predicted pose; or
the timestamp indicative of the first time instance.
9 . The apparatus of claim 1 , wherein the change in the communication characteristic comprises a change in a round-trip-time (RTT) for communication between the device and the server.
10 . The apparatus of claim 9 , wherein the at least one processor is further configured to determine to transmit the request to cease rendering the first frame of image data based on a duration of the change in the RTT.
11 . The apparatus of claim 9 , wherein the at least one processor is further configured to determine to cause the at least one transmitter to transmit the request to cease rendering the first frame of image data in response to:
the change in the RTT comprising an increase of the RTT, wherein the increase exceeds a first threshold; or
the change in the RTT comprising a decrease of the RTT, wherein the decrease exceeds a second threshold.
12 . The apparatus of claim 1 , wherein the change in the communication characteristic comprises a change in a bandwidth for communication between the device and the server.
13 . The apparatus of claim 12 , wherein the at least one processor is further configured to determine to cause the at least one transmitter to transmit the request to cease rendering the first frame of image data based on a degree of the change in the bandwidth.
14 . The apparatus of claim 12 , wherein the at least one processor is further configured to determine to cause the at least one transmitter to transmit the request to cease rendering the first frame of image data in response to:
the change in the bandwidth comprising an increase of the bandwidth, wherein the increase exceeds a first threshold; or
the change in the bandwidth comprising a decrease of the bandwidth, wherein the decrease exceeds a second threshold.
15 . The apparatus of claim 12 , wherein the at least one processor is further configured to cause the at least one transmitter to transmit a request to revise how to process data at the server based on the change in the bandwidth.
16 . An apparatus for processing data at a server, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
receive, from a device, a request to render a first frame of image data based on a first predicted pose of the device, the first predicted pose corresponding to a first time instance;
in response to the request to render the first frame of image data, initiate rendering of the first frame of image data;
receive, from the device, a request to cease rendering the first frame of image data; and
in response to the request to cease rendering the first frame of image data, cease rendering of the first frame of image data.
17 . The apparatus of claim 16 , wherein the at least one processor is further configured to:
receive, from the device, a request to render a second frame of image data based on a second predicted pose of the device, the second predicted pose corresponding to a second time instance;
in response to the request to render the second frame of image data, render the second frame of image data; and
cause at least one transmitter to transmit the second frame of image data to the device.
18 . The apparatus of claim 17 , wherein, to render the second frame of image data, the at least one processor is configured to render the second frame of image data based on the second predicted pose and encode the second frame of image data.
19 . The apparatus of claim 16 , wherein the request to render the first frame of image data comprises an indication of the first predicted pose.
20 . The apparatus of claim 16 , wherein the request to process the first frame of image data comprises at least one of:
an indication of the first predicted pose;
an identifier of the first predicted pose; or
a timestamp indicative of the first time instance.
21 . The apparatus of claim 20 , wherein the request to cease rendering the first frame of image data comprises at least one of:
the indication of the first predicted pose;
the identifier of the first predicted pose; or
the timestamp indicative of the first time instance.
22 . The apparatus of claim 16 , wherein the at least one processor is further configured to, based on ceasing to render the first frame of image data, cause at least one transmitter to transmit a message to the device.
23 . An apparatus for wireless communication at a device, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory and configured to:
determine a first predicted pose of the device, the first predicted pose corresponding to a first time;
cause at least one transmitter to transmit, to a server, a request to render a first frame of image data based on the first predicted pose;
determine a change in a communication characteristic between the device and the server; and
cause the at least one transmitter to transmit, to the server, in response to the determined change in the communication characteristic, a request for the server to revise how the server renders the first frame of image data.
24 . The apparatus of claim 23 , wherein the at least one processor is further configured to:
determine a second predicted pose of the device, the second predicted pose corresponding to a second time; and
cause the at least one transmitter to transmit, to the server, a request to render a second frame of image data based on the second predicted pose.
25 . The apparatus of claim 23 , wherein the change in the communication characteristic comprises a change in a bandwidth for communication between the device and the server.
26 . The apparatus of claim 23 , wherein the request to revise how the server renders the first frame of image data comprises a request to increase a quality for rendering the first frame of image data or a request to decrease the quality for rendering the first frame of image data.
27 . The apparatus of claim 23 , wherein:
in response to the change in the communication characteristic comprising an increase in a bandwidth for communication between the device and the server, the request to revise how the server renders the first frame of image data comprises a request to increase a quality for rendering the first frame of image data; and
in response to the change in the communication characteristic comprising a decrease in a bandwidth for communication between the device and the server, the request to revise how the server renders the first frame of image data at the server comprises a request to decrease a quality for rendering the first frame of image data.