Techniques to facilitate a cloud-based vehicle XR experience
Apparatus, methods, and computer-readable media for facilitating a cloud-based vehicle XR user experience are disclosed herein. An example method for wireless communication at a user equipment (UE) includes transmitting a request for a vehicle extended reality (XR) session. The vehicle XR session may be based on a first user XR stream including a vehicle XR component associated with a vehicle and a first user XR component associated with a first user. The first user may have an association with the vehicle. The example method also includes transmitting uplink information associated with the first user XR stream. The example method also includes receiving rendering information associated with the first user XR stream. The rendering information may be based on the uplink information.
1. An apparatus for wireless communication at a user equipment (UE), comprising:
memory; and
one or more processors coupled to the memory and configured to cause the UE to:
transmit a request for a vehicle extended reality (XR) session, wherein the vehicle XR session is based on a first user XR stream that includes a vehicle XR component associated with a vehicle and a first user XR component associated with a first user, wherein the first user has an association with the vehicle and the first user XR component includes relative user pose information with reference to the vehicle;
transmit, via wireless communication, information associated with the first user XR stream, wherein the information associated with the first user XR stream includes vehicle position information and first user XR information, and wherein the first user XR information comprises the relative user pose information that indicates an orientation of the first user relative to an XR space; and
receive, via a wireless connection, rendering information associated with the first user XR stream, wherein the rendering information is based at least in part on the information associated with the first user XR stream, which includes the relative user pose information.
2. The apparatus of claim 1 , further comprising:
at least one antenna coupled to the one or more processors, wherein the one or more processors are further configured to cause the UE to:
present the rendering information via one or more displays associated with the vehicle XR session.
3. The apparatus of claim 1 , wherein the vehicle XR component includes at least one of vehicle posture information, vehicle information, and vehicle-surrounding information, and wherein the relative user pose information is based on the orientation of the first user as an absolute orientation separate from a vehicle coordinate system or as a relative orientation with respect to the vehicle coordinate system.
4. The apparatus of claim 1 , wherein the first user XR component further includes user input with reference to the vehicle.
5. The apparatus of claim 1 , wherein the request for the vehicle XR session includes a subscription credential, wherein the subscription credential is associated with a subscription level.
6. The apparatus of claim 1 , wherein the one or more processors are further configured to cause the UE to:
collect the first user XR component associated with the first user XR stream via one or more of an advanced driver assistant system (ADAS) or an in-vehicular sensor, wherein the information associated with the first user XR stream comprises the first user XR component.
7. The apparatus of claim 1 , wherein the one or more processors are further configured to cause the UE to:
detect a user interaction with an interactive object associated with rendered information, and wherein the first user XR component includes user interaction information associated with the user interaction.
8. The apparatus of claim 7 , wherein the interactive object is associated with the vehicle XR component of the vehicle XR session.
9. The apparatus of claim 1 , wherein the information associated with the first user XR stream includes at least a first timestamp associated with the vehicle XR component and at least a second timestamp associated with the first user XR component.
10. The apparatus of claim 1 , wherein the rendering information includes an augmentation component associated with vehicle-surrounding information.
11. The apparatus of claim 1 , wherein the vehicle XR session is further based on a second user XR stream that includes the vehicle XR component and a second user XR component associated with a second user.
12. The apparatus of claim 11 , wherein the rendering information includes a first rendering component associated with the first user XR stream and a second rendering component associated with the second user XR stream.
13. The apparatus of claim 11 , wherein the vehicle XR component is shared between the first user XR stream and the second user XR stream.
14. The apparatus of claim 1 , wherein the vehicle position information is in a first transmission, and the relative user pose information is in a second transmission.
15. The apparatus of claim 1 , wherein the vehicle position information and the relative user pose information are transmitted together.
16. A method of wireless communication at a user equipment (UE), comprising:
transmitting a request for a vehicle extended reality (XR) session, wherein the vehicle XR session is based on a first user XR stream including a vehicle XR component associated with a vehicle and a first user XR component associated with a first user, wherein the first user has an association with the vehicle and the first user XR component includes relative user pose information with reference to the vehicle;
transmitting, via wireless communication, information associated with the first user XR stream, wherein the information associated with the first user XR stream includes vehicle position information and first user XR information, and wherein the first user XR information comprises the relative user pose information that indicates an orientation of the first user relative to an XR space; and
receiving, via a wireless connection, rendering information associated with the first user XR stream, wherein the rendering information is based on the information associated with the first user XR stream, which includes the relative user pose information.
17. The method of claim 16 , wherein the vehicle XR component includes at least one of vehicle posture information, vehicle information, and vehicle-surrounding information, wherein the relative user pose information is based on the orientation of the first user as an absolute orientation separate from a vehicle coordinate system or as a relative orientation with respect to the vehicle coordinate system, and wherein the first user XR component further includes user input with reference to the vehicle.
18. The method of claim 16 , wherein the request for the vehicle XR session includes a subscription credential, wherein the subscription credential is associated with a subscription level.
19. The method of claim 16 , further comprising:
detecting a user interaction with an interactive object associated with rendered information, and wherein the first user XR component includes user interaction information associated with the user interaction.
20. The method of claim 16 , wherein the vehicle XR session is further based on a second user XR stream including the vehicle XR component and a second user XR component associated with a second user, wherein the rendering information includes a first rendering component associated with the first user XR stream and a second rendering component associated with the second user XR stream.
21. The method of claim 16 , wherein the vehicle position information is in a first transmission, and the relative user pose information is in a second transmission.
22. The method of claim 16 , wherein the vehicle position information and the relative user pose information are transmitted together.
23. An apparatus for wireless communication at a network entity, comprising:
memory; and
one or more processors coupled to the memory and configured to cause the network entity to:
obtain a request for a vehicle extended reality (XR) session;
authorize the vehicle XR session, wherein the vehicle XR session is based on a first user XR stream that includes a vehicle XR component associated with a vehicle and a first user XR component associated with a first user, wherein the first user has an association with the vehicle and the first user XR component includes relative user pose information with reference to the vehicle;
obtain information associated with the first user XR stream, wherein the information associated with the first user XR stream includes vehicle position information and first user XR information, and wherein the first user XR information comprises the relative user pose information that indicates an orientation of the first user relative to an XR space; and
output rendering information associated with the first user XR stream, wherein the rendering information is based on the information associated with the first user XR stream, which includes the relative user pose information.
24. The apparatus of claim 23 , wherein the vehicle XR component includes at least one of vehicle posture information, vehicle information, and vehicle-surrounding information, and wherein the relative user pose information is based on the orientation of the first user as an absolute orientation separate from a vehicle coordinate system or as a relative orientation with respect to the vehicle coordinate system.
25. The apparatus of claim 23 , wherein the first user XR component further includes user input with reference to the vehicle.
26. The apparatus of claim 23 , wherein the request for the vehicle XR session includes a subscription credential, and wherein the subscription credential is associated with a subscription level.
27. The apparatus of claim 23 , further comprising:
at least one antenna coupled to the one or more processors, wherein the one or more processors are further configured to cause the network entity to:
combine the information associated with the first user XR stream based on the vehicle XR component and the first user XR component to generate the rendering information.
28. The apparatus of claim 27 , wherein to combine the information associated with the first user XR stream, the one or more processors are further configured to cause the network entity to:
identify an environmental component via the vehicle XR component of the first user XR stream; and
associate an augmentation component with vehicle-surrounding information based on the environmental component.
29. The apparatus of claim 27 , wherein the information associated with the first user XR stream includes user interaction information associated with a user interaction, and the one or more processors are further configured to cause the network entity to:
output subsequent rendering information based on the user interaction information.
30. The apparatus of claim 29 , wherein the network entity is a first network entity, and the one or more processors are further configured to cause the network entity to:
identify a transaction interaction based on the user interaction information, the transaction interaction associated with a service provided by a second network entity; and
output transaction information to facilitate a transaction associated with the service.
31. The apparatus of claim 30 , wherein the one or more processors are further configured to cause the network entity to:
establish a connection with the second network entity based on the transaction interaction;
obtain service information via the connection with the second network entity; and
generate the transaction information based on the information associated with the first user XR stream and the service information.
32. The apparatus of claim 30 , wherein the one or more processors are further configured to cause the network entity to:
obtain a transaction message in response to the transaction information; and
generate the subsequent rendering information based on the transaction message.
33. The apparatus of claim 23 , wherein the information associated with the first user XR stream includes at least a first timestamp associated with the vehicle XR component and at least a second timestamp associated with the first user XR component, and the one or more processors are further configured to cause the network entity to:
correlate multiple attributes of the information based on at least the first timestamp and the second timestamp.
34. The apparatus of claim 23 , wherein the vehicle XR session is further based on a second user XR stream that includes the vehicle XR component and a second user XR component associated with a second user.
35. The apparatus of claim 34 , wherein the rendering information includes a first rendering component associated with the first user XR stream and a second rendering component associated with the second user XR stream.
36. The apparatus of claim 35 , wherein the one or more processors are further configured to cause the network entity to obtain second user XR information that includes the second user XR component associated with the second user, and the second rendering component is based on the vehicle XR component and the second user XR component.
37. The apparatus of claim 34 , wherein the vehicle XR component is shared between the first user XR stream and the second user XR stream.
38. The apparatus of claim 23 , wherein the vehicle position information is in a first transmission, and the relative user pose information is in a second transmission.
39. The apparatus of claim 23 , wherein the vehicle position information and the relative user pose information are transmitted together.
40. A method of wireless communication at a network entity, comprising:
obtaining a request for a vehicle extended reality (XR) session;
authorizing the vehicle XR session, wherein the vehicle XR session is based on a first user XR stream including a vehicle XR component associated with a vehicle and a first user XR component associated with a first user, wherein the first user has an association with the vehicle and the first user XR component includes relative user pose information with reference to the vehicle;
obtaining information associated with the first user XR stream, wherein the information associated with the first user XR stream includes vehicle position information and first user XR information, and wherein the first user XR information comprises the relative user pose information that indicates an orientation of the first user relative to an XR space; and
outputting rendering information associated with the first user XR stream, wherein the rendering information is based on the information associated with the first user XR stream, which includes the relative user pose information.
41. The method of claim 40 , further comprising:
combining the information associated with the first user XR stream based on the vehicle XR component and the first user XR component to generate the rendering information, wherein the information associated with the first user XR stream includes user interaction information associated with a user interaction; and
outputting subsequent rendering information based on the user interaction information.
42. The method of claim 41 , wherein the network entity is a first network entity, and the method further comprises:
identifying a transaction interaction based on the user interaction information, the transaction interaction associated with a service provided by a second network entity; and
outputting transaction information to facilitate a transaction associated with the service.
43. The method of claim 42 , further comprising:
establishing a connection with the second network entity based on the transaction interaction;
obtaining service information via the connection with the second network entity; and
generating the transaction information based on the information associated with the first user XR stream and the service information.
44. The method of claim 42 , further comprising:
obtaining a transaction message in response to the transaction information; and
generating the subsequent rendering information based on the transaction message.
45. The method of claim 40 , wherein the vehicle XR session is further based on a second user XR stream including the vehicle XR component and a second user XR component associated with a second user, wherein the rendering information includes a first rendering component associated with the first user XR stream and a second rendering component associated with the second user XR stream.
46. The method of claim 40 , wherein the vehicle position information is in a first transmission, and the relative user pose information is in a second transmission.
47. The method of claim 40 , wherein the vehicle position information and the relative user pose information are transmitted together.
48. A non-transitory computer-readable storage medium, comprising code for a network entity, wherein the code when executed by one or more processors causes the network entity to:
obtain a request for a vehicle extended reality (XR) session;
authorize the vehicle XR session, wherein the vehicle XR session is based on a first user XR stream that includes a vehicle XR component associated with a vehicle and a first user XR component associated with a first user, wherein the first user has an association with the vehicle and the first user XR component includes relative user pose information with reference to the vehicle;
obtain information associated with the first user XR stream, wherein the information associated with the first user XR stream includes vehicle position information and first user XR information, and wherein the first user XR information comprises the relative user pose information that indicates an orientation of the first user relative to an XR space; and
output rendering information associated with the first user XR stream, wherein the rendering information is based on the information associated with the first user XR stream, which includes the relative user pose information.
49. A non-transitory computer-readable storage medium, comprising code for a user equipment (UE), wherein the code when executed by one or more processors causes the UE to:
transmit a request for a vehicle extended reality (XR) session, wherein the vehicle XR session is based on a first user XR stream that includes a vehicle XR component associated with a vehicle and a first user XR component associated with a first user, wherein the first user has an association with the vehicle and the first user XR component includes relative user pose information with reference to the vehicle;
transmit, via wireless communication, information associated with the first user XR stream, wherein the information associated with the first user XR stream includes vehicle position information and first user XR information, and wherein the first user XR information comprises the relative user pose information that indicates an orientation of the first user relative to an XR space; and
receive, via a wireless connection, rendering information associated with the first user XR stream, wherein the rendering information is based on the information associated with the first user XR stream, which includes the relative user pose information.