Computer-altered reality data rendering coordination
Techniques, devices, and systems for computer-altered reality data rendering coordination are discussed herein. Coordination of disjointed and/or distributed rendering of computer-altered reality data (e.g., extended reality (XR) data) performed by networks and systems can be performed. The coordination can be performed based on various types of information. Information utilized to perform the coordination of computer-altered reality data rendering can include coordination and/or rendering information (e.g., global coordination information, global rendering information, other global information of one or more other types, or any combination thereof). The computer-altered reality data can be rendered utilizing coordinated nodes, which can provide rendered computer-altered reality data for the user devices.
1 . A method comprising:
exchanging at least one computer-altered reality data oriented communication with a user device;
based on the at least one computer-altered reality data oriented communication, identifying, by a primary node, computer-altered reality data that includes at least one set of computer-altered reality item data, wherein the primary node is initiated via an edge server associated with a network edge location, the network edge location being identified by an edge location identifier that is based on a device location identifier indicating a location of the user device;
identifying primary node rendering coordination information based on the computer-altered reality data being identified, and at least one portion of computer-altered reality data rendering information based on the at least one set of computer-altered reality item data being identified;
based on the primary node rendering coordination information, transmitting, to at least one coordinated node, the at least one portion of computer-altered reality data rendering information and the at least one set of computer-altered reality item data, the at least one coordinated node utilizing the at least one portion of computer-altered reality data rendering information to render, as at least one set of rendered computer-altered reality item data, the at least one set of computer-altered reality item data;
receiving, from the at least one coordinated node, the at least one set of rendered computer-altered reality item data; and
transmitting the at least one set of rendered computer-altered reality item data to the user device, the at least one set of rendered computer-altered reality item data being blended by the primary node or the user device.
2 . The method of claim 1 , wherein identifying primary node rendering coordination information further comprises:
identifying at least one of selection information, distribution information, coherence information, aggregation information, network information, or orchestration information; and
identifying the primary node rendering coordination information, including the at least one of the selection information, the distribution information, the coherence information, the aggregation information, the network information, or the orchestration information.
3 . The method of claim 1 , further comprising:
transmitting, by an edge server and to a user device, a portion of the primary node rendering coordination information,
blending, as first blended computer-altered reality data, the at least one set of rendered computer-altered reality item data based on the portion of the primary node rendering coordination information,
wherein transmitting the computer-altered reality data further comprises transmitting the first blended computer-altered reality data to the user device, the user device refining the first blended computer-altered reality data to generate second blended computer-altered reality data, the second blended computer-altered reality data being generated further based on at least one of previous computer-altered reality data, asynchronous time warp (ATW) information, occlusion handling information, or pose loop information.
4 . The method of claim 1 , wherein the user device receives the at least one set of rendered computer-altered reality item data, and blends, as blended computer-altered reality item data, the at least one set of rendered computer-altered reality item data.
5 . The method of claim 1 , wherein identifying primary node rendering coordination information further comprises identifying, via execution of rendering software that is customized by at least one of a rendering service plugin or a rendering management plugin, the primary node rendering coordination information.
6 . The method of claim 1 , wherein rendering by the at least one coordinated node of the computer-altered reality data further comprises utilizing coherence information in the primary node rendering coordination information to coordinate the rendering of the computer-altered reality data based on coordinated node information, the coordinated node information including at least one of coordinated node validation information, coordinated node allocation information, dynamic resource management information, or item rendering information.
7 . A system comprising:
at least one processor; and
non-transitory memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
exchanging, with a user device, at least one communication associated with computer-altered reality data;
transmitting, to at least one coordinated node, at least one set of the computer-altered reality data, the at least one coordinated node utilizing at least one portion of computer-altered reality data rendering information to render, as rendered computer-altered reality data that includes at least one set of rendered computer-altered reality data, the at least one set of the computer-altered reality data;
receiving, from the at least one coordinated node, the at least one set of the rendered computer-altered reality data;
identifying the rendered computer-altered reality data that includes the at least one set of the rendered computer-altered reality data, the at least one set of the rendered computer-altered reality data being associated with at least one rendered item; and
routing the at least one set of the rendered computer-altered reality data to the user device, wherein routing the at least one set of the rendered computer-altered reality data further comprises transmitting the rendered computer-altered reality data to the user device, wherein the user device performs at least one of an asynchronous time warp (ATW) process or an asynchronous spatial warp (ASW) process on the rendered computer-altered reality data, and blends and recomposites, based at least in part on the performing of the at least one of the ATW or the ASW process, recomposited computer-altered reality data comprising a rendered computer-altered reality frame that includes the rendered computer-altered reality data.
8 . The system of claim 7 , the operations further comprising:
continuously receiving user device information from the user device, the user device information including at least one of pose information, device location information, or lighting information; and
dynamically performing at least one of a time synchronization or a spatial synchronization, based at least in part on the user device information.
9 . The system of claim 7 , wherein the at least one portion of computer-altered reality data rendering information is utilized to route the at least one set of the computer-altered reality data, and
wherein individual ones of the at least one portion of the computer-altered reality data rendering information include item classification information, and the item classification information includes at least one of item interactivity information, frame rate information, or resolution information.
10 . The system of claim 7 , the operations further comprising:
identifying the rendered computer-altered reality data that includes the at least one set of the rendered computer-altered reality data, the at least one set of the rendered computer-altered reality data being associated with at least one rendered item,
performing at least one of an asynchronous time warp (ATW) process or an asynchronous spatial warp (ASW) process on the rendered computer-altered reality data; and
based at least in part on the performing of the at least one of the ATW or the ASW process, utilizing occlusion information to blend and recomposite, as recomposited computer-altered reality data, a recomposited computer-altered reality frame that includes the rendered computer-altered reality data,
wherein routing the at least one set of the rendered computer-altered reality data further comprises transmitting, to the user device, the recomposited computer-altered reality frame.
11 . The system of claim 7 , wherein routing the at least one set of the computer-altered reality data further comprises transmitting, based at least in part on the at least one portion of the computer-altered reality data rendering information, the at least one set of the computer-altered reality data, and
wherein the at least one portion of the computer-altered reality data rendering information includes one or more of at least one item classification identifier, at least one server identifier, or at least one node identifier.
12 . The system of claim 7 , the operations further comprising:
identifying primary node information that includes at least one of time information, frame information, universal coordinate information, global illumination (GI) synchronization information.
13 . The system of claim 7 , the operations further comprising:
identifying primary node information associated with at least one server,
blending, as at least one set of blended computer-altered reality data, the at least one set of the rendered computer-altered reality data based at least in part on the primary node information,
wherein the primary node information includes at least one of an edge node blending flag being set, and the primary node information further includes at least one of primary node location information, quality on demand (QoD) information, edge cloud guarantee information, or user device location information; and
transmitting the at least one set of the blended computer-altered reality data to the user device.
14 . One or more non-transitory computer-readable media storing instructions executable by at least one processor, wherein the instructions, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
exchanging, with a user device, at least one communication associated with computer-altered reality data;
transmitting, to at least one coordinated node, at least one set of the computer-altered reality data, the at least one coordinated node utilizing at least one portion of computer-altered reality data rendering information to render, as rendered computer-altered reality data that includes at least one set of rendered computer-altered reality data, the at least one set of the computer-altered reality data;
receiving, from the at least one coordinated node, the at least one set of the rendered computer-altered reality data;
identifying primary node information associated with at least one server,
blending, as at least one set of blended computer-altered reality data, the at least one set of the rendered computer-altered reality data based at least in part on the primary node information,
wherein the primary node information includes at least one of an edge node blending flag being set, and further includes at least one of primary node location information, quality on demand (QoD) information, edge cloud guarantee information, or user device location information; and
transmitting the at least one set of the blended computer-altered reality data to the user device.
15 . The one or more non transitory computer readable media of claim 14 , wherein routing the at least one set of the rendered computer-altered reality data further comprises:
identifying, based at least in part on at least one depth identifier associated with a depth map, occlusion information, the at least one depth identifier indicating at least one depth corresponding to at least one item associated with the at least one set of the computer-altered reality data, the at least one depth being identified with respect to a location of the user device; and
blending, as at least one set of blended computer-altered reality data, the at least one set of the rendered computer-altered reality data, based at least in part on the occlusion information.
16 . The one or more non transitory computer readable media of claim 14 , the operations further comprising:
identifying the at least one portion of the computer-altered reality data rendering information utilized to transmit the at least one set of the computer-altered reality data,
wherein the at least one portion of computer-altered reality data rendering information includes item classification information, and the item classification information includes at least one of item interactivity information, frame rate information, or resolution information.
17 . The one or more non transitory computer readable media of claim 14 , wherein the user device identifies user device information, the user device information including at least one of pose information, location information, or lighting information,
wherein the user device identifies item classification information associated with individual ones of the at least one set of the computer-altered reality data, and the item classification information includes at least one of item interactivity information, frame rate information, or resolution information, and
wherein the user device blends the rendered computer-altered reality data based at least in part on the user device information and the item classification information.
18 . The one or more non transitory computer readable media of claim 14 , the operations further comprising:
identifying, via execution of rendering software that is customized by at least one of a rendering service plugin or a rendering management plugin, the at least one portion of the computer-altered reality data rendering information.
19 . The one or more non transitory computer readable media of claim 14 , the operations further comprising:
continuously receiving user device information from the user device, the user device information including at least one of pose information, device location information, or lighting information; and
dynamically performing at least one of a time synchronization or a spatial synchronization, based at least in part on the user device information.
20 . The one or more non transitory computer readable media of claim 14 , wherein the at least one portion of computer-altered reality data rendering information is utilized to route the at least one set of the computer-altered reality data, and
wherein individual ones of the at least one portion of the computer-altered reality data rendering information include item classification information, and the item classification information includes at least one of item interactivity information, frame rate information, or resolution information.