Method and device for providing split computing based on device capability

1 . A method performed by a user equipment (UE) for providing capability-based split computing, the method comprising:

measuring, by a hardware-component of the UE, a performance parameter of the UE based on an environment parameter for the UE;

determining, by a hardware-processor of the UE, an abnormal status of the UE based on the environment parameter and the performance parameter;

transmitting, by the hardware-processor via a transceiver, to a server, a message including information on UE capability related to the environment parameter and the performance parameter, wherein the UE capability is adjusted based on the determined abnormal status and the UE capability indicates UE requirements for the server;

receiving, by the hardware-processor via the transceiver, from the server, first information on adjusted content and second information on an adjusted process, according to the UE capability information, wherein the second information includes a process manifest, and the adjusted content meets the UE requirements; and

executing the adjusted process to receive the adjusted content,

wherein the environment parameter includes a temperature of the UE, a voltage of the UE, and an operation frequency of the UE,

wherein the performance parameter includes:

first latency information indicating a time taken by the UE from reception of rendered result to display,

second latency information indicating a time taken for the UE to decode one or more media, position the decoded one or more media on 3-dimension, and composite them, and

frame-drop information indicating a number of frames that are not finally rendered relative to a target frame per second (fps) of content,

wherein the adjusted process is determined, according to the performance degradation of the UE, as adjusting process complexity or deleting a process, and

wherein the process manifest is created according to at least one of a scheme for specifying a process, a scheme for specifying a complexity of the process, a scheme for specifying a target performance for each option according to the complexity of the process.

2 . The method of claim 1 , wherein the information on the UE capability includes adjusted device capability of the UE according to at least one of the environment parameter and the performance parameter.

3 . The method of claim 1 , wherein the information on the UE capability is transferred to the server in a provisioning phase or a streaming phase of a call flowchart.

4 . The method of claim 1 , wherein the information on the UE capability is transferred through an M8 interface between an application of the UE and an application service provider (ASP) in a provisioning phase for a standalone (STAR) augmented reality (AR)-based call flow.

5 . The method of claim 1 , wherein the information on the UE capability is transferred through an M5 interface or an M4 interface between an application of the UE and an application server (AS) in a provisioning phase for a STAR-based call flow.

6 . The method of claim 1 , wherein the information on the UE capability is transferred from a media session handler of the UE to a media application function (AF) of the server in a provisioning phase for a streaming architecture extension for edge processing (EMSA)-based client driven call flow.

7 . The method of claim 1 , wherein the information on the UE capability is transferred from a media session handler of the UE to a media application function (AF) of the server in a provisioning phase of a call flow for a streaming architecture extension for edge processing (EMSA)-based split rendering.

8 . The method of claim 1 , wherein the information on the UE capability is transferred to a media application server (AS) of the server through at least one of an augmented reality (AR) session, a mixed reality (MR) session, an interactive scene session, or an interactive media session in a streaming phase of a call flow.

9 . The method of claim 1 ,

wherein the process manifest includes at least one of decoding, encoding, rendering, encryption, decryption, compositing, displaying, pose sensing, pose correcting, feature extracting, feature matching, anchor mapping, object tracking, hand tracking, or eye tracking.

10 . The method of claim 1 , further comprising:

triggering consumption reporting based on parameters for a consumption reporting configuration being initialized while playing back media including the adjusted content;

transmitting updated consumption reporting parameters to the server; and

transmitting a consumption report based on the updated consumption reporting parameters to the server.

11 . A user equipment (UE) configured to provide capability-based split computing, the UE comprising:

a transceiver;

a hardware component; and

a hardware-processor operatively connected with the transceiver, wherein the hardware-processor is configured to:

measure a performance parameter of the UE based on an environment parameter for the UE;

determine an abnormal status of the UE based on the environment parameter and the performance parameter;

transmit, to a server, a message including information on UE capability related to the environment parameter and the performance parameter, wherein the UE capability is adjusted based on the determined abnormal status and the UE capability indicates UE requirements for the server;

receive, from the server, first information on adjusted content and second information on an adjusted process according to the UE capability information, wherein the second information includes a process manifest and the adjusted content meets the UE requirements; and

execute the adjusted process to receive the adjusted content,

wherein the environment parameter includes a temperature of the UE, a voltage of the UE, and an operation frequency of the UE,

wherein the performance parameter includes:

first latency information indicating a time taken by the UE from reception of rendered result to display,

second latency information indicating a time taken for the UE to decode one or more media, position the decoded one or more media on 3-dimension, and composite them, and

frame-drop information indicating a number of frames that are not finally rendered relative to a target frame per second (fps) of content,

wherein the adjusted process is determined, according to the performance degradation of the UE, as adjusting process complexity or deleting a process, and

wherein the process manifest is created according to at least one of a scheme for specifying a process, a scheme for specifying a complexity of the process, a scheme for specifying a target performance for each option according to the complexity of the process.

12 . The UE of claim 11 , wherein the information on the UE capability includes adjusted device capability of the UE according to at least one of the environment parameter and the performance parameter.

13 . The UE of claim 11 , wherein the information on the UE capability is transferred to the server in a provisioning phase or a streaming phase of a call flowchart.

14 . The UE of claim 11 , wherein the information on the UE capability is transferred through an M8 interface between an application of the UE and an application service provider (ASP) in a provisioning phase for a standalone (STAR) augmented reality (AR)-based call flow.

15 . The UE of claim 11 , wherein the information on the UE capability is transferred through an M5 interface or an M4 interface between an application of the UE and an application server (AS) in a provisioning phase for a STAR-based call flow.

16 . He UE of claim 11 , wherein the information on the UE capability is transferred from a media session handler of the UE to a media application function (AF) of the server in a provisioning phase for a streaming architecture extension for edge processing (EMSA)-based client driven call flow.

17 . The UE of claim 11 , wherein the information on the UE capability is transferred from a media session handler of the UE to a media application function (AF) of the server in a provisioning phase of a call flow for a streaming architecture extension for edge processing (EMSA)-based split rendering.

18 . The UE of claim 11 , wherein the information on the UE capability is transferred to a media application server (AS) of the server through at least one of an augmented reality (AR) session, a mixed reality (MR) session, an interactive scene session, or an interactive media session in a streaming phase of a call flow.

19 . The UE of claim 11 ,

wherein the process manifest includes at least one of decoding, encoding, rendering, encryption, decryption, compositing, displaying, pose sensing, pose correcting, feature extracting, feature matching, anchor mapping, object tracking, hand tracking, or eye tracking.

20 . The UE of claim 11 , wherein the hardware-processor is further configured to:

trigger consumption reporting based on parameters for a consumption reporting configuration being initialized while playing back media including the adjusted content;

transmit updated consumption reporting parameters to the server; and

transmit a consumption report based on the updated consumption reporting parameters to the server.