Energy-aware multimedia adaptation for streaming and conversational services
Technology to provide is disclosed. In an example, a user equipment (UE) can include computer circuitry configured to: receive a manifest file for an HTTP adaptive stream from a node; identify an energy characterization in the manifest file for a plurality of representations for a selected period; select a representation for the selected period having a desired energy characterization; and request segments from the node that are in the representation having the desired energy characterization.
1. A mobile device operable to provide hyper-text transfer protocol (HTTP) adaptive streaming, having computer circuitry hardware configured to:
receive a manifest file for an HTTP adaptive stream from a node;
identify an energy characterization in the manifest file for each of a plurality of representations for a selected period, wherein the energy characterization is a determination of an amount of energy or power used by the mobile device to decode and display the HTTP adaptive stream of a representation of the plurality of representations for the selected period and includes at least a first attribute defining a minimum energy value for each of the plurality of representations for the selected period and a second attribute defining a maximum energy level for each of the plurality of representations for the selected period;
select a representation for the selected period having a desired energy characterization; and
request segments from the node that are in the representation having the desired energy characterization.
2. The computer circuitry hardware of claim 1 wherein the computer circuitry is further configured to:
determine a power budget of the mobile device to decode and perform the HTTP adaptive stream; and
select the representation for the selected period having the desired energy characterization for the power budget.
3. The computer circuitry of claim 1 wherein the energy characterization for the HTTP adaptive stream is included in:
a media presentation description for a dynamic adaptive streaming over HTTP (DASH) adaptation set; or
metadata embedded in a 3GP file format.
4. The computer circuitry hardware of claim 1 , wherein the computer circuitry is further configured to communicate, to a content server, via the node, an energy characterization for power consumed during reception, decoding, or rendering of the HTTP adaptive stream.
5. The computer circuitry hardware of claim 4 , wherein the mobile device receives a representation having a different energy characterization from the content server, based on the energy characterization reported to the content server.
6. The computer circuitry hardware of claim 1 , wherein the computer circuitry is further configured to:
identify an energy characterization in the manifest file for a plurality of sub-representations for the selected period; and
request sub-segments from the node that are in at least one of the sub-representations and have a desired energy characterization.
7. The computer circuitry hardware of claim 1 , wherein the computer circuitry is further configured to switch to a different representation having a different energy characterization at a selected access point in the HTTP adaptive stream to change an amount of power consumed by the mobile device to decode and perform the HTTP adaptive stream.
8. The computer circuitry hardware of claim 1 , wherein the media device is in communication with a metadata management server configured to communicate the energy characterization information.
9. A media server operable to provide hyper-text transfer protocol (HTTP) adaptive streaming, having computer circuitry hardware configured to:
communicate energy characterization metadata to a mobile device over a byte range for a plurality of representations of an HTTP adaptive stream, wherein the energy characterization is a determination of an amount of energy or power used by the mobile device to decode and display the HTTP adaptive stream of a representation of the plurality of representations for the selected period and includes at least a first attribute defining a minimum energy value for each of the plurality of representations for the selected period and a second attribute defining a maximum energy level for each of the plurality of representations for the selected period;
receive a request for segments of the HTTP adaptive stream in the byte range in a representation selected from the plurality of representations, wherein the representation is selected based, at least in part, on the energy characterization metadata; and
communicate the requested segments in the byte range to the mobile device.
10. The computer circuitry hardware of claim 9 , wherein the computer circuitry is further configured to determine the energy characterization metadata over the byte range based on content-specific information comprising frame pixel histograms, a maximum frame-pixel value, a block coded type, or deblocking filtering numbers.
11. The computer circuitry hardware of claim 9 , wherein the computer circuitry is further configured to determine a minimum and a maximum power level for segments over the byte range.
12. The computer circuitry hardware of claim 9 , wherein the byte range is for a period, an adaptation set, a representation, a segment or a sub-segment.
13. The computer circuitry hardware of claim 9 , wherein the computer circuitry is further configured to provide a vectorized set of energy/power values to specify a minimum and a maximum energy level of each period, adaptation set, representation, segment or sub-segment in the energy characterization metadata.
14. The computer circuitry hardware of claim 9 , wherein the manifest file for the HTTP adaptive stream is:
a media presentation description for a dynamic adaptive streaming over HTTP (DASH) adaptation set; or
metadata embedded in a 3GP file format.
15. The computer circuitry hardware of claim 9 , wherein the computer circuitry is further configured to receive the request for segments of the HTTP adaptive stream in the byte range, wherein the segments are located in an adaptation set that includes the plurality of representations, and at least one representation includes a plurality of segments.
16. The computer circuitry hardware of claim 9 , wherein each representation contains a same media file over the byte range that is encoded differently than other representations, wherein the encoding includes a bit rate, a frame rate, a resolution, or a codec type.
17. The computer circuitry hardware of claim 9 , wherein the computer circuitry is further configured to:
receive a quality of experience (QoE) report from the mobile device that includes a power metric associated with power that is consumed at the mobile device during reception, decoding, or rendering of the HTTP adaptive stream; and
communicate a different representation to the mobile device based on the power metric received in the QoE report.
18. The computer circuitry hardware of claim 9 , wherein the computer circuitry is further configured to:
receive a request for segments of the HTTP adaptive stream in the byte range in a different representation selected from the plurality of representation, wherein the different representation is selected based, at least in part, on energy usage at the mobile device; and
communicate the requested segments in the byte range to the mobile device.