IP Library Granted Patent US 11,516,485
Granted Patent B2
US 11,516,485 · App. 17/323,139 · Granted Nov 29, 2022

Power aware video decoding and streaming

Inventors: Yuwen He (San Diego, CA); Yan Ye (San Diego, CA); Yong He (San Diego, CA); George W. McClellan (Bensalem, PA); Eun Seok Ryu (Gangnam-gu, KR)
Assignee: VID SCALE, Inc.
H04N19/187G06F1/329G06F1/3212H04L65/612H04L65/613H04N19/117H04N19/127H04N19/136H04N19/156H04N19/44H04N21/23439H04N21/41407H04N21/4424H04N21/8456H04N21/85406Y02D10/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,516,485
App. No.
17/323,139
Granted
Nov 29, 2022
Kind
B2
Abstract

Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.

Claims (46)

1. A wireless transmit/receive unit (WTRU) for requesting a video stream from a video server, the WTRU comprising:

a memory; and

a processor configured to:

receive a metadata for the video stream, the video stream comprising a first video segment and a second video segment, and the metadata indicating a video decoding power consumption information for one or more complexity levels associated with the first video segment;

determine a power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information;

determine, based on the power reduction ratio, a complexity level from the one or more complexity levels; and

request the first video segment at the complexity level.

2. The WTRU of claim 1 , wherein the processor is further configured to determine the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the complexity level.

3. The WTRU of claim 1 , wherein the complexity level is a first complexity level, and wherein the processor is further configured to determine a second complexity level from one or more complexity levels associated with the second video segment.

4. The WTRU of claim 3 , wherein the processor is further configured to determine the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the first complexity level and the second complexity level.

5. The WTRU of claim 1 , wherein the video decoding power consumption information for the one or more complexity levels associated with the first video segment further indicates relative amounts of energy that would be used to decode the first video segment at each of the one or more complexity levels.

6. The WTRU of claim 1 , wherein the processor is further configured to:

determine an amount of energy remaining in the WTRU; and

determine, based on the amount of energy remaining in the WTRU, a power available for decoding the first video segment.

7. The WTRU of claim 6 , wherein the processor is further configured to:

determine the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio such that decoding the first video segment results in using approximately the amount of energy available for decoding the first video segment.

8. A method for a wireless transmit/receive unit (WTRU) for requesting a video stream from a video server, the method comprising:

receiving a metadata for the video stream, the video stream comprising a first video segment and a second video segment, and the metadata indicating a video decoding power consumption information for one or more complexity levels associated with the first video segment;

determining a power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information;

determining, based on the power reduction ratio, a complexity level from the one or more complexity levels; and

requesting the first video segment at the complexity level.

9. The method of claim 8 , wherein the method further comprises determining the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the complexity level.

10. The method of claim 8 , wherein the complexity level is a first complexity level, and wherein the method further comprises determining a second complexity level from one or more complexity levels associated with the second video segment.

11. The method of claim 10 , wherein the method further comprises determining the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the first complexity level and the second complexity level.

12. The method of claim 8 , wherein the video decoding power consumption information for the one or more complexity levels associated with the first video segment further indicates relative amounts of energy that would be used to decode the first video segment at each of the one or more complexity levels.

13. The method of claim 8 , wherein the method further comprises:

determining an amount of energy remaining in the WTRU; and

determining, based on the amount of energy remaining in the WTRU, a power available for decoding the first video segment.

14. The method of claim 13 , wherein method further comprises determining the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio such that decoding the first video segment results in using approximately the amount of energy available for decoding the first video segment.

15. A video server, comprising:

a processor, and

a memory, wherein the video server is configured to:

send, to a video streaming device, metadata for a video stream, the video stream comprising a first video segment and a second video segment, and the metadata indicating a video decoding power consumption information for one or more complexity levels associated with the first video segment and the second video segment;

receive, from the video streaming device, a first request for the first video segment at a first complexity level;

receive, from the video streaming device, a second request for the second video segment at a second complexity level; and

send, to the video streaming device, the first video segment at the first complexity level and the second video segment at the second complexity level.

16. The video server of claim 15 , wherein the processor is further configured to:

receive power information associated with the video streaming device, wherein the power information associated with the video streaming device indicates one or more of a power level, a power usage, a battery level, or an amount of energy allocated for decoding at least a portion of the video stream; and

encode one or more of the first video segment or the second video segment into the video stream based on the power information.

17. The video server of claim 15 , wherein the video decoding power consumption information further indicates a relative amount of energy that would be used to decode the first video segment at the first complexity level.

18. The video server of claim 15 , wherein the processor is further configured to:

encode the first video segment at the first complexity level; and

encode the second video segment at the second complexity level.

19. The video server of claim 15 , wherein the processor is further configured to:

receive a message from the video streaming device, the message indicating an amount of energy the video streaming device used to decode the first video segment at the first complexity level.

20. The video server of claim 15 , wherein the processor is further configured to generate the metadata for the video stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
Continuity (5)
Continuation 16698512 · Nov 27, 2019
Continuation 16196227 · Nov 20, 2018
Continuation 13937678 · Jul 9, 2013
Provisional Application 61669581 · Jul 9, 2012
Related Publication 20210274199A1 · Sep 2, 2021