IP Library Granted Patent US 10,104,407
Granted Patent B2
US 10,104,407 · App. 15/292,466 · Granted Oct 16, 2018

Method and device for network-assisted client-centric QoE optimization

Inventors: Zheng Lu (Milpitas, CA); Sangeeta Ramakrishnan (Saratoga, CA); Xiaoqing Zhu (Austin, TX)
Assignee: CISCO TECHNOLOGY, INC.
H04N21/2387H04L67/303H04N21/25808H04N21/25891H04N21/44H04N21/44209H04N21/4532H04N21/47217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,104,407
App. No.
15/292,466
Granted
Oct 16, 2018
Kind
B2
Abstract

In one implementation, a method performed by a client device includes: determining a perceptual characterization metric, where the perceptual characterization metric provides a quantitative characterization of factors that determine quality of experience associated with a first playback profile of media content presented by the client device; and normalizing the perceptual characterization metric based on characterization factors associated with the client device. The method further includes: obtaining an aggregate perceptual characterization metric that is based at least in part on the normalized perceptual characterization metric from the client device and one or more other perceptual characterization metrics from other client devices sharing at least one network resource with the client device; and determining whether to change the first playback profile based on a function of the first normalized perceptual characterization metric and the aggregate perceptual characterization metric.

Claims (52)

1. A method comprising:

at a client device with one or more processors and non-transitory memory:

determining, by the client device, a first perceptual characterization metric, wherein the first perceptual characterization metric provides a corresponding quantitative characterization of factors that determine quality of experience associated with a first playback profile of media content presented by the client device, and wherein the first perceptual characterization metric is a function of a first set of perceptual characterization indicator values that include perception metrics characterizing performance associated with at least one of a plurality of performance criteria;

normalizing, by the client device, the first perceptual characterization metric based on one or more client device characterization factors associated with the client device;

obtaining, by the client device, an aggregate perceptual characterization metric, wherein the aggregate perceptual characterization metric is based at least in part on the normalized perceptual characterization metric from the client device and one or more other perceptual characterization metrics from one or more other client devices sharing at least one network resource with the client device; and

determining, by the client device, whether to change the first playback profile based on a function of the first normalized perceptual characterization metric and the aggregate perceptual characterization metric.

2. The method of claim 1 , further comprising:

determining, by the client device, whether the normalized perceptual characterization metric exceeds the aggregate perceptual characterization metric;

selecting, by the client device, a second playback profile according to the determination that the normalized perceptual characterization metric exceeds the aggregate perceptual characterization metric, wherein the second playback profile is associated with a lower media presentation quality than the first playback profile; and

transmitting, by the client device, a request to a content server for a segment of the media content based on the second playback profile.

3. The method of claim 1 , further comprising:

determining, by the client device, whether the aggregate perceptual characterization metric exceeds the normalized perceptual characterization metric;

selecting, by the client device, a third playback profile according to the determination that aggregate perceptual characterization metric exceeds the normalized perceptual characterization metric, wherein the third playback profile is associated with a higher media presentation quality than the first playback profile; and

transmitting, by the client device, a request to a content server for a segment of the media content based on the third playback profile.

4. The method of claim 1 , further comprising:

determining, by the client device, whether the normalized perceptual characterization metric is within a threshold tolerance of the aggregate perceptual characterization metric;

maintaining, by the client device, the first playback profile according to the determination that the first normalized perceptual characterization metric is within the threshold tolerance of the aggregate perceptual characterization metric; and

transmitting, by the client device, a request to a content server for a segment of the media content based on the first playback profile.

5. The method of claim 1 , wherein the factors that characterize quality of experience include at least one of a peak-signal-to-noise ratio, a mean opinion score, a video quality metric, an encoding rate, and subscription tier data.

6. The method of claim 1 , wherein the performance criteria include playback preference level, playback capability, degradation tolerance, one or more degradation policies, a buffer level criterion, and a resource utilization criterion.

7. The method of claim 1 , wherein the one or more client device characterization factors associated with the client device correspond to at least one of a connectivity status of the client device, a power level of the client device, a hardware profile associated with the client device, or a service tier associated with the client device.

8. The method of claim 1 , wherein the network resource corresponds to at least one of a memory resource, a computational resource, or a bandwidth resource shared between the client device and the one or more other client devices.

9. The method of claim 1 , further comprising providing, by the client device, the normalized first perceptual characterization metric to a monitor device, wherein the aggregate perceptual characterization metric is obtained from the monitor device.

10. A client device comprising:

one or more processors;

a non-transitory memory; and

one or more programs stored in the non-transitory, which, when executed by the one or more processors, cause the client device to:

determine, by the client device, a first perceptual characterization metric, wherein the first perceptual characterization metric provides a corresponding quantitative characterization of factors that determine quality of experience associated with a first playback profile of media content presented by the client device, and wherein the first perceptual characterization metric is a function of a first set of perceptual characterization indicator values that include perception metrics characterizing relative performance associated with at least one of a plurality of performance criteria;

normalize, by the client device, the first perceptual characterization metric based on one or more client device characterization factors associated with the client device;

obtain, by the client device, an aggregate perceptual characterization metric, wherein the aggregate perceptual characterization metric is based at least in part on the normalized perceptual characterization metric from the client device and one or more other perceptual characterization metrics from one or more other client devices sharing at least one network resource with the client device; and

determine, by the client device, whether to change the first playback profile based on a function of the first normalized perceptual characterization metric and the aggregate perceptual characterization metric.

11. The client device of claim 10 , wherein the one or more programs further cause the client device to:

determine, by the client device, whether the normalized perceptual characterization metric exceeds the aggregate perceptual characterization metric;

select, by the client device, a second playback profile according to the determination that the normalized perceptual characterization metric exceeds the aggregate perceptual characterization metric, wherein the second playback profile is associated with a lower media presentation quality than the first playback profile; and

transmit, by the client device, a request to a content server for a segment of the media content based on the second playback profile.

12. The client device of claim 10 , wherein the one or more programs further cause the client device to:

determine, by the client device, whether the aggregate perceptual characterization metric exceeds the normalized perceptual characterization metric;

select, by the client device, a third playback profile according to the determination that aggregate perceptual characterization metric exceeds the normalized perceptual characterization metric, wherein the third playback profile is associated with a higher media presentation quality than the first playback profile; and

transmit, by the client device, a request to a content server for a segment of the media content based on the third playback profile.

13. The client device of claim 10 , wherein the one or more programs further cause the client device to:

determine, by the client device, whether the normalized perceptual characterization metric is within a threshold tolerance of the aggregate perceptual characterization metric;

maintain, by the client device, the first playback profile according to the determination that the first normalized perceptual characterization metric is within the threshold tolerance of the aggregate perceptual characterization metric; and

transmit, by the client device, a request to a content server for a segment of the media content based on the first playback profile.

14. The client device of claim 10 , wherein the factors that characterize quality of experience include at least one of a peak-signal-to-noise ratio, a mean opinion score, a video quality metric, an encoding rate, and subscription tier data.

15. The client device of claim 10 , wherein the performance criteria include playback preference level, playback capability, degradation tolerance, one or more degradation policies, a buffer level criterion, and a resource utilization criterion.

16. The client device of claim 10 , wherein the one or more client device characterization factors associated with the client device correspond to at least one of a connectivity status of the client device, a power level of the client device, a hardware profile associated with the client device, or a service tier associated with the client device.

17. A non-transitory memory storing one or more programs, the one or more programs comprising instructions, which, when executed by one or more processors of a client device, cause the client device to:

determine, by the client device, a first perceptual characterization metric, wherein the first perceptual characterization metric provides a corresponding quantitative characterization of factors that determine quality of experience associated with a first playback profile of media content presented by the client device, and wherein the first perceptual characterization metric is a function of a first set of perceptual characterization indicator values that include perception metrics characterizing relative performance associated with at least one of a plurality of performance criteria;

normalize, by the client device, the first perceptual characterization metric based on one or more client device characterization factors associated with the client device;

obtain, by the client device, an aggregate perceptual characterization metric, wherein the aggregate perceptual characterization metric is based at least in part on the normalized perceptual characterization metric from the client device and one or more other perceptual characterization metrics from one or more other client devices sharing at least one network resource with the client device; and

determine, by the client device, whether to change the first playback profile based on a function of the first normalized perceptual characterization metric and the aggregate perceptual characterization metric.

18. The non-transitory memory of claim 17 , wherein the one or more client device characterization factors associated with the client device correspond to at least one of a connectivity status of the client device, a power level of the client device, a hardware profile associated with the client device, or a service tier associated with the client device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2016
From: LU, ZHENG; RAMAKRISHNAN, SANGEETA; ZHU, XIAOQING
To: CISCO TECHNOLOGY, INC.
Reel/Frame 040350/0178 →
Continuity (1)
Related Publication 20180109819A1 · Apr 19, 2018