IP Library Granted Patent US 11,490,150
Granted Patent B2
US 11,490,150 · App. 17/393,436 · Granted Nov 1, 2022

System and method for delivering media based on viewer behavior

Inventors: Jian Yu (Ashburn, VA); David Chen (Ashburn, VA); Vipul Patel (Great Falls, VA); Kenneth Gould (Reston, VA)
Assignee: TIME WARNER CABLE ENTERPRISES LLC
H04N21/2668H04N21/44218H04N21/44224H04N21/2402
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,490,150
App. No.
17/393,436
Granted
Nov 1, 2022
Kind
B2
Abstract

Methods, systems and devices are provided for communicating multimedia content over a service provider network. A network server may receive an audio-video stream from a content provider server, relaying the audio-video stream to a receiver device via the service provider network, receive an operating mode notification identifying a user behavior from the receiver device, and ceasing the relaying of the audio-video stream to the receiver device based on the user behavior. The network server may also alter the audio-video stream based on the received operating mode notification and send the altered audio-video stream to the receiver device via the service provider network.

Claims (82)

1. A method of communicating multimedia content over a service provider network, the method comprising:

receiving, by a receiver device processor in a receiver device, an audio-video stream from a network server;

commencing presentation, by the receiver device processor, at least one of audio content or video content;

monitoring, by the receiver device processor, user behaviors during the presentation of the least one of audio content or video content to detect changes in user actions or behaviors;

determining, by the receiver device processor, an operating mode based on the detected user behaviors;

generating and sending, by the receiver device processor, an operating mode notification message to the network server;

receiving, by the receiver device processor, an altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested; and

rendering, by the receiver device processor, content based on the content included in the altered stream.

2. The method of claim 1 , further comprising modifying resource usage on the receiver device in response to generating and sending the operating mode notification message to the network server.

3. The method of claim 2 , wherein modifying resource usage on the receiver device comprises de-energizing a video processor of the receiver device or powering off an electronic display of the receiver device.

4. The method of claim 1 , wherein receiving the altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested comprises receiving an audio-only stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested.

5. The method of claim 1 , wherein receiving the altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested comprises receiving a closed-caption-only data stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested.

6. The method of claim 1 , wherein:

monitoring the user behaviors during the presentation of the least one of audio content or video content to detect the changes in user actions or behaviors comprises monitoring the user behaviors during the presentation of the least one of audio content or video content to determine whether a user of the receiver device is actively viewing the presented content; and

determining the operating mode based on the detected user behaviors comprises determining the operating mode in response to detecting that the user is no longer activity viewing the presented content.

7. The method of claim 6 , wherein monitoring the user behaviors during the presentation of the least one of audio content or video content to determine whether the user is actively viewing the content comprises:

activating a camera of the receiver device to determine whether the user's eyes are visibly open;

activating an eye tracking component of the receiver device to determine whether the user's eye movements are consistent with active viewing of the presented content;

activating a motion sensor to determine whether the user is in close proximity to the receiver device; or

activating orientation sensors to determine whether the receiver device is face down.

8. The method of claim 6 , wherein monitoring the user behaviors during the presentation of the least one of audio content or video content to determine whether the user is actively viewing the content comprises monitoring a sensor in the receiver device that detects one or more of:

a motion;

a gesture;

an orientation;

an eye movement;

a presence of the user's eye; or

a location of the user's eye relative to the receiver device.

9. A receiver device, comprising:

a receiver device processor configured with processor-executable software instructions to:

receive an audio-video stream from a network server;

commence presenting at least one of audio content or video content;

monitor user behaviors during the presentation of the least one of audio content or video content to detect changes in user actions or behaviors;

determine an operating mode based on the detected user behaviors;

generate and send an operating mode notification message to the network server;

receive an altered stream from the network server in response to the network server receiving the operating mode notification message and determining that a service provider network is congested; and

render content based on the content included in the altered stream.

10. The receiver device of claim 9 , wherein the receiver device processor is further configured to modify resource usage on the receiver device in response to generating and sending the operating mode notification message to the network server.

11. The receiver device of claim 10 , wherein the receiver device processor is configured to modify resource usage on the receiver device by de-energizing a video processor of the receiver device or powering off an electronic display of the receiver device.

12. The receiver device of claim 9 , wherein the receiver device processor is configured to receive the altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested by receiving an audio-only stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested.

13. The receiver device of claim 9 , wherein the receiver device processor is configured to receive the altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested by receiving a closed-caption-only data stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested.

14. The receiver device of claim 9 , wherein the receiver device processor is configured to:

monitor the user behaviors during the presentation of the least one of audio content or video content to detect the changes in user actions or behaviors by monitoring the user behaviors during the presentation of the least one of audio content or video content to determine whether a user of the receiver device is actively viewing the presented content; and

determine the operating mode based on the detected user behaviors by determining the operating mode in response to detecting that the user is no longer activity viewing the presented content.

15. The receiver device of claim 14 , wherein the receiver device processor is configured to monitor the user behaviors during the presentation of the least one of audio content or video content to determine whether the user is actively viewing the content by:

activating a camera of the receiver device to determine whether the user's eyes are visibly open;

activating an eye tracking component of the receiver device to determine whether the user's eye movements are consistent with active viewing of the presented content;

activating a motion sensor to determine whether the user is in close proximity to the receiver device; or

activating orientation sensors to determine whether the receiver device is face down.

16. The receiver device of claim 14 , wherein the receiver device processor is configured to monitor the user behaviors during the presentation of the least one of audio content or video content to determine whether the user is actively viewing the content by monitoring a sensor in the receiver device that detects one or more of:

a motion;

a gesture;

an orientation;

an eye movement;

a presence of the user's eye; or

a location of the user's eye relative to the receiver device.

17. A non-transitory computer readable storage medium having stored thereon processor-executable software instructions configured to cause a receiver device processor in a receiver device to perform operations for communicating multimedia content over a service provider network, the operations comprising:

receiving an audio-video stream from a network server;

commencing presentation at least one of audio content or video content;

monitoring user behaviors during the presentation of the least one of audio content or video content to detect changes in user actions or behaviors;

determining an operating mode based on the detected user behaviors;

generating and sending an operating mode notification message to the network server;

receiving an altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested; and

rendering content based on the content included in the altered stream.

18. The non-transitory computer readable storage medium of claim 17 , wherein the stored processor-executable software instructions configured to cause the receiver device processor to perform operations further comprising modifying resource usage on the receiver device in response to generating and sending the operating mode notification message to the network server.

19. The non-transitory computer readable storage medium of claim 18 , wherein the stored processor-executable software instructions configured to cause the receiver device processor to perform operations such that modifying resource usage on the receiver device comprises de-energizing a video processor of the receiver device or powering off an electronic display of the receiver device.

20. The non-transitory computer readable storage medium of claim 17 , wherein the stored processor-executable software instructions configured to cause the receiver device processor to perform operations such that receiving the altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested comprises receiving an audio-only stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested.

21. The non-transitory computer readable storage medium of claim 17 , wherein the stored processor-executable software instructions configured to cause the receiver device processor to perform operations such that receiving the altered stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested comprises receiving a closed-caption-only data stream from the network server in response to the network server receiving the operating mode notification message and determining that the service provider network is congested.

22. The non-transitory computer readable storage medium of claim 17 , wherein the stored processor-executable software instructions configured to cause the receiver device processor to perform operations such that:

monitoring the user behaviors during the presentation of the least one of audio content or video content to detect the changes in user actions or behaviors comprises monitoring the user behaviors during the presentation of the least one of audio content or video content to determine whether a user of the receiver device is actively viewing the presented content; and

determining the operating mode based on the detected user behaviors comprises determining the operating mode in response to detecting that the user is no longer activity viewing the presented content.

23. The non-transitory computer readable storage medium of claim 22 , wherein the stored processor-executable software instructions configured to cause the receiver device processor to perform operations such that monitoring the user behaviors during the presentation of the least one of audio content or video content to determine whether the user is actively viewing the content comprises:

activating a camera of the receiver device to determine whether the user's eyes are visibly open;

activating an eye tracking component of the receiver device to determine whether the user's eye movements are consistent with active viewing of the presented content;

activating a motion sensor to determine whether the user is in close proximity to the receiver device; or

activating orientation sensors to determine whether the receiver device is face down.

24. The non-transitory computer readable storage medium of claim 22 , wherein the stored processor-executable software instructions configured to cause the receiver device processor to perform operations such that monitoring the user behaviors during the presentation of the least one of audio content or video content to determine whether the user is actively viewing the content comprises monitoring a sensor in the receiver device that detects one or more of:

a motion;

a gesture;

an orientation;

an eye movement;

a presence of the user's eye; or

a location of the user's eye relative to the receiver device.

Assignments (5)
SECURITY INTEREST Recorded Sep 22, 2022
From: CHARTER COMMUNICATIONS OPERATING, LLC; TIME WARNER CABLE ENTERPRISES, LLC
To: WELLS FARGO TRUST COMPANY, N.A.
Reel/Frame 061503/0937 →
SECURITY INTEREST Recorded Sep 22, 2022
From: CHARTER COMMUNICATIONS OPERATING, LLC; TIME WARNER CABLE ENTERPRISES, LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 061504/0307 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Aug 10, 2022
From: CHARTER COMMUNICATIONS OPERATING, LLC; TIME WARNER CABLE ENTERPRISES LLC
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 061633/0069 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2021
From: YU, JIAN; CHEN, DAVID; PATEL, VIPUL; GOULD, KENNETH
To: TIME WARNER CABLE ENTERPRISES, LLC
Reel/Frame 057073/0460 →
CHANGE OF APPLICANT'S ADDRESS Recorded Aug 4, 2021
From: TIME WARNER CABLE ENTERPRISES LLC
To: TIME WARNER CABLE ENTERPRISES LLC
Reel/Frame 057073/0490 →
Continuity (5)
Continuation 16690488 · Nov 21, 2019
Continuation 16206774 · Nov 30, 2018
Continuation 15682832 · Aug 22, 2017
Continuation 13671956 · Nov 8, 2012
Related Publication 20210368224A1 · Nov 25, 2021