IP Library Granted Patent US 10,425,665
Granted Patent B2
US 10,425,665 · App. 15/336,665 · Granted Sep 24, 2019

System and method for early media buffering using detection of user behavior

Inventor: Andreas Öman (Stockholm, SE)
Assignee: SPOTIFY AB
H04N21/23406H04L47/722H04L65/60H04L67/22H04N21/2183H04N21/2393H04N21/2407H04N21/437H04N21/44218H04N21/44222H04N21/4667H04N21/47202H04N21/8545H04N2021/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,425,665
App. No.
15/336,665
Granted
Sep 24, 2019
Kind
B2
Abstract

A system and method for early media buffering using prediction of user behavior. In accordance with an embodiment, a client device user interface displays a plurality of media options, each of which is associated with a corresponding media content, for example a media channel or video stream, that can be received from a media server system for playing at the device, or at a controlled device. While the user interacts with the user interface, media content associated with regions of the interface can be buffered in preparation for selection and subsequent playing. The client device can include a user interaction sensor, for example a motion, hand/proximity, or heat sensor, which detects when a user is about to interact with the device. The media server system can be triggered to buffer media content associated with one or more neighboring media options on the user interface, in preparation for selection and playing.

Claims (47)

1. A system for early media buffering using prediction of user behavior, comprising:

a client device, including a processor;

an application user interface provided at the client device, which displays a plurality of media options as a visual array of media tiles, each of which media tiles is associated with a corresponding media stream that can be received from a media server system for playing at one or more of the client device, or a controlled device;

a user interaction sensor provided at the client device, which detects when a user is about to interact with the client device; and

a user prediction logic provided at the client device, which receives an indication from the user interaction sensor when the user is about to interact with the client device;

wherein the client device operates to

determine one or more neighboring media tiles within the visual array of media tiles as one or more media tiles having a likelihood to be selected next, and communicate with the media server system to enable the client device to buffer the corresponding media streams associated with a first set of media tiles within the visual array, including the one or more media tiles having a likelihood to be selected next, in preparation for selection and subsequent playing, and

in response to receiving an input indicative of panning the visual array of media tiles,

display one or more additional media options at the user interface as one or more additional media tiles,

determine one or more of the additional media tiles as having a likelihood to be selected next, and

communicate with the media server system to enable the client device to buffer the corresponding media streams associated with a second set of media tiles within the visual array, including at least one of the one or more additional media tiles having a likelihood to be selected next, in preparation for selection and subsequent playing.

2. The system of claim 1 , wherein each of the media tiles is associated with a corresponding media channel or video stream that can be selected and received from the media server system for playing at one or both of the client device and the controlled device.

3. The system of claim 1 , wherein the user interaction sensor is one or more of a motion, hand/proximity, or heat sensor, which detects when the user picks up the client device and provides the indication when the user is about to interact with the client device.

4. The system of claim 1 , wherein the controlled device includes an output display that displays media content, and wherein the client device operates as a remote control, and is adapted to receive a selection from the user of a selected media tile, for subsequent receipt from the media server system and playing at the output display of the controlled device.

5. The system of claim 4 , wherein the controlled device displays media channels or video streams on the output display as received from the media server system, and wherein selection from the user of a selected media tile is used as a media-change request to change a media channel at the controlled device.

6. A method for early media buffering using prediction of user behavior, comprising:

providing, at a client device, an application user interface which displays a plurality of media options as a visual array of media tiles, each of which media tiles is associated with a corresponding media stream that can be received from a media server system for playing at one or more of the client device, or a controlled device;

detecting, using a user interaction sensor provided at the client device, when a user is about to interact with the client device;

receiving an indication from the user interaction sensor when the user is about to interact with the client device;

determining one or more neighboring media tiles within the visual array of media tiles as one or more media tiles having a likelihood to be selected next, and communicating with the media server system to enable the client device to buffer the corresponding media streams associated with a first set of media tiles within the visual array, including the one or more media tiles having a likelihood to be selected next, in preparation for selection and subsequent playing; and

in response to receiving an input indicative of panning the visual array of media tiles

displaying one or more additional media options at the user interface as one or more additional media tiles,

determining one or more of the additional media tiles as having a likelihood to be selected next, and

communicating with the media server system to enable the client device to buffer the corresponding media streams associated with a second set of media tiles within the visual array, including at least one of the one or more additional media tiles having a likelihood to be selected next, in preparation for selection and subsequent playing.

7. The method of claim 6 , wherein each of the media tiles is associated with a corresponding media channel or video stream that can be selected and received from the media server system for playing at one or both of the client device and the controlled device.

8. The method of claim 6 , wherein the user interaction sensor is one or more of a motion, hand/proximity, or heat sensor, which detects when the user picks up the client device and provides the indication when the user is about to interact with the client device.

9. The method of claim 6 , wherein the controlled device includes an output display that displays media content, and wherein the client device operates as a remote control, and is adapted to receive a selection from the user of a selected media tile, for subsequent receipt from the media server system and playing at the output display of the controlled device.

10. The method of claim 9 , wherein the controlled device displays media channels or video streams on the output display as received from the media server system, and wherein selection from the user of a selected media tile is used as a media-change request to change a media channel at the controlled device.

11. A non-transitory computer readable storage medium, including instructions stored thereon which when read and executed by one or more computers cause the one or more computers to perform steps comprising:

providing, at a client device, an application user interface which displays a plurality of media options as a visual array of media tiles, each of which media tiles is associated with a corresponding media stream that can be received from a media server system for playing at one or more of the client device, or a controlled device;

detecting, using a user interaction sensor provided at the client device, when a user is about to interact with the client device; and

receiving an indication from the user interaction sensor when the user is about to interact with the client device;

determining one or more neighboring media tiles within the visual array of media tiles as one or more media tiles having a likelihood to be selected next, and communicating with the media server system to enable the client device to buffer the corresponding media streams associated with a first set of media tiles within the visual array, including the one or more media tiles having a likelihood to be selected next, in preparation for selection and subsequent playing; and

in response to receiving an input indicative of panning the visual array of media tiles,

displaying one or more additional media options at the user interface as one or more additional media tiles,

determining one or more of the additional media tiles as having a likelihood to be selected next, and

communicating with the media server system to enable the client device to buffer the corresponding media streams associated with a second set of media options within the visual array, including at least one of the one or more additional media tiles having a likelihood to be selected next, in preparation for selection and subsequent playing.

12. The non-transitory computer readable storage medium of claim 11 , wherein each of the media tiles is associated with a corresponding media channel or video stream that can be selected and received from the media server system for playing at one or both of the client device and the controlled device.

13. The non-transitory computer readable storage medium of claim 11 , wherein the user interaction sensor is one or more of a motion, hand/proximity, or heat sensor, which detects when the user picks up the client device and provides the indication when the user is about to interact with the client device.

14. The non-transitory computer readable storage medium of claim 11 , wherein the controlled device includes an output display that displays media content, and wherein the client device operates as a remote control, and is adapted to receive a selection from the user of a selected media tile, for subsequent receipt from the media server system and playing at the output display of the controlled device.

15. The non-transitory computer readable storage medium of claim 14 , wherein the controlled device displays media channels or video streams on the output display as received from the media server system, and wherein selection from the user of a selected media tile is used as a media-change request to change a media channel at the controlled device.

16. The system of claim 1 , wherein determining the one or more media tiles having a likelihood to be selected next includes predicting a direction of a subsequent swipe input.

17. The method of claim 6 , wherein determining the one or more media tiles having a likelihood to be selected next includes predicting a direction of a subsequent swipe input.

18. The non-transitory computer readable storage medium of claim 11 , wherein determining the one or more media tiles having a likelihood to be selected next includes predicting a direction of a subsequent swipe input.

19. The system of claim 1 , further comprising a buffering logic, which enables a portion of each media content item associated with one or more neighboring media tiles displayed to the left, right, above, or below a selected media tile as the one or more media tiles having a likelihood to be selected next, to be pre-buffered as determined by the user prediction logic.

20. The method of claim 6 , further comprising pre-buffering a portion of each media content item associated with one or more neighboring media tiles displayed to the left, right, above, or below a selected media tile as the one or more media tiles having a likelihood to be selected next.

21. The non-transitory computer readable storage medium of claim 11 , wherein the instructions further cause the one or more computers to pre-buffer a portion of each media content item associated with one or more neighboring media tiles displayed to the left, right, above, or below a selected media tile as the one or more media tiles having a likelihood to be selected next.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2019
From: OMAN, ANDREAS
To: SPOTIFY AB
Reel/Frame 049992/0823 →
Continuity (2)
Continuation 14485529 · Sep 12, 2014
Related Publication 20170048563A1 · Feb 16, 2017
Cited By (2)
US 12,316,906 US 12,713,093