IP Library Granted Patent US 9,654,539
Granted Patent B2
US 9,654,539 · App. 14/859,599 · Granted May 16, 2017

Multi-streaming multimedia data

Inventor: Barry P. Falvo (Eagleville, PA)
Assignee: Google Technology Holdings LLC
H04L65/608H04L65/4084H04L65/4092H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,654,539
App. No.
14/859,599
Granted
May 16, 2017
Kind
B2
Abstract

A method for multi-streaming multimedia content data over a network to affiliated client devices is provided. A manifest including a list of Universal Resource Indicators (URIs) for different segments of multimedia content data for selected primary multimedia content and a list of URIs for different segments of multimedia content data for at least one alternate multimedia content related to and different from the selected primary multimedia content is built and made available for download over the network with a transfer protocol. Synchronization of display of the selected primary multimedia content on a primary display and display of the at least one alternate content on the at least one auxiliary client device is thereby enabled. A system for streaming multimedia data over a network to affiliated client devices is also disclosed.

Claims (25)

1. A method comprising:

generating a manifest for primary multimedia content and alternate multimedia content related to and different from the primary multimedia content, the primary multimedia content comprising segments of multimedia content data and the alternate multimedia content comprising different segments of multimedia content data, the manifest including a list of identifiers for the segments and a list of identifiers for the different segments, the generating comprising modifying an initial manifest generated for the primary multimedia content by splicing the list of identifiers for the different segments into the initial manifest to produce a modified manifest for multi-streaming the primary multimedia content on a primary client device and the alternate multimedia content on an auxiliary client device affiliated with the primary client device; and

providing the manifest to the primary client device, and the auxiliary client device, the manifest comprising a marker for triggering the auxiliary client device to obtain and play the at least one alternate multimedia content in synchronization with the primary multimedia content.

2. The method of claim 1 , wherein providing the manifest to the primary client and the auxiliary client comprises making the manifest available for download over a network with a transfer protocol.

3. The method of claim 2 , wherein the transfer protocol is Hyper-Text Transfer Protocol (HTTP)-based streaming.

4. The method of claim 1 , wherein the auxiliary client device is one of a tablet, a personal computer, a laptop computer, a smartphone, an e-book reader, or a portable electronic device having an associated display screen, and a different marker is used for each different type of device.

5. The method of claim 1 , further comprising the step of transmitting the manifest to a subscriber site so that the alternate multimedia content is available to the auxiliary client device.

6. The method of claim 1 , further comprising the steps of authenticating the auxiliary client device and transmitting information of the marker to the auxiliary client device after the authenticating step.

7. A system comprising:

a processor;

a multi-stream playlist rebuilder executed by the processor and configured to generate a manifest for primary multimedia content and alternate multimedia content related to and different from the primary multimedia content, the primary multimedia content comprising segments of multimedia content data and the alternate multimedia content comprising different segments of multimedia content data, the manifest including a list of identifiers for the segments and a list of identifiers for the different segments the generating comprising modifying an initial manifest generated for the primary multimedia content by splicing the list of identifiers for the different segments into the initial manifest to produce a modified manifest for multi-streaming the primary multimedia content on a primary client device and the alternate multimedia content on an auxiliary client device affiliated with the primary client device in a synchronized manner; and

a session manager executed by the processor and configured to provide the manifest to the primary client device and the auxiliary client device affiliated with the primary client device, the manifest comprising a marker for triggering the auxiliary client device to obtain and play the at least one alternate multimedia content.

8. The system of claim 7 , wherein the alternate content coordination manager is further configured to receive program scheduling information from a program scheduling information unit.

9. The system of claim 8 , wherein the alternate content coordination manager is further configured to determine the alternate multimedia content from a plurality of alternate media content items based on the program scheduling information.

10. The system of claim 7 , wherein the manifest is transmitted over the network with Dynamic Adaptive Streaming over HTTP (MPEG DASH), and wherein the manifest is a Media Presentation Description (MPD), and wherein the list of identifiers for the segments of the multimedia content data for the selected primary multimedia presentation and the list of identifiers for the segments of the multimedia content data for the at least one alternate content are provided in separate adaptation sets within the MPD.

11. The system of claim 7 , wherein the session manager is further configured to authenticate the auxiliary client device and transmit the marker to the auxiliary client device occurs after the authenticating step.

12. The system of claim 7 , wherein the auxiliary client device is one of a set-top box, a tablet, a personal computer, a laptop computer, a smartphone, an e-book reader, and a portable electronic device having an associated display screen, and wherein a different marker is used for each different type of device.

13. The system of claim 7 , further comprising at least one server on which the manifest, the different segments of the multimedia content data for the selected primary multimedia presentation, and the different segments of the multimedia content data for the at least one alternate multimedia content is stored and made available to the affiliated client devices via a content distribution network.

14. A method comprising:

providing, by a content delivery system, primary content for presentation on a primary client device, the primary content comprising primary segments of multimedia content data;

receiving, at the content delivery system, a request for auxiliary content for synchronized presentation on an auxiliary client device, the auxiliary content related to the primary content and comprising one or more auxiliary segments of multimedia content data, each of the auxiliary segments associated with one of the primary segments;

generating, at the content delivery system, a multi-stream playlist including identifiers for the primary and auxiliary segments, the multi-stream playlist further including references between associated primary and auxiliary segments;

providing the manifest to the auxiliary client device;

receiving, from the auxiliary client device, a request for an auxiliary segment; and

providing the auxiliary segment to the auxiliary client device for synchronized presentation with the associated primary segment.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2016
From: FALVO, BARRY P.
To: GENERAL INSTRUMENT CORPORATION
Reel/Frame 039346/0076 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2016
From: GENERAL INSTRUMENT CORPORATION
To: GENERAL INSTRUMENT HOLDINGS, INC.
Reel/Frame 039579/0081 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2016
From: GENERAL INSTRUMENT HOLDINGS, INC.
To: MOTOROLA MOBILITY LLC
Reel/Frame 039579/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2016
From: MOTOROLA MOBILITY LLC
To: GOOGLE TECHNOLOGY HOLDINGS LLC
Reel/Frame 039581/0001 →
Continuity (2)
Continuation 13691124 · Nov 30, 2012
Related Publication 20160014183A1 · Jan 14, 2016