IP Library Granted Patent US 10,791,356
Granted Patent B2
US 10,791,356 · App. 15/736,934 · Granted Sep 29, 2020

Synchronisation of streamed content

Inventors: Philip Shaw (York, GB); Peter Heiland (Dover, MA); Sean Everett (New York, NY); Mark Christie (London, GB); Kristan Bullett (York, GB); Ralf Tilmann (Manheim, DE); Hans-Jurgen Maas (Mainz, DE)
Assignee: PIKSEL, INC.
H04N21/26233H04H60/46H04L65/607H04N21/2187H04N21/21805H04N21/232H04N21/235H04N21/2343H04N21/2353H04N21/2358H04N21/23106H04N21/23418H04N21/23439H04N21/234336H04N21/2402H04N21/242H04N21/2407H04N21/2541H04N21/25866H04N21/2665H04N21/2668H04N21/26208H04N21/26613H04N21/414H04N21/41407H04N21/4223H04N21/433H04N21/4305H04N21/4307H04N21/4331H04N21/4334H04N21/44029H04N21/4431H04N21/44204H04N21/440236H04N21/440263H04N21/4828H04N21/633H04N21/6332H04N21/8186H04N21/8358H04N21/84H04N21/8547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,791,356
App. No.
15/736,934
Granted
Sep 29, 2020
Kind
B2
Abstract

There is described a system for providing streaming services, comprising: a plurality of capture devices each for generating a stream of an event, each stream being associated with a timing reference; and a server for analysing the plurality of captured streams in order to align the received plurality of received captured streams according.

Claims (42)

1. A system for providing streaming services, comprising:

a plurality of capture devices, each for generating at least one stream of an event, each of the streams having a timestamp; and

a server for analysing the plurality of generated streams and configured to:

receive each of the streams having the timestamp from the plurality of capture devices;

align each of the plurality of generated streams in time based on the time stamp of each stream;

determine a section of each of the plurality of aligned streams, each section corresponding in time with respect to a timing reference, each section being of the same time duration, wherein for a given time period relative to the timing reference there is provided a single such section of each of the plurality of streams;

recover a fingerprint from each section of each of the plurality of aligned streams, wherein the sections are each for a common time period relative to the timing period and have the same time duration;

wherein the processor is further configured, for each successive section of the same time duration, to:

identify a subset of the plurality of the streams having matching fingerprints within the sections having the same time duration and at the common time period relative to the timing reference; and

group the identified subset of the plurality of the streams having matching fingerprints for the time duration of the common time period, wherein an independent grouping determination is made for different sections.

2. The system of claim 1 wherein the server is for processing the captured streams and generating at least one viewing stream, the system further comprising:

at least one viewing device for receiving the at least one viewing stream.

3. The system of claim 1 wherein each capture device calculates an offset of its internal clock from a shared external clock to create an internal representation of time based on the shared external clock.

4. The system of claim 3 wherein a sampling of each capture device is timed to coincide with boundaries of its internal representation of time based on the shared external clock.

5. The system of claim 1 wherein one of a selection of the plurality of captured streams and segments of the plurality of captured streams from different capture devices associated with the same event are synchronised by the server.

6. The system of claim 1 wherein a sound signature is derived as the timing reference in each captured stream from each of the capture devices.

7. The system of claim 1 wherein a visual signature is derived as the timing reference in each captured stream from each of the capture devices.

8. The system of claim 1 wherein at least one of the capture devices generates two streams of one event, one of the two streams having a higher quality than the other of the two streams, wherein the two streams are each associated with a timing reference, and wherein a relative position of one of the two streams is aligned with a relative position of the other of the two streams at the server based on a derivation of respective timing marks at the server.

9. The system of claim 1 wherein the timing references each provide a time line for the captured streams, and wherein the server analysis aligns the time line for each of the captured streams, so that each of the captured streams is aligned.

10. A method for providing streaming services, comprising:

generating at least one stream of an event from each of a plurality of capture devices, each of the streams having a timestamp;

receiving, at a server, each of the streams having the timestamp from the plurality of capture devices;

aligning, at the server, each of the plurality of generated streams in time based on the timestamp of each stream;

determining a section of each of the plurality of aligned streams, each section corresponding in time with respect to a timing reference and being of the same time duration, wherein for a given time period relative to the timing reference there is provided a single such section of each of the plurality of streams;

recovering a fingerprint from each of the section of each of the plurality of aligned streams, which section of each stream is for a common time period relative to the timing period of the same time duration;

identifying, for each successive section of the same time duration, a subset of the plurality of the streams having matching fingerprints in sections of the same time duration at the common time period relative to the timing reference; and

grouping, for each successive section of the same time duration, the identified subset of the plurality of the streams having matching fingerprints in the sections for the time duration of the common time period, wherein an independent grouping determination is made for each successive section.

11. The method of claim 10 further comprising:

processing the captured streams and generating at least one viewing stream; and

receiving at least one viewing stream at one or more viewing devices.

12. The method of claim 10 further comprising:

calculating at each capture device an offset of its internal clock from a shared external clock to create an internal representation of time based on the shared external clock.

13. The method of claim 12 wherein a sampling of each capture device is timed to coincide with boundaries of its internal representation of time.

14. The method of claim 10 wherein one of a selection of the plurality of captured streams and segments of the plurality of captured streams from different capture devices associated with the same event are synchronised by the server.

15. The method of claim 10 wherein a sound signature is derived as a timing reference in each captured stream from each of the capture devices.

16. The method of claim 10 wherein a visual signature is derived as a timing reference in each captured stream from each of the capture devices.

17. The method of claim 12 further comprising:

generating at at least one of the capture devices two streams of one event, one of the two streams having a higher quality than the other of the two streams, wherein the two streams are each associated with a timing reference, the server being configured to align a position of one of the two streams with respect to a position of the other of the two streams.

18. The method of claim 10 further comprising:

providing a time line for the captured streams with the timing references, and analysing the time line for each of the captured streams to align each of the captured streams.

19. The system of claim 1 wherein the association of the streams identifies a subset of the capture devices situated in the same environment such that the fingerprint is used to associate the subset of capture devices.

20. The method of claim 10 wherein the association of the streams identifies a subset of the capture devices situated in the same environment such that the fingerprint is used to associate the subset of capture devices.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2022
From: PIKSEL, INC.
To: PRJ HOLDING COMPANY, LLC
Reel/Frame 060703/0956 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2018
From: SHAW, PHILIP; HEILAND, PETER; EVERETT, SEAN; CHRISTIE, MARK; BULLETT, KRISTAN; TILLMANN, RALF; MAAS, HANS-JURGEN
To: PIKSEL, INC.
Reel/Frame 045937/0469 →