IP Library › Granted Patent US 12,250,421
Granted Patent B2
US 12,250,421 · App. 16/676,593 · Granted Mar 11, 2025

Device synchronization for audiovisual content

Inventors: Zachary Wagner (Philadelphia, PA); Tony Nguyen (Philadelphia, PA); Yong Ji (Springfield, PA); Alison Stiel (Philadelphia, PA)
Assignee: Comcast Cable Communications, LLC
H04N21/242H04N21/235H05B47/155
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,250,421
App. No.
16/676,593
Granted
Mar 11, 2025
Kind
B2
Abstract

Systems, apparatuses, and methods are described for synchronizing output of a plurality of user devices. An immersive experience for users may be provided by mapping what the users are watching into functionalities of the user devices. Manifest files may comprise information determined for audio and/or video features of segments of audiovisual content. The manifest files may be used by secondary user devices to output visual effects in synchronization with output of audiovisual content by a primary user device.

Claims (51)

1. A method comprising:

sending, by a first computing device to a second computing device, content segments associated with a content item;

receiving a request to synchronize output, of visual effects from one or more third computing devices, with output of the content item via the second computing device;

pausing, based on receiving the request, sending of an additional content segment associated with the content item to the second computing device;

receiving, by the first computing device, a manifest file associated with the additional content segment, wherein the additional content segment comprises an audio component and a video component, and wherein the manifest file comprises data, for controlling the output of the visual effects by the one or more third computing devices, comprising:

a time value associated with one or more frames of the video component of the additional content segment, wherein the time value indicates a time associated with a beat in the audio component, and

color values, corresponding to the time value, based on the one or more frames of the video component; and

sending, based on receiving the manifest file, the additional content segment to the second computing device and the manifest file to the one or more third computing devices.

2. The method of claim 1 , wherein the color values comprise values indicating average red, green, and blue color values associated with pixels of the one or more frames of the video component.

3. The method of claim 1 , further comprising:

modifying, based on one or more user preferences associated with the one or more third computing devices, the manifest file.

4. The method of claim 1 , wherein the receiving the manifest file comprises receiving, based on subscription to a message queue associated with the additional content segment, the manifest file.

5. The method of claim 1 , further comprising causing, based on the manifest file, adjustment of output of visual effects from the one or more third computing devices, wherein the visual effects are associated with the color values.

6. The method of claim 1 , wherein the one or more third computing devices comprise at least one lighting device.

7. The method of claim 1 , wherein the color values comprise values indicating average hue, brightness, and saturation values associated with pixels of the one or more frames of the video component.

8. The method of claim 1 , further comprising sending, after pausing the sending of the additional content segment associated with the content item, an alternative segment comprising an overlay indicating the sending of the additional content segment is paused.

9. A computing device comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, configure the computing device to:

send, to a second computing device, content segments associated with a content item;

receive a request to synchronize output, of visual effects from one or more third computing devices, with output of the content item via the second computing device;

pause, based on receiving the request, sending of an additional content segment associated with the content item to the second computing device;

receive a manifest file associated with the additional content segment, wherein the additional content segment comprises an audio component and a video component, and wherein the manifest file comprises data, for controlling the output of the visual effects by the one or more third computing devices, comprising:

a time value associated with one or more frames of the video component of the additional content segment, wherein the time value indicates a time associated with a beat in the audio component, and

color values, corresponding to the time value, based on the one or more frames of the video component; and

send, based on receiving the manifest file, the additional content segment to the second computing device and the manifest file to the one or more third computing devices.

10. The computing device of claim 9 , wherein the color values comprise values indicating average red, green, and blue color values associated with pixels of the one or more frames of the video component.

11. The computing device of claim 9 , wherein the instructions, when executed by the one or more processors, further configure the computing device to:

modify, based on one or more user preferences associated with the one or more third computing devices, the manifest file.

12. The computing device of claim 9 , wherein the instructions, when executed by the one or more processors, configure the computing device to receive the manifest file based on subscription to a message queue associated with the additional content segment.

13. The computing device of claim 9 , wherein the instructions, when executed by the one or more processors, further configure the computing device to cause, based on the manifest file, adjustment of output of visual effects from the one or more third computing devices, wherein the visual effects are associated with the color values.

14. The computing device of claim 9 , wherein the one or more third computing devices comprise at least one lighting device.

15. The computing device of claim 9 , wherein the color values comprise values indicating average hue, brightness, and saturation values associated with pixels of the one or more frames of the video component.

16. The computing device of claim 9 , wherein the instructions, when executed by the one or more processors, further configure the computing device to send, after pausing the sending of the additional content segment associated with the content item, an alternative segment comprising an overlay indicating the sending of the additional content segment is paused.

17. One or more non-transitory computer readable medium storing instructions that, when executed, cause:

sending, by a first computing device to a second computing device, content segments associated with a content item;

receiving a request to synchronize output, of visual effects from one or more third computing devices, with output of the content item via the second computing device;

pausing, based on receiving the request, sending of an additional content segment associated with the content item to the second computing device;

receiving, by the first computing device, a manifest file associated with the additional content segment, wherein the additional content segment comprises an audio component and a video component, and wherein the manifest file comprises data, for controlling the output of the visual effects by the one or more third computing devices, comprising:

a time value associated with one or more frames of the video component of the additional content segment, wherein the time value indicates a time associated with a beat in the audio component, and

color values, corresponding to the time value, based on the one or more frames of the video component; and

sending, based on receiving the manifest file, the additional content segment to the second computing device and the manifest file to the one or more third computing devices.

18. The one or more non-transitory computer readable medium of claim 17 , wherein the color values comprise values indicating average red, green, and blue color values associated with pixels of the one or more frames of the video component.

19. The one or more non-transitory computer readable medium of claim 17 , wherein the instructions, when executed, further cause:

modifying, based on one or more user preferences associated with the one or more third computing devices, the manifest file.

20. The one or more non-transitory computer readable medium of claim 17 , wherein the receiving the manifest file comprises receiving, based on subscription to a message queue associated with the additional content segment, the manifest file.

21. The one or more non-transitory computer readable medium of claim 17 , wherein the instructions, when executed, further cause:

causing, based on the manifest file, adjustment of output of visual effects from the one or more third computing devices, wherein the visual effects are associated with the color values.

22. The one or more non-transitory computer readable medium of claim 17 , wherein the one or more third computing devices comprise at least one lighting device.

23. The one or more non-transitory computer readable medium of claim 17 , wherein the color values comprise values indicating average hue, brightness, and saturation values associated with pixels of the one or more frames of the video component.

24. The one or more non-transitory computer readable medium of claim 17 , wherein the instructions, when executed, further cause sending, after pausing the sending of the additional content segment associated with the content item, an alternative segment comprising an overlay indicating the sending of the additional content segment is paused.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2019
From: WAGNER, ZACHARY; NGUYEN, TONY; JI, YONG; STIEL, ALISON
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 051071/0853 →
Continuity (1)
Related Publication 20210144422A1 · May 13, 2021
References Cited (36)
US 10771835B1 · Chong · 2020 [cited by examiner]
US 20050275626A1 · Mueller · 2005 [cited by examiner]
US 20070169115A1 · Ko · 2007 [cited by examiner]
US 20080080568A1 · Hughes · 2008 [cited by examiner]
US 20100080532A1 · Ubillos · 2010 [cited by examiner]
US 20120047542A1 · Lewis · 2012 [cited by examiner]
US 20140118541A1 · Lasko · 2014 [cited by examiner]
US 20140189052A1 · Gholmieh · 2014 [cited by examiner]
US 20140229829A1 · Mazur · 2014 [cited by examiner]
US 20160338180A1 · Archdale · 2016 [cited by examiner]
US 20170034263A1 · Archambault · 2017 [cited by examiner]
US 20170262253A1 · Silva · 2017 [cited by examiner]
US 20180063217A1 · Barkley · 2018 [cited by examiner]
US 20180131971A1 · Hwang · 2018 [cited by examiner]
US 20180152499A1 · Oyman · 2018 [cited by examiner]
US 20180277112A1 · Kim · 2018 [cited by examiner]
US 20180310032A1 · Reitmeyer · 2018 [cited by examiner]
US 20190104593A1 · Aliakseyeu · 2019 [cited by examiner]
US 20190174610A1 · Den Hartog · 2019 [cited by examiner]
US 20190191246A1 · Born · 2019 [cited by examiner]
US 20190228253A1 · Ramaswamy · 2019 [cited by examiner]
US 20190268393A1 · Panagos · 2019 [cited by examiner]
US 20190349213A1 · Shive · 2019 [cited by examiner]
US 20200137347A1 · Rechner · 2020 [cited by examiner]
US 20200275152A1 · Rycroft · 2020 [cited by examiner]
US 20200382742A1 · Guillotel · 2020 [cited by examiner]
Vitruk, Max. “How to Process Live Video Stream Using FFMPEG and OpenCV”, Lemberg.com website, Oct. 26, 2017 [retrieved on Nov. 21, 2020]. Retrieved from the Internet: <URL: https://lembergsolutions.com/blog/how-process-… [cited by examiner]
Kastrenakes, Jacob “Philips Hue box makes smart lights flash along with anything on your TV,” The Verge, https://www.theverge.com/2019/9/17/20864953/tv-light-sync-box-philps-hue-play-hdmi-passthrough-4k, Sep. 17, 2019. [cited by applicant]
Set-top box, retreived from https://web.archive.org/web/20191003194818/https://en.wikipedia.org/wiki/Set-top_box, dated Oct. 3, 2019. [cited by applicant]
Internet Protocol television, retrieved from https://web.archive.org/web/20191013100456/https://en.wikipedia.org/wiki/Internet_Protocol_television, dated Oct. 13, 2019. [cited by applicant]
Message queue, retrieved from https://web.archive.org/web/20190809172433/https://en.wikipedia.org/wiki/Message_queue, dated Aug. 9, 2019. [cited by applicant]
ROS Answers, “What is the Difference between a topic and a message?”, retrieved from https://web.archive.org/web/20180125082109/https://answers.ros.org/question/63511/what-is-the-difference-between-a-topic-and-a-message… [cited by applicant]
Manifest file, retrieved from https://web.archive.org/web/20190812193932/https://en.wikipedia.org/wiki/Manifest_file, dated Aug. 12, 2019. [cited by applicant]
Beat detection, retrieved from https://web.archive.org/web/20190803222826/https://en.wikipedia.org/wiki/Beat_detection, dated Aug. 3, 2019. [cited by applicant]
TarsosDSP, Github.com, retrieved from https://web.archive.org/web/20171221224643/https://github.com/JorenSix/TarsosDSP, dated Dec. 21, 2017. [cited by applicant]
Lovisa Johansson, “What is message queueing?”, https://www.cloudamqp.com/blog/2014-12-03-what-is-message-queuing.html, last updated Sep. 25, 2019. [cited by applicant]