IP Library Granted Patent US 11,228,799
Granted Patent B2
US 11,228,799 · App. 16/387,213 · Granted Jan 18, 2022

Methods and systems for content synchronization

Inventor: Srinath V. Ramaswamy (East Windsor, NJ)
Assignee: COMCAST CABLE COMMUNICATIONS, LLC
H04N21/4307G06F16/7834G06F16/7867H04N21/2404
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,228,799
App. No.
16/387,213
Granted
Jan 18, 2022
Kind
B2
Abstract

Methods and systems are described for content synchronization. A computing device may receive video content and audio content. The computing device may determine an error associated with a video content output time or an audio content output time.

Claims (68)

1. A method comprising:

receiving, by a computing device, a video frame and video frame metadata, wherein the video frame metadata comprises an audio frame identifier and a first output delta;

determining, based on the video frame metadata, a video frame output time and a first audio frame;

determining, based on the first audio frame, a first audio frame output time;

determining, based on a difference between the video frame output time and the first audio frame output time, a first calculated output delta; and

determining, based on a difference between the first output delta and the first calculated output delta satisfying a threshold, an error associated with the video frame output time.

2. The method of claim 1 , wherein the video frame metadata comprises a video frame identifier, wherein the first audio frame comprises audio content that starts output during output of the video frame, and wherein the error indicates a synchronization error between the video frame and the first audio frame.

3. The method of claim 1 , further comprising:

determining a verified audio frame output time; and

determining, based on a difference between the first output delta and the verified audio frame output time, a corrected video frame output time.

4. The method of claim 1 , further comprising:

correcting, based on the first output delta and the first audio frame output time, the error associated with the video frame output time; and

causing, based on the corrected error associated with the video frame output time, output of the video frame.

5. The method of claim 1 , further comprising:

determining, based on a difference between a second audio frame output time for a second audio frame and the video frame output time, a second calculated output delta; and

determining, based on a difference between a second output delta, in audio frame metadata, and the second calculated output delta satisfying a second threshold, an error associated with the second audio frame output time.

6. A method comprising:

receiving, by a computing device, a first audio frame and audio frame metadata, wherein the audio frame metadata comprises a video frame identifier and a first output delta;

determining, based on the audio frame metadata, a first audio frame output time and a video frame;

determining, based on the video frame, a video frame output time;

determining, based on a difference between the first audio frame output time and the video frame output time, a first calculated output delta; and

determining, based on a difference between the first output delta and the first calculated output delta satisfying a threshold, an error associated with the first audio frame output time.

7. The method of claim 6 , wherein the first audio frame comprises an audio frame identifier and audio content that starts output during output of the video frame, and wherein the error indicates a synchronization error between the video frame and the first audio frame.

8. The method of claim 6 , further comprising:

determining a corrected audio frame output time; and

determining, based on a difference between the first output delta and the corrected audio frame output time, a corrected video frame output time.

9. The method of claim 6 , further comprising:

correcting, based on the first output delta and the video frame output time, the error associated with the first audio frame output time; and

causing, based on the corrected error associated with the first audio frame output time, output of the first audio frame.

10. The method of claim 6 , further comprising:

determining, based on a difference between the video frame output time and a second audio frame output time for a second audio frame, a second calculated output delta; and

determining, based on a difference between a second output delta, in video frame metadata, and the second calculated output delta satisfying a second threshold, an error associated with the second audio frame output time.

11. An apparatus comprising:

one or more processors; and

memory storing processor-executable instructions that, when executed by the one or more processors, cause the apparatus to:

receive a video frame and video frame metadata, wherein the video frame metadata comprises an audio frame identifier and a first output delta;

determine, based on the video frame metadata, a video frame output time and a first audio frame;

determine, based on the first audio frame, a first audio frame output time;

determine, based on a difference between the video frame output time and the first audio frame output time, a first calculated output delta; and

determine, based on a difference between the first output delta and the first calculated output delta satisfying a threshold, an error associated with the video frame output time.

12. The apparatus of claim 11 , wherein the video frame metadata comprises a video frame identifier, wherein the first audio frame comprises audio content that starts output during output of the video frame, and wherein the error indicates a synchronization error between the video frame and the first audio frame.

13. The apparatus of claim 11 , wherein the processor-executable instructions, when executed by the one or more processors, further cause the apparatus to:

determine a verified audio frame output time; and

determine, based on a difference between the first output delta and the verified audio frame output time, a corrected video frame output time.

14. The apparatus of claim 11 , wherein the processor-executable instructions, when executed by the one or more processors, further cause the apparatus to:

correct, based on the first output delta and the first audio frame output time, the error associated with the video frame output time; and

cause, based on the corrected error associated with the video frame output time, output of the video frame.

15. The apparatus of claim 11 , wherein the processor-executable instructions, when executed by the one or more processors, further cause the apparatus to:

determine, based on a difference between a second audio frame output time for a second audio frame and the video frame output time, a second calculated output delta; and

determine, based on a difference between a second output delta, in audio frame metadata, and the second calculated output delta satisfying a second threshold, an error associated with the second audio frame output time.

16. An apparatus comprising:

one or more processors; and

memory storing processor-executable instructions that, when executed by the one or more processors, cause the apparatus to:

receive a first audio frame and audio frame metadata, wherein the audio frame metadata comprises a video frame identifier and a first output delta;

determine, based on the audio frame metadata, a first audio frame output time and a video frame;

determine, based on the video frame, a video frame output time;

determine, based on a difference between the first audio frame output time and the video frame output time, a first calculated output delta; and

determine, based on a difference between the first output delta and the first calculated output delta satisfying a threshold, an error associated with the first audio frame output time.

17. The apparatus of claim 16 , wherein the first audio frame comprises an audio frame identifier and audio content that starts output during output of the video frame, and wherein the error indicates a synchronization error between the video frame and the first audio frame.

18. The apparatus of claim 16 , wherein the processor-executable instructions, when executed by the one or more processors, further cause the apparatus to:

determine a corrected audio frame output time; and

determine, based on a difference between the first output delta and the corrected audio frame output time, a corrected video frame output time.

19. The apparatus of claim 16 , wherein the processor-executable instructions, when executed by the one or more processors, further cause the apparatus to:

correct, based on the first output delta and the video frame output time, the error associated with the first audio frame output time; and

cause, based on the corrected error associated with the first audio frame output time, output of the first audio frame.

20. The apparatus of claim 16 , wherein the processor-executable instructions, when executed by the one or more processors, further cause the apparatus to:

determine, based on a difference between the video frame output time and a second audio frame output time for a second audio frame, a second calculated output delta; and

determine, based on a difference between a second output delta, in video frame metadata, and the second calculated output delta satisfying a second threshold, an error associated with the second audio frame output time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2019
From: RAMASWAMY, SRINATH V.
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 048915/0984 →
Continuity (1)
Related Publication 20200336781A1 · Oct 22, 2020