IP Library Granted Patent US 11,032,447
Granted Patent B2
US 11,032,447 · App. 16/504,992 · Granted Jun 8, 2021

Method and system for automatically synchronizing audio-video inputs in a multi camera environment

Inventors: Abhiroop Boggavarapu (Bangalore, IN); Dalimba Laxminarayana (Bangalore, IN); Rao Venkata Krishna Suryanarayana (Bangalore, IN); Satish Balasubramanian Iyer (Bangalore, IN)
Assignee: Sling Media PVT. Ltd.
H04N5/04G06T7/80G06T7/97H04N5/38
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,032,447
App. No.
16/504,992
Granted
Jun 8, 2021
Kind
B2
Abstract

Systems and methods for synchronizing video generated by a camera with media content generated by a media source external to the camera. A calibration procedure is performed in which a time delay is determined that includes a camera delay associated with the camera. A display device displays a sequence of images comprising a first image displayed for a first time period and a second image displayed for a second time period. The camera captures a plurality of captured images capturing display of the sequence of images and a transmitter device coupled to the camera transmits the captured images to a hub. The hub determines a target image of the captured images corresponding to display of the second image. The time delay is determined based on a difference between a time associated with the target image and a time associated with the second image.

Claims (64)

1. A method, comprising:

obtaining a plurality of captured images, produced by a camera, that capture images displayed by a display device including at least a first display image displayed for a first time period and a second display image displayed for a second time period that is different than the first time period;

obtaining, from the display device and independent from content of the second display image, display time information based on a system time associated with the display device, the display time information indicating a first time at which the display device displayed the second display image;

identifying, from the plurality of captured images, a target captured image that captures the second display image displayed by the display device;

identifying a second time indicated in capture time information associated with the target captured image; and

determining a time delay that includes a camera delay associated with the camera based on the first time and the second time.

2. The method of claim 1 , wherein the plurality of captured images are obtained from a transition-minimized differential signaling encoded signal.

3. The method of claim 1 , comprising:

receiving, before the first time period, a signal indicating that the display device is to display the first display image and the second display image in connection with a calibration procedure.

4. The method of claim 1 , comprising:

for the plurality of captured images,

calculating a representative value of each captured image; and

comparing the representative value to a threshold value, wherein the target captured image in the plurality of captured images is determined as a result of the representative value associated with the target captured image satisfying a condition involving the threshold value.

5. The method of claim 1 , wherein the first display image has a first brightness value and the second display image has a second brightness value different than the first brightness value.

6. The method of claim 1 , wherein the first display image is a black image and the second display image is a white image.

7. The method of claim 1 , wherein the plurality of captured images includes a plurality of candidate images that capture the second display image consecutively displayed two or more frames by the display device during the second time period.

8. The method of claim 7 , comprising:

for the plurality of captured images,

calculating a representative value corresponding to the plurality of candidate images; and

comparing the representative value to a threshold value, wherein the target captured image in the plurality of captured images is determined as a result of determining that the representative value image satisfies a condition involving the threshold value.

9. The method of claim 1 , wherein determining the time delay involves determining a difference between the first time and the second time.

10. The method of claim 1 , wherein the plurality of captured images are received from a transmitter device communicatively coupled to the camera, and the time delay includes a capture delay between a time at which circuitry of the camera outputs an image and a time at which the transmitter device captures the image outputted from the camera.

11. The method of claim 1 , comprising:

obtaining a second plurality of captured images captured by the camera during a third time period after the first time period and the second time period;

obtaining media content captured during the third time period by a source external to the camera; and

synchronizing the media content and the second plurality of captured images based on the time delay.

12. A system, comprising:

a communication interface;

one or more processors; and

memory storing a set of instructions that, as a result of execution by the one or more processors, cause the one or more processors to:

obtain a sequence of captured images, produced by a camera, that captures display, by a display device, of a first image over a first time period and a second image over a second time period shorter than the first time period;

receive, over a network via the communication interface and independent from content of the second image, display time information based on a system time associated with the display device, the display time information specifying a first time at which the display device displayed the second image;

determine, from the sequence of captured images, a target captured image that captures the second image displayed by the display device;

identify a second time indicated in capture time information associated with the target capture image; and

determine a time delay that includes a camera delay associated with the camera based on the first time and the second time.

13. The system of claim 12 , wherein execution of the set of instructions causes the system to:

obtain a second sequence of captured images captured by the camera during a third time period after the first time period and the second time period;

obtain media content captured during the third time period by a source external to the camera via the communication interface; and

synchronize the media content and the second sequence of captured images based on the time delay.

14. The system of claim 12 , wherein execution of the set of instructions causes the system to:

receive, before the first time period via the communication interface, a signal indicating that the display device will display the first image and the second image in connection with a calibration procedure.

15. The system of claim 12 , wherein the time delay is determined based on a difference between the first time and the second time.

16. The system of claim 12 , wherein execution of the set of instructions causes the system to:

for the sequence of captured images,

calculate an average value of each captured image; and

compare the average value to a threshold value, wherein the target captured image in the sequence of captured images is determined as a result of a determination that the average value of the image satisfies a condition involving the threshold value.

17. The system of claim 12 , further comprising:

a transmitter device having a media input port, wherein the sequence of captured images is provided in a transition-minimized differential signaling encoded signal received via the media input port.

18. The system of claim 17 , wherein the transmitter device transmits the sequence of captured images to the communication interface, and the time delay includes a capture delay between a time at which circuitry of the camera outputs an image and a time at which the transmitter device captures the image outputted from the camera.

19. A non-transitory computer-readable medium having a set of instructions stored thereon that, as a result of execution, cause one or more processors to:

obtain a plurality of captured images, produced by a camera, that capture display, by a display device, of a first image over a first time period and a second image over a second time period after the first time period;

obtain, from the display device and independent from content of the second image, display time information based on a system time associated with the display device, the display time information indicating a first time at which the display device displayed the second image;

determine, from the plurality of captured images, a target captured image that captures the second image displayed by the display device;

identify a second time indicated in capture time information associated with the target captured image; and

determine a time delay that includes a camera delay with the camera based on the first time and the second time.

20. The non-transitory computer-readable medium of claim 19 wherein execution of the set of instructions causes the one or more processors to:

obtain a second plurality of captured images captured by the camera over a third time period after the first time period and the second time period;

obtain media content captured during the third time period by a source external to the camera; and

synchronize the media content and the second plurality of captured images based on the time delay.

21. The non-transitory computer-readable medium of claim 19 , wherein execution of the set of instructions causes the one or more processors to:

for the plurality of captured images,

calculate an average value of each captured image; and

compare the average value to a threshold value, wherein the target captured image in the plurality of captured images is determined as a result of a determination that the average value of the image satisfies a condition involving the threshold value.

22. The non-transitory computer-readable medium of claim 19 , wherein the first image has a first average brightness value and the second image has a second average brightness value different than the first average brightness value.

Assignments (2)
CHANGE OF NAME Recorded Jul 18, 2022
From: SLING MEDIA PRIVATE LIMITED
To: DISH NETWORK TECHNOLOGIES INDIA PRIVATE LIMITED
Reel/Frame 060535/0011 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2019
From: BOGGAVARAPU, ABHIROOP; LAXMINARAYANA, DALIMBA; SURYANARAYANA, RAO VENKATA KRISHNA; IYER, SATISH BALASUBRAMANIAN
To: SLING MEDIA PVT LTD
Reel/Frame 049691/0633 →
Continuity (1)
Related Publication 20210014385A1 · Jan 14, 2021