IP Library Granted Patent US 11,483,496
Granted Patent B2
US 11,483,496 · App. 17/670,480 · Granted Oct 25, 2022

System and method for synchronizing auxiliary content to a video stream

Inventors: Oran Gilad (Herzliya Pituach, IL); Samuel Chenillo (New York, NY); Oren Steinfeld (Kfar Saba, IL)
H04N5/275H04N5/0675H04N21/2187H04N21/4307H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,483,496
App. No.
17/670,480
Granted
Oct 25, 2022
Kind
B2
Abstract

A system and method of synchronizing auxiliary content to a video stream is disclosed that uses a block of bit-vectors linked to a target frame in a video steam. The block of bit-vectors consists of a multi-frame sequence of image bit-vectors. The video stream and block of bit-vectors are transmitted to an end user device that uses the bit-vector block to uniquely identify the target frame. The target frame is used to synchronize auxiliary content to the video stream.

Claims (31)

1. A method of synchronizing auxiliary content to a video stream, comprising:

identifying a target frame in said video stream;

creating a block of bit-vectors comprising only every nth frame of a multi-frame sequence of image bit-vectors linked to said target frame, where n is an integer greater than or equal to 2;

transmitting said video stream to an end user device via a first transmission path; transmitting said block of bit-vectors to said end user device via a second transmission path;

identifying said target frame by said end user device using said block of bit-vectors; synchronizing said auxiliary content to said video stream by said end user device using said target frame; and,

displaying said synchronized video stream and said auxiliary content on said end user device.

2. The method of claim 1 , further comprising:

obtaining virtual insertion data from said target frame; and,

transmitting said virtual insertion data with said block of bit-vectors to said end user device via said second transmission path.

3. The method of claim 2 , wherein, said virtual insertion data and said block of bit-vectors are compressed using a lossless compression algorithm prior to transmission.

4. The method of claim 2 , wherein, said virtual insertion data comprises virtual insertion keying, occlusion, and tracking data; and, said auxiliary content comprises a video image.

5. The method of claim 4 , wherein, said auxiliary content is transmitted to said end user device via a third transmission path.

6. The method of claim 1 , wherein, said video stream is obtained from cameras at a live event.

7. The method of claim 1 , further comprising transmitting to said end user device via said second transmission path a size of said block of bit-vectors.

8. A method of synchronizing auxiliary content to a video stream, comprising:

identifying a target frame in said video stream;

creating a block of bit-vectors comprising a multi-frame sequence of image bit-vectors linked to said target frame, said bit-vectors being created using an average bit-vector function comprising the steps of: reducing a video frame to 64 smaller, equally sized images; converting each of said 64 smaller images to a gray scale image; obtaining an average pixel value of each of said 64 smaller gray scale images; obtaining an average value of all 64 average pixel values; and generating an image bit-vector by sequentially appending a 1 for each occurrence of said average pixel value of each of said 64 smaller gray scale images equaling or exceeding said average value of all 64 average values, and a 0 when it does not;

transmitting said video stream to an end user device via a first transmission path;

transmitting said block of bit-vectors to said end user device via a second transmission path;

identifying said target frame by said end user device using said block of bit-vectors;

synchronizing said auxiliary content to said video stream by said end user device using said target frame; and,

displaying said synchronized video stream and said auxiliary content on said end user device.

9. The method of claim 8 , further comprising:

a virtual insertion preparation module that obtains virtual insertion data linked to said target frame; and,

transmits said virtual insertion data with said bit-vector block to said end user device via said second transmission path.

10. A system for synchronizing auxiliary content to a video stream, comprising:

a bit-vector block module that identifies a target frame of the video stream, and creates a block of bit-vectors comprising only every nth frame of a multi-frame sequence of image bit-vectors linked to said target frame, where n is an integer greater than or equal to 2;

a first transmitter that transmits said video stream to an end user device;

a second transmitter that transmits said block of bit-vectors to said end user device;

an auxiliary content supply that supplies an auxiliary content file to said end user device;

a synchronize and display app functioning on said end user device that identifies said target frame using said block of bit-vectors, synchronizes said auxiliary content file to said video stream, and displays said synchronized video stream and said auxiliary content file.

Assignments (3)
CHANGE OF NAME Recorded Oct 15, 2025
From: BRANDMAGIC INC.
To: TGI SPORT TECHNOLOGY INTERNATIONAL INC.
Reel/Frame 073686/0353 →
SECURITY INTEREST Recorded Dec 2, 2022
From: BALAB LLC; BRANDMAGIC INC.
To: GLOBAL LOAN AGENCY SERVICES AUSTRALIA NOMINEES PTY LTD
Reel/Frame 061951/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: CHENILLO, SAMUEL; STEINFELD, OREN; GILAD, ORAN
To: BRANDMAGIC INC.
Reel/Frame 060954/0627 →
Continuity (4)
Continuation In Part 17330419 · May 26, 2021
Continuation In Part 17072491 · Oct 16, 2020
Continuation In Part 16389957 · Apr 21, 2019
Related Publication 20220166940A1 · May 26, 2022