IP Library Granted Patent US 10,701,409
Granted Patent B1
US 10,701,409 · App. 16/153,958 · Granted Jun 30, 2020

System and method for selectively replacing commercials that are in a video data stream with alternative commercials

Inventor: Manish Gupta (Bangalore, IN)
Assignee: Alphonso Inc.
H04N21/23424H04N21/4331H04N21/44204H04N21/44213H04N21/454
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,701,409
App. No.
16/153,958
Granted
Jun 30, 2020
Kind
B1
Abstract

Systems and methods are provided for selectively replacing commercials that are in a video data stream with alternative commercials. Automatic content recognition (ACR) is performed on the video data stream to detect the identity of each of the commercials played in a commercial block during a commercial break. Commercials in the video data stream which are detected as being displayed on a video display device are stored in a first database, and commercials in the video data stream which are detected as not being displayed on the video display device are stored in a second database. A rules engine defines how commercials in the video data stream should be replaced with other commercials. Commercials in the video data stream that were previously detected as being displayed on the video display device are selectively replaced with commercials that were previously detected as not being displayed on the video display device.

Claims (68)

1. A method for selectively replacing commercials that are in a video data stream with alternative commercials, wherein the commercials are played in commercial blocks, each commercial block including a sequence of individual commercials played in successive time windows, wherein at least portions of the video data stream are displayed on a video display device, the method comprising:

(a) performing, using a search engine in communication with a library of commercials, automatic content recognition (ACR) on the video data stream and detecting the identity of each of the commercials played in a commercial block during a commercial break, wherein the ACR evaluates a succession of samples of each of the commercials against a database of files for commercials in the library of commercials;

(b) detecting, using a video processor, which commercials in the video data stream are displayed on the video display device, and which commercials in the video data stream are not displayed on the video display device, wherein step (b) is a separate and distinct step from step (a);

(c) storing in a first database records of the commercials that were displayed on the video display device;

(d) storing in a second database records of the commercials that were not displayed on the video display device;

(e) providing a rules engine that defines how commercials in the video data stream should be replaced with other commercials; and

(f) selectively replacing, using the video processor in electronic communication with the first and second database and the rules engine, commercials in the video data stream that were previously detected as being displayed on the video display device with commercials that were previously detected as not being displayed on the video display device,

wherein the video data stream includes a plurality of different broadcast channels, and the video display device is tuned at any one time to only one of the broadcast channel, and wherein at least some of the commercials that were not displayed on the video display device were not displayed because they were broadcast on a channel that the video display device was not tuned to.

2. The method of claim 1 wherein in step (f), the replaced commercials have one or more of the following characteristics compared to the commercials being replaced:

(i) same length,

(ii) same brand,

(iii) same product type, and

(iv) same or lower content rating, and

wherein the rules engine includes the one or more characteristics.

3. The method of claim 1 wherein the first database records a number of times that the commercials that were displayed on the video display device, and the second database records the number of times that the commercials were not displayed on the video display device, and

wherein the rules engine includes rules for balancing out the commercial replacement, using the number of times that the commercials were displayed on the video display device, and the number of times that the commercials were not displayed on the video display device.

4. The method of claim 1 wherein a commercial blocking device, when in an active state, prevents commercials from being displayed on the video display device, and wherein step (f) occurs only when the commercial blocking device is in an inactive state.

5. A method for selectively replacing commercials that are in a video data stream with alternative commercials, wherein the commercials are played in commercial blocks, each commercial block including a sequence of individual commercials played in successive time windows, wherein at least portions of the video data stream are displayed on a video display device, the method comprising:

(a) performing, using a search engine in communication with a library of commercials, automatic content recognition (ACR) on the video data stream and detecting the identity of each of the commercials played in a commercial block during a commercial break, wherein the ACR evaluates a succession of samples of each of the commercials against a database of files for commercials in the library of commercials;

(b) detecting, using a video processor, which commercials in the video data stream are displayed on the video display device, and which commercials in the video data stream are not displayed on the video display device, wherein step (b) is a separate and distinct step from step (a);

(c) storing in a first database records of the commercials that were displayed on the video display device;

(d) storing in a second database records of the commercials that were not displayed on the video display device;

(e) providing a rules engine that defines how commercials in the video data stream should be replaced with other commercials; and

(f) selectively replacing, using the video processor in electronic communication with the first and second database and the rules engine, commercials in the video data stream that were previously detected as being displayed on the video display device with commercials that were previously detected as not being displayed on the video display device,

wherein a commercial blocking device is associated with the video display device, and wherein at least some of the commercials that were not displayed on the video display device were not displayed because they were blocked by the commercial blocking device, and wherein the commercial blocking device blocks all detected commercials.

6. The method of claim 5 wherein in step (f), the replaced commercials have one or more of the following characteristics compared to the commercials being replaced:

(i) same length,

(ii) same brand,

(iii) same product type, and

(iv) same or lower content rating, and

wherein the rules engine includes the one or more characteristics.

7. The method of claim 5 wherein the first database records a number of times that the commercials that were displayed on the video display device, and the second database records the number of times that the commercials were not displayed on the video display device, and

wherein the rules engine includes rules for balancing out the commercial replacement, using the number of times that the commercials were displayed on the video display device, and the number of times that the commercials were not displayed on the video display device.

8. The method of claim 5 wherein the commercial blocking device, when in an active state, prevents all commercials from being displayed on the video display device, and wherein step (f) occurs only when the commercial blocking device is in an inactive state.

9. A system for selectively replacing commercials that are in a video data stream with alternative commercials, wherein the commercials are played in commercial blocks, each commercial block including a sequence of individual commercials played in successive time windows, wherein at least portions of the video data stream are displayed on a video display device, the system comprising:

(a) a search engine in communication with a library of commercials configured to perform, automatic content recognition (ACR) on the video data stream and detect the identity of each of the commercials played in a commercial block during a commercial break, wherein the ACR evaluates a succession of samples of each of the commercials against a database of files for commercials in the library of commercials;

(b) a video processor configured to detect which commercials in the video data stream are displayed on the video display device, and which commercials in the video data stream are not displayed on the video display device, wherein the detection by the video processor is a separate and distinct action from the ACR performed by the search engine;

(c) a first database that stores records of the commercials that were displayed on the video display device;

(d) a second database that stores records of the commercials that were not displayed on the video display device; and

(e) a rules engine configured to define how commercials in the video data stream should be replaced with other commercials,

wherein the video processor is in electronic communication with the first and second database and the rules engine, and is further configured to selectively replace commercials in the video data stream that were previously detected as being displayed on the video display device with commercials that were previously detected as not being displayed on the video display device, and

wherein the video data stream includes a plurality of different broadcast channels, and the video display device is tuned at any one time to only one of the broadcast channel, and wherein at least some of the commercials that were not displayed on the video display device were not displayed because they were broadcast on a channel that the video display device was not tuned to.

10. The system of claim 9 wherein the replaced commercials have one or more of the following characteristics compared to the commercials being replaced:

(i) same length,

(ii) same brand,

(iii) same product type, and

(iv) same or lower content rating, and

wherein the rules engine includes the one or more characteristics.

11. The system of claim 9 wherein the first database records a number of times that the commercials that were displayed on the video display device, and the second database records the number of times that the commercials were not displayed on the video display device, and

wherein the rules engine includes rules for balancing out the commercial replacement, using the number of times that the commercials were displayed on the video display device, and the number of times that the commercials were not displayed on the video display device.

12. The system of claim 9 wherein a commercial blocking device, when in an active state, prevents commercials from being displayed on the video display device, and wherein the selective replacement of commercials occurs only when the commercial blocking device is in an inactive state.

13. A system for selectively replacing commercials that are in a video data stream with alternative commercials, wherein the commercials are played in commercial blocks, each commercial block including a sequence of individual commercials played in successive time windows, wherein at least portions of the video data stream are displayed on a video display device, the system comprising:

(a) a search engine in communication with a library of commercials configured to perform, automatic content recognition (ACR) on the video data stream and detect the identity of each of the commercials played in a commercial block during a commercial break, wherein the ACR evaluates a succession of samples of each of the commercials against a database of files for commercials in the library of commercials;

(b) a video processor configured to detect which commercials in the video data stream are displayed on the video display device, and which commercials in the video data stream are not displayed on the video display device, wherein the detection by the video processor is a separate and distinct action from the ACR performed by the search engine;

(c) a first database that stores records of the commercials that were displayed on the video display device;

(d) a second database that stores records of the commercials that were not displayed on the video display device; and

(e) a rules engine configured to define how commercials in the video data stream should be replaced with other commercials,

wherein the video processor is in electronic communication with the first and second database and the rules engine, and is further configured to selectively replace commercials in the video data stream that were previously detected as being displayed on the video display device with commercials that were previously detected as not being displayed on the video display device, and

wherein a commercial blocking device is associated with the video display device, and wherein at least some of the commercials that were not displayed on the video display device were not displayed because they were blocked by the commercial blocking device, and wherein the commercial blocking device blocks all detected commercials.

14. The system of claim 13 wherein the replaced commercials have one or more of the following characteristics compared to the commercials being replaced:

(i) same length,

(ii) same brand,

(iii) same product type, and

(iv) same or lower content rating, and

wherein the rules engine includes the one or more characteristics.

15. The system of claim 13 wherein the first database records a number of times that the commercials that were displayed on the video display device, and the second database records the number of times that the commercials were not displayed on the video display device, and

wherein the rules engine includes rules for balancing out the commercial replacement, using the number of times that the commercials were displayed on the video display device, and the number of times that the commercials were not displayed on the video display device.

16. The system of claim 13 wherein the commercial blocking device, when in an active state, prevents all commercials from being displayed on the video display device, and wherein the selective replacement of commercials occurs only when the commercial blocking device is in an inactive state.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Mar 12, 2024
From: TREMOR VIDEO, INC.
To: ALPHONSO INC.
Reel/Frame 066794/0274 →
SECURITY INTEREST Recorded Mar 30, 2021
From: ALPHONSO INC.
To: TREMOR VIDEO, INC.
Reel/Frame 055776/0102 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2018
From: GUPTA, MANISH
To: ALPHONSO INC.
Reel/Frame 047093/0021 →
Cited By (2)
US 12,200,301 US 12,309,451