IP Library Granted Patent US 9,058,522
Granted Patent B2
US 9,058,522 · App. 13/862,318 · Granted Jun 16, 2015

Logo presence detection based on blending characteristics

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,058,522
App. No.
13/862,318
Granted
Jun 16, 2015
Kind
B2
Abstract

A video processing system detects an overlay image, such as a logo, in a picture of a video stream, the overlay for example being a broadcaster's logo. The detection is based on evaluation of blending characteristics of a picture frame. The method of detection of an overlay defines first and second areas within the image, the first and second areas being non-overlapping. Next an alpha-blended value is calculated for the mean color value of the second area with an overlay color value. Then, if the mean color value of the first area is closer to the alpha-blended value than it is to the mean color value of the second area, the overlay can be indicated as detected and defined within the picture. Detection of the overlay can be used to identify an owner of the video, or detect when a scene change such as a commercial occurs.

Claims (61)

1. A method for an electronic device to detect an overlay area within an image, the method comprising:

defining, by the electronic device, first and second areas within the image, the first and second areas non-overlapping;

calculating, by the electronic device, an alpha-blended value of a mean color value of the second area with an overlay color value; and

if a mean color value of the first area is closer to the alpha-blended value than it is to the mean color value of the second area, then defining an overlay area comprising at least one pixel within the first area,

wherein the method is further performed separately on a first image, and on a second image, where the second image is a temporally averaged image, the method further comprising:

determining a common overlay area based on an intersection of the overlay area for the first image and the overlay area for the second image.

2. The method of claim 1 , wherein the overlay area is specified as a portion of a binary image, the method further comprising:

applying at least one of: a morphological closing and a morphological opening operation to at least a portion of the binary image to provide a second binary image.

3. A method for an electronic device to detect an overlay area within an image, the method comprising:

defining, by the electronic device, first and second areas within the image, the first and second areas non-overlapping;

calculating, by the electronic device, an alpha-blended value of a mean color value of the second area with an overlay color value; and

if a mean color value of the first area is closer to the alpha-blended value than it is to the mean color value of the second area, then defining an overlay area comprising at least one pixel within the first area,

wherein the image is a time-averaged composition of a plurality of frames within a video based on a change-gated temporal averaging process.

4. The method of claim 3 , wherein the change-gated temporal averaging process includes a frame in the time-averaged composition when a predetermined difference exists between the frame and a previous frame already included in the time-averaged composition.

5. The method of claim 3 , wherein the change-gated temporal averaging process includes a frame in the time-averaged composition when a number of frames since a last update to the time-averaged composition exceeds a threshold.

6. A method for an electronic device to detect an overlay area within an image, the method comprising:

defining, by the electronic device, first and second areas within the image, the first and second areas non-overlapping;

calculating, by the electronic device, an alpha-blended value of a mean color value of the second area with an overlay color value;

if a mean color value of the first area is closer to the alpha-blended value than it is to the mean color value of the second area, then defining an overlay area comprising at least one pixel within the first area,

successively defining other corresponding first and second areas within the image; and

repeating the calculating and if-then steps with the other corresponding first and second areas,

wherein each first area is located at a pre-defined offset from a location of its corresponding second area.

7. The method of claim 6 :

wherein the successive defining comprises defining a new corresponding first area for the second area, the new corresponding first area distinct from the first area;

wherein the new corresponding first area is located at a new offset from the location of the second area; and

wherein the new offset is greater than the first offset.

8. The method of claim 3 , wherein the successively defining is performed in a direction across the image selected from the group consisting of: horizontally, vertically, and diagonally.

9. The method of claim 6 , further comprising:

successively defining other first and second areas within the image until the entire image has been incorporated into first and second areas.

10. A method for an electronic device to detect an overlay area within an image, the method comprising:

defining, by the electronic device, first and second areas within the image, the first and second areas non-overlapping;

calculating, by the electronic device, an alpha-blended value of a mean color value of the second area with an overlay color value; and

if a mean color value of the first area is closer to the alpha-blended value than it is to the mean color value of the second area, then defining an overlay area comprising at least one pixel within the first area,

wherein the image is a first frame of a series of frames within a video;

the method further comprising:

repeating the defining, comparing, and performing steps with a second frame within the video, the first and second frames distinct;

if overlay areas are found within a plurality of successive frames, then comparing overlay areas across a plurality of successive frames; and

if the successive overlay areas are consistent with one another, then including the overlay areas in an overlay mask.

11. A method for an electronic device to detect an overlay area within an image, the method comprising:

defining, by the electronic device, first and second areas within the image, the first and second areas non-overlapping;

calculating, by the electronic device, an alpha-blended value of a mean color value of the second area with an overlay color value;

if a mean color value of the first area is closer to the alpha-blended value than it is to the mean color value of the second area, then defining an overlay area comprising at least one pixel within the first area; and

redefining the overlay area to exclude the at least one pixel within the first area if the mean color value of the first area is greater than the alpha-blended value plus a tolerance value, or is less than the alpha-blended value minus a tolerance value.

12. The method of claim 11 wherein the tolerance value depends on the mean image color value of the second area.

13. The method of claim 11 , wherein the tolerance value is based linearly on a luminance of the mean color value of the second area.

14. A method for an electronic device to detect an overlay area within an image, the method comprising:

defining, by the electronic device, first and second areas within the image, the first and second areas non-overlapping;

calculating, by the electronic device, a predicted mean color value of the first area based, at least in part, on a mean color value of the second area, wherein the predicted mean color value is greater than or equal to the mean color value of the second area; and

if a mean color value of the first area is closer to the predicted mean color value than it is to the mean color value of the second area, then:

defining an overlay area comprising at least one pixel within the first area; and

performing, by the electronic device, an action selected comprising at least one of: displaying a border around the overlay area, indicating that an overlay area has been found, providing a mask of the overlay area, influencing parameters to be used when encoding at least the overlay area, and causing an encoder to target a higher quality of encoded video output for the overlay area,

wherein a difference between the predicted mean color value of the first area and the mean color value of the second area decreases linearly as the mean color value of the second area increases.

15. A method for an electronic device to detect an overlay area within an image, the method comprising:

defining, by the electronic device, first and second areas within the image, the first and second areas non-overlapping;

calculating, by the electronic device, a predicted mean color value of the first area based, at least in part, on a mean color value of the second area, wherein the predicted mean color value is greater than or equal to the mean color value of the second area;

if a mean color value of the first area is closer to the predicted mean color value than it is to the mean color value of the second area, then:

defining an overlay area comprising at least one pixel within the first area; and

performing, by the electronic device, an action selected comprising at least one of: displaying a border around the overlay area, indicating that an overlay area has been found, providing a mask of the overlay area, influencing parameters to be used when encoding at least the overlay area, and causing an encoder to target a higher quality of encoded video output for the overlay area; and

redefining the overlay area to exclude the at least one pixel within the first area if:

the mean color value of the first area is greater than the predicted mean color value plus a tolerance value, or

the mean color value of the first area is less than the predicted mean color value minus a tolerance value.

Assignments (13)
RELEASE OF SECURITY INTEREST AT REEL/FRAME 049905/0504 Recorded Dec 19, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ARRIS ENTERPRISES LLC (F/K/A ARRIS ENTERPRISES, INC.); ARRIS TECHNOLOGY, INC.; ARRIS SOLUTIONS, INC.; COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; RUCKUS WIRELESS, LLC (F/K/A RUCKUS WIRELESS, INC.)
Reel/Frame 071477/0255 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2022
From: ARRIS TECHNOLOGY, INC.
To: ARRIS ENTERPRISES, INC.
Reel/Frame 060791/0583 →
SECURITY INTEREST Recorded Nov 19, 2021
From: ARRIS SOLUTIONS, INC.; ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE, INC. OF NORTH CAROLINA; RUCKUS WIRELESS, INC.
To: WILMINGTON TRUST
Reel/Frame 060752/0001 →
PATENT SECURITY AGREEMENT Recorded Jul 3, 2019
From: ARRIS ENTERPRISES LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 049820/0495 →
TERM LOAN SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049905/0504 →
ABL SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049892/0396 →
CHANGE OF NAME Recorded Jul 2, 2019
From: ARRIS ENTERPRISES, INC.
To: ARRIS ENTERPRISES LLC
Reel/Frame 049649/0062 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Apr 8, 2019
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: ARRIS GROUP, INC.; ARRIS ENTERPRISES, INC.; ARRIS INTERNATIONAL LIMITED; ARRIS TECHNOLOGY, INC.; ARCHIE U.S. MERGER LLC; ARCHIE U.S. HOLDINGS LLC; ARRIS GLOBAL SERVICES, INC.; ARRIS HOLDINGS CORP. OF ILLINOIS, INC.; ARRIS SOLUTIONS, INC.; BIG BAND NETWORKS, INC.; TEXSCAN CORPORATION; POWER GUARD, INC.; JERROLD DC RADIO, INC.; NEXTLEVEL SYSTEMS (PUERTO RICO), INC.; GIC INTERNATIONAL HOLDCO LLC; GIC INTERNATIONAL CAPITAL LLC
Reel/Frame 050721/0401 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2015
From: ARRIS TECHNOLOGY, INC
To: ARRIS ENTERPRISES, INC.
Reel/Frame 037328/0341 →
SECURITY INTEREST Recorded Jun 26, 2015
From: ARRIS GROUP, INC.; ARRIS ENTERPRISES, INC.; ARRIS INTERNATIONAL LIMITED; ARRIS TECHNOLOGY, INC.; ARCHIE U.S. MERGER LLC; ARCHIE U.S. HOLDINGS LLC; ARRIS GLOBAL SERVICES, INC.; ARRIS HOLDINGS CORP. OF ILLINOIS, INC.; ARRIS SOLUTIONS, INC.; BIG BAND NETWORKS, INC.; TEXSCAN CORPORATION; POWER GUARD, INC.; JERROLD DC RADIO, INC.; NEXTLEVEL SYSTEMS (PUERTO RICO), INC.; GIC INTERNATIONAL HOLDCO LLC; GIC INTERNATIONAL CAPITAL LLC
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 036020/0789 →
MERGER AND CHANGE OF NAME Recorded Mar 10, 2015
From: GENERAL INSTRUMENT CORPORATION; GENERAL INSTRUMENT CORPORATION
To: ARRIS TECHNOLOGY, INC.
Reel/Frame 035176/0620 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2013
From: BAUM, KEVIN L.; ISHTIAQ, FAISAL
To: GENERAL INSTRUMENT CORPORATION
Reel/Frame 030225/0123 →