IP Library Granted Patent US 9,286,517
Granted Patent B2
US 9,286,517 · App. 13/618,867 · Granted Mar 15, 2016

Methods and apparatus to specify regions of interest in video frames

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,286,517
App. No.
13/618,867
Granted
Mar 15, 2016
Kind
B2
Abstract

Methods and apparatus to specify regions of interest in video frames are disclosed. Example disclosed methods to mark a region in a graphical presentation include selecting a first point located at a substantially central position within the region, selecting a plurality of second points to define a boundary of the region, and comparing a plurality of stored templates with the selected first and second points to identify a first one of the stored templates to represent the region.

Claims (57)

1. A method to mark a region in a graphical presentation, the method comprising:

identifying, with a processor, a plurality of user-selected points selected in the graphical presentation with an input device;

determining, with the processor, that the plurality of user-selected points defines a boundary of the region;

responsive to a first user input received prior to or during selection of the plurality of user-selected points with the input device, comparing, with the processor, a plurality of stored templates with the plurality of user-selected points to identify a first one of the stored templates to mark the region; and

displaying, in the graphical presentation, the first one of the stored templates identified by the processor based on the comparing of the plurality of the stored templates with the plurality of user-selected points, prior to the first one of the stored templates being accepted for marking the region.

2. A method as defined in claim 1 , further including:

identifying a subsequent user-selected point in the graphical presentation selected after the first one of the stored templates is identified to mark the region;

reshaping at least a portion of a depiction of the first one of the stored templates in the graphical presentation based on a location of the subsequent user-selected point to determine a reshaped depiction of the first one of the stored templates; and

marking the region in the graphical presentation based on the reshaped depiction of the first one of the stored templates.

3. A method as defined in claim 1 , wherein the comparing of the plurality of stored templates with the plurality of user-selected points occurs in response to a key press detected prior to or during selection of a first one of the plurality of user-selected points.

4. A method as defined in claim 1 , wherein the comparing of the plurality of stored templates with the plurality of user-selected points occurs in response to a selection of a virtual button on a graphical display detected prior to or during selection of a first one of the plurality of user-selected points.

5. A method as defined in claim 1 , wherein the comparing of the plurality of stored templates with the plurality of user-selected points includes:

determining normalized cross-correlations of the plurality of user-selected points with respective ones of the plurality of stored templates; and

identifying a respective one of the plurality of stored templates associated with a largest normalized cross-correlation to be the first one of the stored templates.

6. A method as defined in claim 1 , wherein the first one of the stored templates is identified by the comparing when not all vertices of a polygon bounding the region are included in the plurality of user-selected points.

7. A computer readable storage device or storage disk comprising computer readable instructions which, when executed, cause a computer to at least:

identify a plurality of user-selected points selected in a graphical presentation with an input device;

determine that the plurality of user-selected points defines a boundary of a region to be marked in the graphical presentation;

responsive to a first user input received prior to or during selection of the plurality of user-selected points, compare a plurality of stored templates with the plurality of user-selected points to identify a first one of the stored templates to mark the region; and

display, in the graphical presentation, the first one of the stored templates identified by the computer based on the comparison of the plurality of the stored templates with the plurality of user-selected points, prior to the first one of the stored templates being accepted for marking the region.

8. A storage device or storage disk as defined in claim 7 , wherein the instructions, when executed, further cause the computer to:

identify a subsequent user-selected point in the graphical presentation selected after the first one of the stored templates is identified to mark the region;

reshape at least a portion of a depiction of the first one of the stored templates in the graphical presentation based on a location of the subsequent user-selected point to determine a reshaped depiction of the first one of the stored templates; and

mark the region in the graphical presentation based on the reshaped depiction of the first one of the stored templates.

9. A storage device or storage disk as defined in claim 7 , wherein the instructions, when executed, cause the computer to compare the plurality of stored templates with the plurality of user-selected points in response to a key press detected prior to or during selection of a first one of the plurality of user-selected points.

10. A storage device or storage disk as defined in claim 7 , wherein the instructions, when executed, cause the computer to compare the plurality of stored templates with the plurality of user-selected points in response to a selection of a virtual button on a graphical display detected prior to or during selection of a first one of the plurality of user-selected points.

11. A storage device or storage disk as defined in claim 7 , wherein to compare the plurality of stored templates with the plurality of user-selected points, the instructions, when executed, cause the computer to:

determine normalized cross-correlations of the plurality of user-selected points with respective ones of the plurality of stored templates; and

identify a respective one of the plurality of stored templates associated with a largest normalized cross-correlation to be the first one of the stored templates.

12. A storage device or storage disk as defined in claim 7 , wherein the first one of the stored templates is identified when less than all vertices of a polygon bounding the region are included in the plurality of user-selected points.

13. An apparatus to mark a region in a graphical presentation, the apparatus comprising:

an input device;

a processor to:

identify a plurality of user-selected points selected with the input device in the graphical presentation;

determine that the plurality of user-selected points defines a boundary of the region;

responsive to a first user input received prior to or during selection of the plurality of user-selected points, compare a plurality of stored templates with the plurality of user-selected points to identify a first one of the stored templates to mark the region; and

display, in the graphical presentation, the first one of the stored templates identified by the processor based on the comparison of the plurality of the stored templates with the plurality of user-selected points, prior to the first one of the stored templates being accepted for marking the region; and

memory to store the plurality of stored templates.

14. An apparatus as defined in claim 13 , wherein the processor is further to:

identify a subsequent user-selected point in the graphical presentation selected after the first one of the stored templates is identified to mark the region;

reshape at least a portion of a depiction of the first one of the stored templates in the graphical presentation based on a location of the subsequent user-selected point to determine a reshaped depiction of the first one of the stored templates; and

mark the region in the graphical presentation based on the reshaped depiction of the first one of the stored templates.

15. An apparatus as defined in claim 13 , wherein the processor is to compare the plurality of stored templates with the plurality of user-selected points in response to a key press detected prior to or during selection of a first one of the user-selected plurality of points.

16. An apparatus as defined in claim 13 , wherein the processor is to compare the plurality of stored templates with the plurality of user-selected points in response to a selection of a virtual button detected prior to or during selection of a first one of the plurality of user-selected points, the virtual button included in a graphical user interface presented by the processor.

17. An apparatus as defined in claim 13 , wherein to compare the plurality of stored templates with the plurality of user-selected points, the processor is to:

determine normalized cross-correlations of the plurality of user-selected points with respective ones of the plurality of stored templates; and

identify a respective one of the plurality of stored templates associated with a largest normalized cross-correlation to be the first one of the stored templates to mark the region.

18. An apparatus as defined in claim 13 , wherein the processor is to identify the first one of the stored templates when not all vertices of a polygon bounding the region are included in the plurality of user-selected points.

19. A method as defined in claim 1 , wherein the region is a first region, the plurality of user-selected points is a first plurality of user-selected points, and further including:

comparing the plurality of stored templates with a second plurality of user-selected points to identify a second one of the stored templates to mark a second region in the graphical presentation; and

responsive to a second user input, automatically determining a shape bounding a first set of pixels in the graphical presentation marked by the first one of the stored templates and a second set of pixels in the graphical presentation marked by the second one of the stored templates to mark a third region in the graphical presentation corresponding to a combination of the first region and the second region.

20. A storage device or storage disk as defined in claim 7 , wherein the region is a first region, the plurality of user-selected points is a first plurality of user-selected points, and the instructions, when executed, further cause the computer to:

compare the plurality of stored templates with a second plurality of user-selected points to identify a second one of the stored templates to mark a second region in the graphical presentation; and

responsive to a second user input, automatically determine a shape bounding a first set of pixels in the graphical presentation marked by the first one of the stored templates and a second set of pixels in the graphical presentation marked by the second one of the stored templates to mark a third region in the graphical presentation corresponding to a combination of the first region and the second region.

21. An apparatus as defined in claim 13 , wherein the region is a first region, the plurality of user-selected points is a first plurality of user-selected points, and the processor is further to:

compare the plurality of stored templates with a second plurality of user-selected points to identify a second one of the stored templates to mark a second region in the graphical presentation; and

responsive to a second user input, automatically determine a shape bounding a first set of pixels in the graphical presentation marked by the first one of the stored templates and a second set of pixels in the graphical presentation marked by the second one of the stored templates to mark a third region in the graphical presentation corresponding to a combination of the first region and the second region.

Assignments (11)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
MERGER Recorded Jan 27, 2014
From: NIELSEN MEDIA RESEARCH, LLC (FORMERLY KNOWN AS NIELSEN MEDIA RESEARCH, INC.)
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 032056/0098 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2014
From: DENG, KEVIN; GREENBERG, BARRY
To: NIELSEN MEDIA RESEARCH, INC.
Reel/Frame 032056/0089 →