IP Library Granted Patent US 8,090,822
Granted Patent B2
US 8,090,822 · App. 12/181,841 · Granted Jan 3, 2012

Methods and apparatus for nonintrusive monitoring of web browser usage

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,090,822
App. No.
12/181,841
Granted
Jan 3, 2012
Kind
B2
Abstract

Methods and apparatus for nonintrusive monitoring of web browser usage are disclosed. An example method for monitoring web browsing disclosed herein comprises obtaining a video signal from a video output of a device implementing a web browser, processing a video image obtained from the video signal to identify a region of the video image displaying at least a portion of the web browser, determining textual information displayed by the web browser in the identified region of the video image, and using the textual information to record usage of the web browser.

Claims (41)

1. A method for monitoring web browsing, the method comprising:

obtaining a video signal from a video output of a device implementing a web browser;

performing graphical recognition processing on a video image obtained from the video signal to extract an image region less than the entire video image, the extracted image region displaying at least a portion of the web browser, the portion of the web browser including at least a portion of an address bar;

performing textual recognition processing to determine textual information displayed in the portion of the address bar included in the extracted image region of the video image; and

using the textual information to record usage of the web browser.

2. A method as defined in claim 1 wherein the image region extracted from the video image is a rectangular region including at least the portion of the address bar of the web browser.

3. A method as defined in claim 2 wherein the rectangular region is a first rectangular region and the method further comprises performing graphical recognition processing on the video image to extract a second rectangular region including at least a portion of a title bar of the web browser.

4. A method as defined in claim 3 wherein performing textual recognition processing further comprises performing optical character recognition to determine at least a portion of a title corresponding to a web page displayed by the web browser.

5. A method as defined in claim 1 wherein using the textual information to record usage of the web browser comprises determining a URL represented by at least a portion of the textual information.

6. A method as defined in claim 5 wherein the determined URL corresponds to a web page processed by the web browser.

7. A method as defined in claim 5 further comprising reporting the determined URL to a central processing facility, the central processing facility to process the URL to determine a web site corresponding to a web page processed by the web browser.

8. A method as defined in claim 1 wherein the address bar is to display at least a portion of a uniform resource locator (URL) corresponding to a web page displayed by the web browser.

9. A method as defined in claim 1 wherein the graphical recognition processing comprises at least one of edge detection, corner detection or blob detection.

10. A method as defined in claim 1 wherein performing textual recognition processing comprises performing optical character recognition to determine at least a portion of a URL or a numeric Internet protocol address corresponding to a web page displayed by the web browser.

11. A method as defined in claim 1 wherein obtaining the video signal from the video output of the device comprises splitting a video connection coupling the video output with a display device.

12. An apparatus to monitor Internet usage, the apparatus comprising:

a video interface, implemented by at least one of hardware or a combination of hardware and at least one of software or firmware, to accept a video signal from a device implementing a web browser;

a graphical recognition processor to extract a rectangular image region that is a subset of a video image of the video signal, the extracted rectangular image region having an image characteristic corresponding to a presentation of at least a portion of an address bar of the web browser included in the video image;

a textual recognition processor to extract uniform resource locator (URL) information included in the extracted rectangular image region; and

a network interface to report the extracted URL information to a central processing facility to track usage of the web browser.

13. An apparatus as defined in claim 12 wherein the extracted rectangular image region is a first extracted rectangular image region, and the graphical recognition processor is further to extract a second rectangular image region from the video image, the second extracted rectangular image region having an image characteristic corresponding to a presentation of at least a portion of a title bar of the web browser displayed in the video image of the video signal.

14. An apparatus as defined in claim 13 wherein the textual recognition processor is further to extract title information included in the second extracted rectangular image region.

15. An apparatus as defined in claim 12 wherein the video interface comprises a video splitter to split the video signal into a first video signal and a second video signal, wherein the first video signal is provided to the video interface and the second video signal is provided to a display.

16. An apparatus as defined in claim 12 wherein the network interface is to report the extracted title information to the central processing facility.

17. An apparatus as defined in claim 12 wherein the network interface is to interface with an access network providing network connectivity for the device implementing the web browser.

18. An apparatus as defined in claim 12 wherein the network interface is to interface with a first access network different from a second access network providing network connectivity for the device implementing the web browser.

19. An apparatus as defined in claim 12 further comprising a video interface activity detector to indicate whether an active video signal has been applied to the video interface.

20. An apparatus to monitor Internet usage, the apparatus comprising:

a video interface to accept a video signal from a device implementing a web browser, wherein the video interface comprises a camera positioned to capture video images associated with a display of the device implementing the web browser to generate the video signal;

a graphical recognition processor to extract a rectangular image region that is a subset of a video image of the video signal, the extracted rectangular image region having an image characteristic corresponding to a presentation of at least a portion of an address bar of the web browser included in the video image;

a textual recognition processor to extract uniform resource locator (URL) information included in the extracted rectangular image region; and

a network interface to report the extracted URL information to a central processing facility to track usage of the web browser.

21. An apparatus to monitor Internet usage, the apparatus comprising:

a video interface, implemented by at least one of hardware or a combination of hardware and at least one of software or firmware, to accept a video signal from a device implementing a web browser;

a graphical recognition processor to extract a rectangular image region that is a subset of a video image of the video signal, the extracted rectangular image region having an image characteristic corresponding to a presentation of at least a portion of an address bar of the web browser included in the video image, wherein the graphical recognition processor is to:

determine whether the rectangular image region has a first image characteristic corresponding to the rectangular image region having a light solid background and a high aspect ratio;

determine whether the rectangular image region has a second image characteristic corresponding to the rectangular image region being located below a second rectangular region having a dark solid background;

determine whether the rectangular image region has a third image characteristic corresponding to the rectangular image region being located above a third rectangular region; and

extract the rectangular image region from the video image when the rectangular image region is determined to have the first, second and third image characteristics;

a textual recognition processor to extract uniform resource locator (URL) information included in the extracted rectangular image region; and

a network interface to report the extracted URL information to a central processing facility to track usage of the web browser.

Assignments (12)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
CHANGE OF NAME Recorded Oct 26, 2009
From: NIELSEN COMPANY (U.S.), INC., THE, A NEW YORK CORPORATION
To: TNC (US) HOLDING, INC., A NEW YORK CORPORATION
Reel/Frame 023429/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2009
From: TNC (US) HOLDINGS, INC.
To: NIELSEN COMPANY (US), LLC, THE
Reel/Frame 023426/0885 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2008
From: LEE, MORRIS
To: THE NIELSEN COMPANY (US), INC., A NEW YORK CORPORATION
Reel/Frame 021381/0071 →