IP Library Granted Patent US 8,806,006
Granted Patent B2
US 8,806,006 · App. 13/250,623 · Granted Aug 12, 2014

Methods and apparatus for nonintrusive monitoring of web browser usage

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,806,006
App. No.
13/250,623
Granted
Aug 12, 2014
Kind
B2
Abstract

An example system disclosed herein comprises a web browser monitor to extract textual information from a captured image comprising at least a portion of content displayed by a web browser implemented by a monitored device, and determine color scheme information for a region of the captured image comprising at least a portion of the content displayed by the web browser. The example system also comprises a central processing facility to process the extracted textual information received from the web browser monitor, and compare the color scheme information received from the web browser monitor to reference color schemes associated with reference web pages to determine web sites accessed using the web browser.

Claims (47)

1. A system to monitor Internet usage, the system comprising:

a web browser monitor to:

extract textual information from a captured image representative of a web page displayed by a web browser implemented by a monitored device; and

determine color scheme information for a region of the captured image comprising at least a portion of the web page displayed by the web browser, the color scheme information for the region of the captured image being represented by a histogram corresponding to respective numbers of pixels in the region having respective different colors displayed in the region; and

a computer processor to compare the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

2. A system as defined in claim 1 wherein the web browser monitor is to perform optical character recognition to extract first textual information corresponding to at least one of a uniform resource locator (URL) or a title associated with the web page presented by the web browser.

3. A system as defined in claim 1 wherein the web browser monitor is to process the captured image by performing a graphical recognition operation to extract a second region of the captured image characteristic of at least one of an address bar or a title bar of the web browser, and the web browser monitor is to extract the textual information from the extracted second region.

4. A system as defined in claim 1 wherein the web browser monitor is to determine the color scheme information by:

extracting color values of pixels included in the region of the captured image; and

determining the histogram using the color values.

5. A system as defined in claim 1 wherein the web browser monitor is to determine the color scheme information by:

extracting color values of pixels included in the region of the captured image;

discarding ones of the color values associated with one or more colors determined to be non-distinctive; and

determining the histogram using the color values remaining after the discarding of the ones of the color values.

6. A system as defined in claim 1 wherein the web browser monitor is to report the color scheme information and the textual information to the computer processor, and the computer processor is to identify the web site based on the color scheme information and the textual information.

7. A method to monitor web browsing, the method comprising:

extracting textual information from a captured image representative of a web page displayed by a web browser implemented by a monitored device;

determining color scheme information for a region of the captured image comprising at least a portion of the web page displayed by the web browser, the color scheme information for the region of the captured image including a histogram representing respective numbers of pixels in the region having respective different colors displayed in the region; and

comparing, with a processor, the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

8. A method as defined in claim 7 wherein extracting the textual information further comprises performing optical character recognition to extract first textual information from the captured image corresponding to at least one of a uniform resource locator (URL) or a title associated with the web page presented by the web browser.

9. A method as defined in claim 7 wherein extracting the textual information further comprises:

performing a graphical recognition operation to extract a second region of the captured image that is characteristic of at least one of an address bar or a title bar of the web browser; and

extracting the textual information from the extracted second region.

10. A method as defined in claim 7 further comprising:

extracting color values of pixels included in the region of the captured image; and

determining the histogram using the color values to determine the color scheme information.

11. A method as defined in claim 7 further comprising:

extracting color values of pixels included in the region of the captured image;

discarding ones of the color values respectively associated with corresponding colors determined to be non-distinctive; and

determining the histogram using the color values remaining after the discarding of the ones of the color values.

12. A method as defined in claim 7 further comprising identifying the web site based on the color scheme information and the textual information.

13. A tangible machine readable storage device or storage disk comprising machine readable instructions which, when executed, cause a machine to at least:

extract textual information from a captured image representative of a web page displayed by a web browser implemented by a monitored device;

determine color scheme information for a region of the captured image comprising at least a portion of the web page displayed by the web browser, the color scheme information for the region of the captured image being formatted as a histogram representing respective numbers of pixels in the region having respective different colors displayed in the region; and

compare the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

14. A tangible machine readable storage device or storage disk as defined in claim 13 wherein to extract the textual information, the machine readable instructions, when executed, further cause the machine to perform optical character recognition to extract first textual information from the captured image corresponding to at least one of a uniform resource locator (URL) or a title associated with the web page presented by the web browser.

15. A tangible machine readable storage device or storage disk as defined in claim 13 wherein to extract the textual information, the machine readable instructions, when executed, further cause the machine to:

perform a graphical recognition operation to extract a second region of the captured image that is characteristic of at least one of an address bar or a title bar of the web browser; and

extract the textual information from the extracted second region.

16. A tangible machine readable storage device or storage disk as defined in claim 13 wherein the machine readable instructions, when executed, further cause the machine to:

extract color values of pixels included in the region of the captured image; and

determine the histogram using the color values to determine the color scheme information.

17. A tangible machine readable storage device or storage disk as defined in claim 13 wherein the machine readable instructions, when executed, further cause the machine to:

extract color values of pixels included in the region of the captured image;

discard ones of the color values respectively associated with corresponding colors determined to be non-distinctive; and

determine the histogram using the color values remaining after the ones of the color values are discarded.

18. A tangible machine readable storage device or storage disk as defined in claim 13 wherein the machine readable instructions, when executed, further cause the machine to identify the web site based on the color scheme information and the textual information.

Assignments (10)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2011
From: LEE, MORRIS
To: THE NIELSEN COMPANY (US), INC., A NEW YORK CORPORATION
Reel/Frame 027241/0898 →