IP Library Granted Patent US 9,602,371
Granted Patent B2
US 9,602,371 · App. 14/330,655 · Granted Mar 21, 2017

Methods and apparatus for nonintrusive monitoring of web browser usage

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,602,371
App. No.
14/330,655
Granted
Mar 21, 2017
Kind
B2
Abstract

Example methods disclosed herein for monitoring web browsing include processing a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser. Disclosed example methods also include tagging first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text. Disclosed example methods further include reporting the tagged first textual information to determine usage of the web browser.

Claims (49)

1. A method for monitoring web browsing, the method comprising:

processing, by executing an instruction with a processor, a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser;

tagging, by executing an instruction with the processor, first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text; and

reporting the tagged first textual information to determine usage of the web browser.

2. The method as defined in claim 1 , further including:

identifying a second image region of the video image having a second shape corresponding to a title bar of the web browser;

tagging second textual information identified in the second image region as corresponding to a title of the web page displayed by the web browser in response to determining that the second image region has a first position relative to the first image region; and

reporting the tagged first textual information and the tagged second textual information to determine usage of the web browser.

3. The method as defined in claim 2 , wherein tagging the second textual information includes tagging the second textual information identified in the second image region as corresponding to the title of the web page displayed by the web browser in response to determining that the second image region is positioned above the first image region.

4. The method as defined in claim 2 , further including:

tagging the first image region as corresponding to the address bar of the web browser; and

tagging the second image region as corresponding to the title bar of the web browser.

5. The method as defined in claim 1 , wherein the reference string of text corresponds to at least one of: (1) a uniform resource locator (URL) scheme, (2) a start of a URL, (3) a domain suffix, (4) a sequence of at least two strings of text separated by one or more periods, or (5) a numeric internet protocol (IP) address format.

6. A tangible computer readable storage device or storage disk comprising computer readable instructions which, when executed, cause a computing device to at least:

process a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser;

tag first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text; and

report the tagged first textual information to determine usage of the web browser.

7. The storage device or storage disk as defined in claim 6 , wherein the instructions, when executed, further cause the computing device to:

identify a second image region of the video image having a second shape corresponding to a title bar of the web browser;

tag second textual information identified in the second image region as corresponding to a title of the web page displayed by the web browser in response to determining that the second image region has a first position relative to the first image region; and

report the tagged first textual information and the tagged second textual information to determine usage of the web browser.

8. The storage device or storage disk as defined in claim 7 , wherein the instructions, when executed, further cause the computing device to tag the second textual information identified in the second image region as corresponding to the title of the web page displayed by the web browser in response to determining that the second image region is positioned above the first image region.

9. The storage device or storage disk as defined in claim 7 , wherein the instructions, when executed, further cause the computing device to:

tag the first image region as corresponding to the address bar of the web browser; and

tag the second image region as corresponding to the title bar of the web browser.

10. The storage device or storage disk as defined in claim 6 , wherein the reference string of text corresponds to at least one of: (1) a uniform resource locator (URL) scheme, (2) a start of a URL, (3) a domain suffix, (4) a sequence of at least two strings of text separated by one or more periods, or (5) a numeric internet protocol (IP) address format.

11. An apparatus for monitoring web browsing, the apparatus comprising:

a computer processor;

a graphical recognition processor to process a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser;

a textual recognition processor to tag first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text; and

a network interface report the tagged first textual information to determine usage of the web browser, at least one of the graphical recognition processor, the textual recognition processor or the network interface being implemented by the computer processor.

12. The apparatus as defined in claim 11 , wherein:

the graphical recognition processor is further to identify a second image region of the video image having a second shape corresponding to a title bar of the web browser;

the textual recognition processor is further to tag second textual information identified in the second image region as corresponding to a title of the web page displayed by the web browser in response to determining that the second image region has a first position relative to the first image region; and

the network interface is further to report the tagged first textual information and the tagged second textual information to determine usage of the web browser.

13. The apparatus as defined in claim 12 , wherein the textual recognition processor is further to tag the second textual information identified in the second image region as corresponding to the title of the web page displayed by the web browser in response to determining that the second image region is positioned above the first image region.

14. The apparatus as defined in claim 12 , wherein the textual recognition processor is further to:

tag the first image region as corresponding to the address bar of the web browser; and

tag the second image region as corresponding to the title bar of the web browser.

15. The apparatus as defined in claim 11 , wherein the reference string of text corresponds to at least one of: (1) a uniform resource locator (URL) scheme, (2) a start of a URL, (3) a domain suffix, (4) a sequence of at least two strings of text separated by one or more periods, or (5) a numeric internet protocol (IP) address format.

16. A method to monitor web browsing, the method comprising:

determining, by executing an instruction with a processor, color scheme information for a region of a captured image including at least a portion of a web page displayed by a web browser implemented by a monitored device, the color scheme information including a histogram representative of respective numbers of pixels in the region having respective colors from a set of colors of interest; and

comparing, by executing an instruction with the processor, the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

17. A tangible computer readable storage device or storage disk comprising computer readable instructions which, when executed, cause a computing device to at least:

determine color scheme information for a region of a captured image including at least a portion of a web page displayed by a web browser implemented by a monitored device, the color scheme information including a histogram representative of respective numbers of pixels in the region having respective colors from a set of colors of interest; and

compare the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

18. An apparatus to monitor web browsing, the apparatus comprising:

means for determining color scheme information for a region of a captured image including at least a portion of a web page displayed by a web browser implemented by a monitored device, the color scheme information including a histogram representative of respective numbers of pixels in the region having respective colors from a set of colors of interest; and

means for comparing the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

Assignments (12)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
CHANGE OF NAME Recorded Oct 23, 2014
From: THE NIELSEN COMPANY (US), INC.
To: TNC (US) HOLDINGS, INC., A NEW YORK CORPORATION
Reel/Frame 034036/0687 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2014
From: TNC (US) HOLDINGS, INC., A NEW YORK CORPORATION
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 034017/0883 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2014
From: LEE, MORRIS
To: THE NIELSEN COMPANY (US), INC.
Reel/Frame 033980/0605 →