IP Library Granted Patent US 10,740,118
Granted Patent B1
US 10,740,118 · App. 15/429,917 · Granted Aug 11, 2020

Monitoring mobile device usage

Inventors: Thomas F. Pottjegort (Ashburn, VA); Michael A. Brown (Ashburn, VA)
Assignee: comScore, Inc.
G06F9/451G06F3/04817G06F11/3089G06F11/3438G06K9/18G06K9/6202G06K9/6215G06T7/74H04L67/22G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,740,118
App. No.
15/429,917
Granted
Aug 11, 2020
Kind
B1
Abstract

A first image of a mobile device screen is recorded into memory of the mobile device. The first image includes at least one icon that represents an application installed on the mobile device. A second image of the mobile device screen is recorded into the memory of the mobile device. A graphical change in an area of the mobile device screen corresponding to a position of the icon is detected by comparing at least a portion of the second image to the first image. The graphical change results from a user selection of the icon to activate the application represented by the icon. In response to detecting the graphical change, determine an identifier of the application represented by the icon. Send a record of the user selection of the icon to a collection server. The record includes at least the identifier of the application.

Claims (40)

1. A method for determining user interaction with applications on a mobile device, the method comprising:

recording a first image of a mobile device screen at a first time, the first image including a first area with an icon that represents an application installed on the mobile device;

recording a second image of the mobile device screen at a second time that is after the first time, the second image including a second area with the icon that represents the application installed on the mobile device, the second area being the same as the first area in the mobile device screen;

recording a third image of the mobile device screen at a third time that is after the second time;

detecting a change in brightness between the first area and the second area by comparing pixels of the second area to pixels of the first area, the change in brightness resulting from a user selection of the icon to activate the application represented by the icon;

in response to detection of the change in brightness, determining an identifier of the application represented by the icon;

determining that the third image corresponds to a type of screen that is displayed when applications are no longer displayed on the mobile device; and

determining a duration that the application represented by the icon was displayed based on the difference between the third time and the second time.

2. The method of claim 1 , further comprising:

creating a first hash of the pixels in the first area of the first image; and

creating a second hash of the pixels in the second area of the second image.

3. The method of claim 1 , wherein determining the identifier of the application represented by the icon comprises determining machine-encoded text based on graphical text located at a defined position relative to the icon.

4. The method of claim 1 , further comprising:

recording a fourth image of the mobile device screen;

detecting a characteristic of a web browser in the fourth image; and

in response to detection of the characteristic of the web browser, determining a uniform resource locator corresponding to a web page displayed by the web browser.

5. The method of claim 4 , wherein determining the uniform resource locator corresponding to the web page displayed by the web browser comprises performing optical character recognition on graphical text located at a defined position relative to the characteristic of the web browser.

6. The method of claim 1 , further comprising:

recording a fourth image of the mobile device screen; and

detecting an advertisement visible on the mobile device in the fourth image.

7. A system for determining user interaction with applications on a mobile device, the system comprising at least one processor and at least one memory storing a software application that causes the mobile device or a collection server to:

record a first image of a mobile device screen at a first time, the first image including a first area with an icon that represents an application installed on the mobile device;

record a second image of the mobile device screen at a second time that is after the first time, the second image including a second area with the icon that represents the application installed on the mobile device, the second area being the same as the first area in the mobile device screen;

record a third image of the mobile device screen at a third time that is after the second time;

detect a change in brightness between the first area and the second area by comparing pixels of the second area to pixels of the first area, the change in brightness resulting from a user selection of the icon to activate the application represented by the icon;

in response to detection of the change in brightness, determine an identifier of the application represented by the icon;

determine that the third image corresponds to a type of screen that is displayed when applications are no longer displayed on the mobile device; and

determine a duration that the application represented by the icon was displayed based on the difference between the third time and the second time.

8. The system of claim 7 , wherein the software application causes the mobile device to:

create a first hash of the pixels in the first area of the first image; and

create a second hash of the pixels in the second area of the second image.

9. The system of claim 7 , wherein to determine the identifier of the application represented by the icon, the software application causes the mobile device to determine machine-encoded text based on graphical text located at a defined position relative to the icon.

10. The system of claim 7 , wherein the software application causes the mobile device to:

record a fourth image of the mobile device screen;

detect a characteristic of a web browser in the fourth image; and

in response to detection of the characteristic of the web browser, determine a uniform resource locator corresponding to a web page displayed by the web browser.

11. The system of claim 10 , wherein to determine the uniform resource locator corresponding to the web page displayed by the web browser, the software application causes the mobile device to perform optical character recognition on graphical text located at a defined position relative to the characteristic of the web browser.

12. The system of claim 7 , wherein the software application causes the mobile device to:

record a fourth image of the mobile device screen; and

detect an advertisement visible on the mobile device in the fourth image.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jun 2, 2026
From: BLUE TORCH FINANCE LLC
To: COMSCORE, INC.; PROXIMIC, LLC; RENTRAK, LLC (F/N/A RENTRAK CORPORATION)
Reel/Frame 075679/0830 →
RELEASE OF SECURITY INTEREST Recorded Jan 16, 2025
From: BANK OF AMERICA, N.A.
To: COMSCORE, INC.
Reel/Frame 069934/0573 →
SECURITY INTEREST Recorded Jan 3, 2025
From: COMSCORE, INC.; PROXIMIC, LLC; RENTRAK, LLC
To: BLUE TORCH FINANCE LLC
Reel/Frame 069818/0446 →
CORRECTIVE ASSIGNMENT TO CORRECT THE MISSING ASSIGNMENT PAGE 1 AND 22 OMITTED PATENTS PREVIOUSLY RECORDED AT REEL: 056547 FRAME: 0526. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jun 6, 2022
From: STARBOARD VALUE AND OPPORTUNITY MASTER FUND LTD.
To: COMSCORE, INC.; RENTRAK CORPORATION; PROXIMIC, LLC
Reel/Frame 060922/0001 →
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded May 6, 2021
From: COMSCORE, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 057279/0767 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Mar 25, 2021
From: STARBOARD VALUE AND OPPORTUNITY MASTER FUND LTD.
To: COMSCORE, INC.; RENTRAK CORPORATION; PROXIMIC, LLC
Reel/Frame 056547/0526 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2018
From: POTTJEGORT, THOMAS F.; BROWN, MICHAEL A.
To: COMSCORE, INC.
Reel/Frame 045452/0514 →
ASSIGNMENT FOR SECURITY - PATENTS Recorded Jan 16, 2018
From: COMSCORE, INC.; RENTRAK CORPORATION; PROXIMIC, LLC
To: STARBOARD VALUE AND OPPORTUNITY MASTER FUND LTD.
Reel/Frame 045077/0303 →
Continuity (1)
Provisional Application 62293502 · Feb 10, 2016
Cited By (1)
US 12,306,740