IP Library Patent Application 12789493
Patent Application
App. No. 12/789,493

TRAINED PREDICTIVE SERVICES TO INTERDICT UNDESIRED WEBSITE ACCESSES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
12/789,493
Abstract

Webcrawlers and scraper bots are detrimental because they place a significant processing burden on web servers, corrupt traffic metrics, use excessive bandwidth, excessively load web servers, create spam, cause ad click fraud, encourage unauthorized linking, deprive the original collector/poster of the information of exclusive rights to analysis and summarize information posted on their own site, and enable anyone to create low-cost Internet advertising network products for ultimate sellers. A scaleable predictive service distributed in the cloud can be used to detect scraper activity in real time and take appropriate interdictive access up to and including denial of service based on the likelihood that non-human agents are responsible for accesses. Information gathered from a number of servers can be aggregated to provide real time interdiction protecting a number of disparate servers in a network.

Claims (33)

1 . In a computer arrangement connected to a network, said computer arrangement allowing access by other computers over the network, a method of reducing the impact of undesired server accesses comprising:

(a) monitoring accesses to at least one server;

(b) analyzing said monitored accesses based at least in part on a classifier predictive model, to predict the likelihood that accesses are being made by non-human agents; and

(c) if said analyzing predicts that monitored accesses are possibly being made by non-human agents, performing at least one interdiction action in substantially real time response to said predicted likelihood.

2 . The method of claim 1 wherein said monitoring is performed on a first server to develop said predictive model, and said performing is performed on a second server different from said first server to interdict upon recognizing that said non-human agent is attacking said second server.

3 . The method of claim 1 wherein said monitoring is performed substantially in real time.

4 . The method of claim 1 wherein said interdiction action comprises one of the set consisting of (a) logging of the client's information, (b) introducing an investigative ‘bug’ or ‘tag’ via javascript onto subsequent page requests, (c) introducing a significant change in page content or page structure, (d) imposing a limitation on requests/second, (e) introducing a ‘web tracking device’ or hidden content into the page's content that can be uniquely identified via a search engine, (f) displaying a page requiring human interpretation and action, (g) displaying a page displayed requesting registration or alternative means of identification, and (h) denial of access.

5 . The method of claim 1 wherein said interdiction action comprises imposing a burden on predicted non-human agents that are not imposed on humans.

6 . The method of claim 1 further including training the classifier predictive model based on historical information obtained from previous website accesses.

7 . The method of claim 6 wherein said training is based on historical information gathered from plural different websites.

8 . A computer system for allowing access to at least one server over a network while reducing the impact of undesired server accesses, comprising:

a network connection;

at least one server connected to the network connection;

a monitoring appliance that monitors accesses to the at least one server substantially in real time;

said monitoring appliance including means for analyzing said monitored accesses based at least in part on a classifier predictive model, to predict the likelihood that accesses are initiated by non-human agents; and

means for automatically selecting at least one interdiction action based on said likelihood.

9 . A data processing system comprising:

a machine learning component that uses historical access data to train a predictive model; and

at least one online predictive service device coupled to a host website, said predictive service device operating in accordance with said trained predictive model, said predictive service device using said trained predictive model to predict whether an access(es) to the host website is made by other than a human operating a web browser and in response to a prediction that the access(es) is made by other than a human operating a web browser, changes the manner in which the host website responds to said access(es).

10 . A website monitoring service comprising:

at least one predictive model trained on historical data;

plural predictive service devices associated with plural corresponding websites, said predictive service devices performing online monitoring of said associated corresponding websites and reporting monitoring results; and

a centralized database in communication with said plural predictive service devices, said centralized database using said reported results to further train said predictive model,

wherein said plural predictive service devices predict undesired accesses to said associated corresponding websites and recommend interdiction.

11 . The service of claim 10 wherein said predictive service devices detect non-human agent accesses as undesired accesses.

12 . A website monitoring service comprising:

at least one predictive model trained on historical data at least some of which was collected before said monitoring service is instituted on a given server;

plural monitoring computers associated with plural corresponding servers, said monitoring computers performing online monitoring of said associated corresponding servers and reporting monitoring results over a computer network;

a distributed predictive modeling agent in communication with said plural monitoring computers, said distributed predictive modeling agent using said reported results to further train said predictive model,

wherein said distributed predictive modeling agent predicts undesired accesses to monitored servers and recommends interdiction, and

wherein said monitoring and interdiction recommending is offered on a fee basis to operators of said servers, and information said predictive modeling agent harvests from a first server is used to predict or detect undesired accesses of a second server different from said first server.

13 . The service of claim 12 wherein said at least some of said servers comprise web servers.

14 . The service of claim 12 wherein said undesired accesses include page scraping.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Apr 10, 2014
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: AUTOTRADER.COM, INC.; KELLEY BLUE BOOK CO., INC.; CDMDATA, INC.; VAUTO, INC.
Reel/Frame 032658/0418 →
SECURITY AGREEMENT Recorded Dec 21, 2010
From: AUTOTRADER.COM, INC., A DELAWARE CORPORATION; KELLEY BLUE BOOK CO., INC., A CALIFORNIA CORPORATION; CDMDATA, INC., A MINNESOTA CORPORATION; VAUTO, INC., A DELAWARE CORPORATION
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 025528/0258 →
PATENT RELEASE - 06/14/2010, REEL 24533 AND FRAME 0319; 10/18/2010, REEL 025151 AND FRAME 0684 Recorded Dec 17, 2010
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: AUTOTRADER.COM, INC., A DELAWARE CORPORATION; VAUTO, INC., A DELAWARE CORPORATION
Reel/Frame 025523/0428 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2010
From: ROBINSON, TONY; ROBINSON, STEPHEN R.; BURSON, ROB
To: AUTOTRADER.COM, INC.
Reel/Frame 025470/0893 →
SECURITY AGREEMENT Recorded Jun 14, 2010
From: AUTOTRADER.COM, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 024533/0319 →