IP Library Granted Patent US 9,037,694
Granted Patent B2
US 9,037,694 · App. 11/935,598 · Granted May 19, 2015

Method and system for determining the geographic location of a network block

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,037,694
App. No.
11/935,598
Granted
May 19, 2015
Kind
B2
Abstract

Described herein are a method and a system to assign geographic locations to network blocks. A particular embodiment of the system includes a set of intermediate assignment generators, each intermediate assignment generator being associated with at least one of a plurality of network data sources, each intermediate assignment generator being configured to generate an intermediate assignment for at least one of the plurality of network data sources, a set of classifiers each coupled to at least one of the intermediate assignment generators, each classifier being associated with at least one of the plurality of network data sources, each classifier being configured to generate at least one classification based on at least one of the intermediate assignments and corresponding training data, and an intermediate assignment selector to select a best intermediate assignment based on the classifications generated by the set of classifiers, the best intermediate assignment corresponding to a geographic location of a network block.

Claims (39)

1. A method of assigning a geographic location to a network block comprising:

obtaining geo-location data from a plurality of network data sources;

generating, for each data source, intermediate assignments associated with a network block, each intermediate assignment corresponding to geo-location assignment of the network block based on at least one of the network data sources;

generating a plurality of feature vectors, each feature vector including a plurality of attributes associated with a different network data source of the plurality of network data sources, a value for a particular attribute of the plurality of attributes representing a degree to which that attribute is present or absent in a corresponding network data source of the plurality of network data sources;

classifying and/or regressing each intermediate assignment using the plurality of feature vectors to generate classifications and/or regressions based on training data, the classifications being a mapping from a discrete or continuous feature space to a discrete set of labels, the training data including a set of feature vectors and corresponding desired outputs for each of the feature vectors of the set of feature vectors; and

determining a geographic location of the network block based upon at least one of the intermediate assignment classifications and/or regressions.

2. The method of claim 1 wherein the intermediate assignment classifications are selected from a group including a correct classification and an incorrect classification, the method including generating an error rate estimate and/or expected error for each intermediate assignment classified as correct and using the error rate estimate and/or expected error in the determination of the geographic location.

3. The method of claim 2 wherein the determined geographic location is associated with a lowest error rate estimate among the intermediate assignment classifications.

4. The method of claim 1 including providing a plurality of intermediate assignment generators, each being associated with at least one data source.

5. The method of claim 4 including providing a plurality of classifiers, each being associated with at least one of the plurality of intermediate assignment generators.

6. The method of claim 1 wherein the values for a particular attribute include values from the group: real number and a discrete item.

7. The method of claim 1 wherein the plurality of network data sources are selected from a group including: a location of the registry information for a network, hand mapped assignments, a location assignment from a hostname label, a top level domain of a country, a complete traceroute, an incomplete traceroute, and a previous assignment associated with the network block.

8. The method of claim 1 wherein the geographic location is assigned on a country level, a state level, a city level, a zip code level, and/or a specific coordinate level.

9. The method of claim 1 including using supervised learning techniques to classify and/or regress each intermediate assignment to generate classifications and or regressions based on training data.

10. The method of claim 1 wherein the determined geographic location of the network block is based upon an interpolation between at least two of the intermediate assignment classifications and/or regressions.

11. A network block geo-locator system comprising:

a set of intermediate assignment generators, each intermediate assignment generator being associated with at least one of a plurality of network data sources, each intermediate assignment generator being configured to generate an intermediate assignment for at least one of the plurality of network data sources, the intermediate assignment corresponding to geo-location assignment of a network block based on the at least one network data source;

a feature vector generator to generate a plurality of feature vectors, each feature vector including a plurality of attributes associated with a different network data source of the plurality of network data sources, a value for a particular attribute of the plurality of attributes representing a degree to which that attribute is present or absent in a corresponding network data source of the plurality of network data sources;

a set of classifiers each coupled to the feature vector generator and at least one of the intermediate assignment generators, each classifier being associated with at least one of the plurality of network data sources, each classifier being configured to generate at least one classification and/or regression based on the plurality of feature vectors and at least one of the intermediate assignments and corresponding training data, the classification being a mapping from a discrete or continuous feature space to a discrete set of labels, the training data including a set of feature vectors and corresponding desired outputs for each of the feature vectors of the set of feature vectors; and

an intermediate assignment generator to determine a geographic location of the network block based on the at least one classification and/or regression generated by the set of classifiers.

12. The network block geo-locator system of claim 11 wherein the classifications are selected from a group including a correct classification and an incorrect classification, the set of classifiers being further configured to generate an error rate estimate and/or expected error for each intermediate assignment classified as correct and using the error rate estimate and/or expected error in the determination of the geographic location of the network block.

13. The network block geo-locator system of claim 11 wherein the determined geographic location of a network block is associated with a lowest error rate estimate among the intermediate assignment classifications.

14. The network block geo-locator system of claim 11 wherein the values for a particular attribute include values from the group: real number and a discrete item.

15. The network block geo-locator system of claim 11 wherein the plurality of network data sources are selected from a group including: a location of the registry information for a network, hand mapped assignments, a location assignment from a hostname label, a top level domain of a country, a complete traceroute, an incomplete traceroute, and a previous assignment associated with the network block.

16. The network block geo-locator system of claim 11 wherein the geographic location includes information associated with a country level, a state level, a city level, a zip code level, and/or a specific coordinate level.

17. The network block geo-locator system of claim 11 wherein the determined geographic location of the network block is based upon an interpolation between at least two of the intermediate assignment classifications and/or regressions.

18. An article of manufacture comprising a non-transitory machine-readable storage medium having machine executable instructions embedded thereon, which when executed by a machine, cause the machine to:

obtain geo-location data from a plurality of network data sources;

generate, for each data source, intermediate assignments associated with a network block, each intermediate assignment corresponding to geo-location assignment of the network block based on at least one of the network data sources;

generating a plurality of feature vectors, each feature vector including a plurality of attributes associated with a different network data source of the plurality of network data sources, a value for a particular attribute of the plurality of attributes representing a degree to which that attribute is present or absent in a corresponding network data source of the plurality of network data sources;

classify and/or regress each intermediate assignment using the plurality of feature vectors to generate classifications and/or regressions based on training data, the classifications being a mapping from a discrete or continuous feature space to a discrete set of labels, the training data including a set of feature vectors and corresponding desired outputs for each of the feature vectors of the set of feature vectors; and

determine a geographic location of the network block based upon at least one of the intermediate assignment classifications and/or regressions.

19. The article of manufacture of claim 18 wherein the intermediate assignment classifications are selected from a group including a correct classification and an incorrect classification, the article of manufacture being further configured to generate an error rate estimate and/or expected error for each intermediate assignment classified as correct and using the error rate estimate and/or expected error in the determination of the geographic location.

20. The article of manufacture of claim 19 wherein the determined geographic location is associated with a lowest error rate estimate among the intermediate assignment classifications.

21. The article of manufacture of claim 18 being further configured to provide a plurality of intermediate assignment generators, each being associated with at least one data source.

22. The article of manufacture of claim 21 being further configured to provide a plurality of classifiers, each being associated with at least one of the plurality of intermediate assignment generators.

23. The article of manufacture of claim 18 wherein the values for a particular attribute include values from the group: real number and a discrete item.

24. The article of manufacture of claim 18 wherein the plurality of network data sources are selected from a group including: a location of the registry information for a network, hand mapped assignments, a location assignment from a hostname label, a top level domain of a country, a complete traceroute, an incomplete traceroute, and a previous assignment associated with the network block.

25. The article of manufacture of claim 18 wherein the geographic location is assigned on a country level, a state level, a city level, a zip code level, and/or a specific coordinate level.

Assignments (14)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 16/990,698 PREVIOUSLY RECORDED ON REEL 058294 FRAME 0010. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 21, 2022
From: TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR DATA SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 059846/0157 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 058294, FRAME 0161 Recorded Dec 27, 2021
From: JPMORGAN CHASE BANK, N.A.
To: EBUREAU, LLC; IOVATION, INC.; SIGNAL DIGITAL, INC.; TRANS UNION LLC; TRANSUNION INTERACTIVE, INC.; TRANSUNION RENTAL SCREENING SOLUTIONS, INC.; TRANSUNION TELEDATA LLC; AGGREGATE KNOWLEDGE, LLC; TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
Reel/Frame 058593/0852 →
SECOND LIEN PATENT SECURITY AGREEMENT RELEASE Recorded Dec 3, 2021
From: UBS AG, STAMFORD BRANCH
To: NEUSTAR, INC.; MARKETSHARE PARTNERS LLC; AGGREGATE KNOWLEDGE, INC.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR IP INTELLIGENCE, INC.
Reel/Frame 058300/0739 →
FIRST LIEN PATENT SECURITY AGREEMENT RELEASE Recorded Dec 3, 2021
From: BANK OF AMERICA, N.A.
To: NEUSTAR, INC.; MARKETSHARE PARTNERS LLC; AGGREGATE KNOWLEDGE, INC.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR IP INTELLIGENCE, INC.
Reel/Frame 058300/0762 →
GRANT OF SECURITY INTEREST IN PATENT RIGHTS Recorded Dec 1, 2021
From: TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR DATA SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 058294/0010 →
GRANT OF SECURITY INTEREST IN UNITED STATES PATENTS Recorded Dec 1, 2021
From: EBUREAU, LLC; IOVATION, INC.; SIGNAL DIGITAL, INC.; TRANS UNION LLC; TRANSUNION HEALTHCARE, INC.; TRANSUNION INTERACTIVE, INC.; TRANSUNION RENTAL SCREENING SOLUTIONS, INC.; TRANSUNION TELEDATA LLC; AGGREGATE KNOWLEDGE, LLC; TRU OPTIK DATA CORP.; NEUSTAR INFORMATION SERVICES, INC.; TRUSTID, INC.; NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; MARKETSHARE PARTNERS, LLC; SONTIQ, INC.
To: JPMORGAN CHASE BANK, N.A
Reel/Frame 058294/0161 →
SECURITY INTEREST Recorded Aug 22, 2017
From: MARKETSHARE PARTNERS LLC; AGGREGATE KNOWLEDGE, INC.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR IP INTELLIGENCE, INC.; NEUSTAR, INC.
To: BANK OF AMERICA, N.A.
Reel/Frame 043633/0440 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Aug 22, 2017
From: MARKETSHARE PARTNERS LLC; AGGREGATE KNOWLEDGE, INC.; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR IP INTELLIGENCE, INC.; NEUSTAR, INC.
To: UBS AG, STAMFORD BRANCH
Reel/Frame 043633/0527 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2017
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; ULTRADNS CORPORATION; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR DATA SERVICES, INC.; AGGREGATE KNOWLEDGE, INC.; MARKETSHARE ACQUISITION CORPORATION; MARKETSHARE HOLDINGS, INC.; MARKETSHARE PARTNERS, LLC
Reel/Frame 043618/0826 →
CHANGE OF NAME Recorded Mar 1, 2013
From: QUOVA, INC.
To: NEUSTAR IP INTELLIGENCE, INC.
Reel/Frame 029905/0138 →
RELEASE OF SECURITY INTEREST Recorded Feb 13, 2013
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NEUSTAR, INC.; TARGUS INFORMATION CORPORATION; QUOVA, INC.; ULTRADNS CORPORATION; AMACAI INFORMATION CORPORATION; MUREX LICENSING CORPORATION
Reel/Frame 029809/0177 →
SECURITY AGREEMENT Recorded Feb 13, 2013
From: NEUSTAR, INC.; NEUSTAR IP INTELLIGENCE, INC.; ULTRADNS CORPORATION; NEUSTAR INFORMATION SERVICES, INC.; NEUSTAR DATA SERVICES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 029809/0260 →
SECURITY AGREEMENT Recorded Jan 10, 2012
From: NEUSTAR, INC.; TARGUS INFORMATION CORPORATION; QUOVA, INC; ULTRADNS CORPORATION; AMACAI INFORMATION CORPORATION; MUREX LICENSING CORPORATION
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 027512/0119 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2009
From: WINKLER, ADAM
To: QUOVA, INC.
Reel/Frame 022521/0080 →