IP Library Granted Patent US 10,984,518
Granted Patent B2
US 10,984,518 · App. 16/422,636 · Granted Apr 20, 2021

Methods and systems for assessing the quality of geospatial data

Inventors: Paul Braun (Middleton, WI); Daniel Frye (New Glarus, WI); David Hart (Sun Prairie, WI)
Assignee: Continental Mapping Consultants, LLC
G06T7/0002G06K9/00476G06T7/11G06T2207/20021G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,984,518
App. No.
16/422,636
Granted
Apr 20, 2021
Kind
B2
Abstract

Methods and systems for evaluating the quality of a geospatial data set are provided. Regions of a data set may be selected for review based on statistical methods and a distribution of map features in the data set. Based on errors identified in the selected regions, one or more quality scores may be generated for the data set. Quality scores may be applied toward assessing the utility of the data set against an intended use. Quality scores may be modified in response to an indication that certain feature classes are not relevant for an intended use of the data set. Information associated with the review of a data set may be tracked and stored.

Claims (52)

1. A method for identifying geospatial data for quality review, comprising:

receiving a geospatial data set representing a geographic area, wherein the geospatial data set comprises data representing a plurality of map features, and wherein the plurality of map features is associated with one or more feature classes;

determining a value for map features in the geospatial data set; and

selecting one or more regions in the geospatial data set for review, wherein selecting one or more regions in the geospatial data set for review comprises:

dividing the geospatial data set into a plurality of regions;

determining a value for map features in each region;

determining a probability score for each region based on the value for map features in the region and the value for features in the geospatial data set; and

selecting one or more regions for review based on the probability scores, wherein a number of selected regions is based on a value for map features in the one or more selected regions reaching a threshold value.

2. The method of claim 1 , comprising identifying one or more feature class categories, wherein a feature class category comprises one or more feature classes of interest.

3. The method of claim 1 , comprising outputting one or more review areas, wherein the one or more review areas comprise data representing the selected regions.

4. The method of claim 3 , comprising evaluating the one or more review areas, wherein evaluating the one or more review areas comprises identifying one or more errors in the selected regions.

5. The method of claim 4 , wherein evaluating the one or more review areas comprises storing error information associated with an identified error.

6. The method of claim 5 , wherein error information comprises a feature class of the identified error.

7. The method of claim 5 , wherein error information comprises a description of the identified error.

8. The method of claim 5 , wherein error information comprises a location of the identified error.

9. The method of claim 4 , wherein evaluating the one or more review areas comprises storing evaluation information associated with an evaluation.

10. The method of claim 9 , wherein evaluation information comprises an identity of a reviewer.

11. The method of claim 9 , wherein evaluation information comprises an amount time spent reviewing the data for review.

12. The method of claim 9 , wherein evaluation information comprises an amount of time spent reviewing a selected region.

13. The method of claim 4 , comprising receiving one or more evaluated review areas, wherein the one or more evaluated review areas comprise one or more identified errors in the selected regions.

14. The method of claim 13 , comprising determining a quality score for the geospatial data set based on the reviewed data.

15. The method of claim 14 , comprising receiving a target quality score for the geospatial data set.

16. The method of claim 15 , comprising:

in accordance with a determination that the quality score is greater than or equal to the target quality score, indicating that the quality score is greater than or equal to the target quality score; and

in accordance with a determination that the quality score is less than the target quality score; indicating that the quality score is less than the target quality score.

17. The method of claim 13 , comprising determining a quality score for the one or more feature class categories.

18. The method of claim 1 , wherein determining a probability score for a region comprises determining a z-score of the region based on the value for map features in each region.

19. The method of claim 1 , wherein selecting one or more regions for review based on the probability scores is based on a weighted random selection, wherein the weighted random selection is based on the probability scores of the regions.

20. The method of claim 1 , wherein determining a quality score is based on a value for map features in the one or more selected regions, the value for map features in the geospatial data set, and a quantity of errors associated with one or more map features in the selected regions.

21. The method of claim 3 , wherein outputting one or more review areas comprises generating a second data set, wherein the second data set comprises data corresponding to the one or more selected regions.

22. The method of claim 1 , wherein the method is at an electronic device.

23. An electronic system, comprising:

one or more processors;

one or more memories; and

one or more programs, wherein the one or more programs are stored in the one or more memories and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving a geospatial data set representing a geographic area, wherein the geospatial data set comprises data representing a plurality of map features, and wherein the plurality of map features is associated with one or more feature classes;

determining a value for map features in the geospatial data set; and

selecting one or more regions in the geospatial data set for review, wherein selecting one or more regions in the geospatial data set for review comprises:

dividing the geospatial data set into a plurality of regions;

determining a value for map features in each region;

determining a probability score for each region based on the value for map features in the region and the value for map features in the geospatial data set; and

selecting one or more regions for review based on the probability scores, wherein a number of selected regions is based on a value for map features in the one or more selected regions reaching a threshold value.

24. The system of claim 23 , wherein a user provides the geospatial data set from a client computer.

25. The system of claim 24 , wherein the system is located remotely from the client computer.

26. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic system, cause the system to:

receive a geospatial data set representing a geographic area, wherein the geospatial data set comprises data representing a plurality of map features, and wherein the plurality of map features is associated with one or more feature classes;

determine a value for map features in the geospatial data set; and

select one or more regions in the geospatial data set for review, wherein selecting one or more regions in the geospatial data set for review comprises:

dividing the geospatial data set into a plurality of regions;

determining a value for map features in each region;

determining a probability score for each region based on the value for map features in the region and the value for map features in the geospatial data set; and

selecting one or more regions for review based on the probability scores, wherein a number of selected regions is based on a value for map features in the one or more selected regions reaching a threshold value.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Feb 24, 2023
From: ROUTE 2 CAPITAL PARTNERS SBIC, L.P., AS INVESTOR
To: AXIM GEOSPATIAL, LLC (F/K/A CONTINENTAL MAPPING CONSULTANTS, LLC); CONTINENTAL MAPPING ACQUISITION CORP.; TSG SOLUTIONS, INC.; DELPHI RESEARCH, INC.; GEOGRAPHIC INFORMATION SERVICES, INC.; GEOPIPHANY, LLC; GISIP, LLC
Reel/Frame 062798/0855 →
RELEASE OF SECURITY INTEREST Recorded Feb 24, 2023
From: EAGLEBANK
To: CONTINENTAL MAPPING ACQUISITION CORP.; AXIM GEOSPATIAL, LLC (F/K/A CONTINENTAL MAPPING CONSULTANTS, LLC)
Reel/Frame 062800/0532 →
CHANGE OF NAME Recorded Apr 20, 2022
From: CONTINENTAL MAPPING CONSULTANTS, LLC
To: AXIM GEOSPATIAL, LLC
Reel/Frame 059711/0649 →
CHANGE OF NAME Recorded Mar 25, 2022
From: CONTINENTAL MAPPING CONSULTANTS, LLC
To: AXIM GEOSPATIAL, LLC
Reel/Frame 060199/0310 →
SECURITY INTEREST Recorded Jan 29, 2021
From: CONTINENTAL MAPPING ACQUISITION CORP.; CONTINENTAL MAPPING CONSULTANTS, LLC; GEOGRAPHIC INFORMATION SERVICES, INC.; GEOPIPHANY, LLC; GISIP, LLC; TSG SOLUTIONS, INC.; DELPHI RESEARCH, INC.
To: ROUTE 2 CAPITAL PARTNERS SBIC, L.P., AS INVESTOR
Reel/Frame 055082/0022 →
SECURITY INTEREST Recorded Mar 12, 2020
From: CONTINENTAL MAPPING ACQUISITION CORP.; CONTINENTAL MAPPING CONSULTANTS, LLC
To: EAGLEBANK
Reel/Frame 052095/0226 →
ENTITY CONVERSION Recorded Mar 3, 2020
From: CONTINENTAL MAPPING CONSULTANTS, INC.
To: CONTINENTAL MAPPING CONSULTANTS, LLC
Reel/Frame 052078/0972 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2020
From: BRAUN, PAUL; FRYE, DANIEL; HART, DAVID
To: CONTINENTAL MAPPING CONSULTANTS, INC.
Reel/Frame 051826/0295 →
Continuity (1)
Related Publication 20200372624A1 · Nov 26, 2020