IP Library Granted Patent US 11,409,826
Granted Patent B2
US 11,409,826 · App. 16/729,416 · Granted Aug 9, 2022

Deep learning machine vision to analyze localities for comparative spending analyses

Inventors: Prakash Sridharan (Bangalore, IN); Arun Swamy (Bangalore, IN); Sumant Sahoo (Bangalore, IN); Ravi Shukla (Bangalore, IN); Ramakanth Kanagovi (Bangalore, IN)
Assignee: Dell Products L.P.
G06F16/9537G06F16/906G06N3/08G06Q30/0201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,409,826
App. No.
16/729,416
Granted
Aug 9, 2022
Kind
B2
Abstract

A system, method, and computer-readable storage medium are disclosed that execute machine vision operations to categorize a locality. At least one embodiment accesses a map image of a locality, where the map image includes geographical artefacts corresponding to entities within the locality; analyzes the map image to detect the entities in the locality using the geographical artefacts; assigns entity classes to detected entities in the locality; assigns a locality score to the locality based on entity classes included in the locality; retrieves street view images for one or more of the detected entities in the locality; and analyzes street view images of the detected entities to assign one or more further classifications to the detected entities. Other embodiments include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the method.

Claims (96)

1. A computer-implemented method for using machine vision to categorize a locality to conduct comparative spending analyses, the method comprising:

assigning locality profile scores to a plurality of localities based on entity classes included in the localities, wherein the locality profile scores are derived through neural network analyses of map images for the localities;

grouping localities having similar locality profile scores into separate locality groups;

extracting entities in a locality group;

retrieving historical data for entities in the locality group;

grouping spending of the entities in the locality group by product areas;

ranking spending of the entities in the locality group; and

providing the spending per product area of the entities and ranks of the spending of the entities in the locality group for a comparative spending analysis.

2. The computer-implemented method of claim 1 , wherein grouping localities having similar locality profile scores comprises:

determining a Euclidean distance metric between locality profile scores of the plurality of localities; and

grouping localities having a Euclidean distance metric below a predetermined threshold.

3. The computer-implemented method of claim 1 , wherein grouping localities having similar locality profile scores comprises:

determining a Manhattan distance metric between locality profile scores of the plurality of localities; and

grouping localities having a Manhattan distance metric below a predetermined threshold.

4. The computer-implemented method of claim 1 , wherein

entities within a group are divided into one or more subgroups based on entity identification data in the historical data.

5. The computer-implemented method of claim 1 , further comprising:

accessing a map image of a locality, wherein the map image includes geographical artefacts corresponding to entities within the locality;

analyzing the map image to detect the entities in the locality using the geographical artefacts;

assigning entity classes to detected entities in the locality; and

assigning the locality profile score to the locality based on entity classes included in the locality.

6. The computer-implemented method of claim 5 , wherein

analyzing the map image includes

providing the map image to a neural network, wherein the neural network is configured to separate portions of the map image having geographical artefacts from portions of the map image that do not have geographical artefacts;

reconstructing the map image using the portions of the map image having geographical artefacts;

detecting entities in the reconstructed map using the geographical artefacts;

identifying entity classes of the detected entities by accessing a database for the locality to identify entities using textual portions of the reconstructed map image;

wherein assigning a locality profile score includes

clustering entities with similar entity classes within the locality, wherein each cluster has a cluster type corresponding to the entity classes within the cluster; and

assigning a locality profile score to the locality based on the clustered entities within the locality.

7. The computer-implemented method of claim 6 , wherein

locality profile scores are assigned to the locality using a percentage based analysis, wherein a percentage is assigned to each cluster type based on a number of entities included in the cluster type with respect to a total number of clustered entities.

8. A system comprising:

a processor;

a data bus coupled to the processor; and

a non-transitory, computer-readable storage medium embodying computer program code, the non-transitory, computer-readable storage medium being coupled to the data bus, the computer program code interacting with a plurality of computer operations and comprising instructions executable by the processor and configured for:

assigning locality profile scores to a plurality of localities based on entity classes included in the localities, wherein the locality profile scores are derived through neural network analyses of map images for the localities;

grouping localities having similar locality profile scores into separate locality groups;

extracting entities in a locality group;

retrieving historical data for entities in the locality group;

grouping spending of the entities in the locality group by product areas;

ranking spending of the entities in the locality group; and

providing the spending per product area of the entities and ranks of the spending of the entities in the locality group for a comparative spending analysis.

9. The system of claim 8 , wherein grouping localities having similar locality profile scores comprises:

determining a Euclidean distance metric between locality profile scores of the plurality of localities; and

grouping localities having a Euclidean distance metric below a predetermined threshold.

10. The system of claim 8 , wherein grouping localities having similar locality profile scores comprises:

determining a Manhattan distance metric between locality profile scores of the plurality of localities; and

grouping localities having a Manhattan distance metric below a predetermined threshold.

11. The system of claim 8 , wherein

entities within a group are divided into one or more subgroups based on entity identification data in the historical data.

12. The system of claim 8 , wherein the instructions are further configured for:

accessing a map image of a locality, wherein the map image includes geographical artefacts corresponding to entities within the locality;

analyzing the map image to detect the entities in the locality using the geographical artefacts;

assigning entity classes to detected entities in the locality; and

assigning the locality profile score to the locality based on entity classes included in the locality.

13. The system of claim 12 , wherein

analyzing the map image includes

providing the map image to a neural network, wherein the neural network is configured to separate portions of the map image having geographical artefacts from portions of the map image that do not have geographical artefacts;

reconstructing the map image using the portions of the map image having geographical artefacts;

detecting entities in the reconstructed map using the geographical artefacts;

identifying entity classes of the detected entities by accessing a database for the locality to identify entities using textual portions of the reconstructed map image;

wherein assigning a locality profile score includes

clustering entities with similar entity classes within the locality, wherein each cluster has a cluster type corresponding to the entity classes within the cluster; and

assigning a locality profile score to the locality based on the clustered entities within the locality.

14. The system of claim 13 , wherein

locality profile scores are assigned to the locality using a percentage based analysis, wherein a percentage is assigned to each cluster type based on a number of entities included in the cluster type with respect to a total number of clustered entities.

15. A non-transitory, computer-readable storage medium embodying computer program code, the computer program code comprising computer executable instructions configured for:

assigning locality profile scores to a plurality of localities based on entity classes included in the localities, wherein the locality profile scores are derived through neural network analyses of map images for the localities;

grouping localities having similar locality profile scores into separate locality groups;

extracting entities in a locality group;

retrieving historical data for entities in the locality group;

grouping spending of the entities in the locality group by product areas;

ranking spending of the entities in the locality group; and

providing the spending per product area of the entities and ranks of the spending of the entities in the locality group for a comparative spending analysis.

16. The non-transitory, computer-readable storage medium of claim 15 , wherein grouping localities having similar locality profile scores comprises:

determining a Euclidean distance metric between locality profile scores of the plurality of localities; and

grouping localities having a Euclidean distance metric below a predetermined threshold.

17. The non-transitory, computer-readable storage medium of claim 15 , wherein grouping localities having similar locality profile scores comprises:

determining a Manhattan distance metric between locality profile scores of the plurality of localities; and

grouping localities having a Manhattan distance metric below a predetermined threshold.

18. The non-transitory, computer-readable storage medium of claim 15 , wherein entities within a group are divided into one or more subgroups based on entity identification data in the historical data.

19. The non-transitory, computer-readable storage medium of claim 15 , wherein the instructions are further configured for:

accessing a map image of a locality, wherein the map image includes geographical artefacts corresponding to entities within the locality;

analyzing the map image to detect the entities in the locality using the geographical artefacts;

assigning entity classes to detected entities in the locality; and

assigning the locality profile score to the locality based on entity classes included in the locality.

20. The non-transitory, computer-readable storage medium of claim 19 , wherein

analyzing the map image includes

providing the map image to a neural network, wherein the neural network is configured to separate portions of the map image having geographical artefacts from portions of the map image that do not have geographical artefacts;

reconstructing the map image using the portions of the map image having geographical artefacts;

detecting entities in the reconstructed map using the geographical artefacts;

identifying entity classes of the detected entities by accessing a database for the locality to identify entities using textual portions of the reconstructed map image;

wherein assigning a locality profile score includes

clustering entities with similar entity classes within the locality, wherein each cluster has a cluster type corresponding to the entity classes within the cluster; and

assigning a locality profile score to the locality based on the clustered entities within the locality.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052216/0758) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0680 →
RELEASE OF SECURITY INTEREST AF REEL 052243 FRAME 0773 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0152 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 26, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052243/0773 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Mar 24, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052216/0758 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2019
From: SRIDHARAN, PRAKASH; SWAMY, ARUN; SAHOO, SUMANT; SHUKLA, RAVI; KANAGOVI, RAMAKANTH
To: DELL PRODUCTS L.P.
Reel/Frame 051382/0608 →