IP Library Granted Patent US 11,941,792
Granted Patent B2
US 11,941,792 · App. 17/226,305 · Granted Mar 26, 2024

Machine learning-based analysis of computing device images included in requests to service computing devices

Inventors: Benjamin Fauber (Austin, TX); Lee Saeugling (Austin, TX)
Assignee: Dell Products L.P.
G06T7/0002G06F18/214G06F18/22G06F18/24G06N3/04G06N3/08G06T2207/20072G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,941,792
App. No.
17/226,305
Granted
Mar 26, 2024
Kind
B2
Abstract

An apparatus comprises a processing device configured to receive a service request for a given computing device, the service request comprising a given image of a given computing device, to generate a given image embedding for the given image utilizing a machine learning model, and to determine similarity measures between the given image embedding and other image embeddings for other images of computing devices utilizing an angular similarity metric. The processing device is configured to identify whether the given image exhibits at least a threshold level of similarity to at least one other image based at least in part on the determined similarity measures, to classify the given image as potentially fraudulent responsive to identifying the given image as exhibiting at least the threshold level of similarity to at least one other image, and to modify processing of the service request responsive to classifying the given image as potentially fraudulent.

Claims (41)

1. An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;

the at least one processing device being configured to perform steps of:

receiving a service request for a given computing device, the service request comprising a given image of the given computing device, the given image comprising user identifying information for a user submitting the service request for the given computing device;

generating, utilizing a machine learning model, a given image embedding for the given image;

determining similarity measures between the given image embedding for the given image and one or more other image embeddings for one or more other images of computing devices utilizing an angular similarity metric;

identifying whether the given image exhibits at least a threshold level of similarity to at least one of the one or more other images based at least in part on the determined similarity measures;

classifying the given image as potentially fraudulent responsive to identifying the given image as exhibiting at least the threshold level of similarity to said at least one of the one or more other images; and

modifying processing of the service request responsive to classifying the given image as potentially fraudulent.

2. The apparatus of claim 1 wherein the given image further comprises device identifying information for the given computing device.

3. The apparatus of claim 2 wherein the device identifying information for the given computing device comprises at least a portion of at least one of a serial number and a product tag of the given computing device.

4. The apparatus of claim 2 wherein classifying the given image as potentially fraudulent comprises determining that at least one of the device identifying information and the user identifying information in the given image comprises a modification of at least one of device identifying information and user identifying information in said at least one of the one or more other images.

5. The apparatus of claim 1 wherein the machine learning model comprises a convolutional neural network, the convolutional neural network comprising one or more convolutional layers, one or more pooling layers, and a fully connected layer.

6. The apparatus of claim 5 wherein the given image embedding for the given image comprises a normalized representation of an output of the fully connected layer.

7. The apparatus of claim 6 wherein the output of the fully connected layer of the machine learning model is subject to dimensionality reduction prior to normalization to produce the given image embedding for the given image.

8. The apparatus of claim 1 wherein the machine learning model is trained utilizing a contrastive loss function that determines similarity between pairs of images in a training data set, the pairs of images in the training data set comprising two or more copies of at least one image having different image transforms applied thereto.

9. The apparatus of claim 1 wherein the angular similarity metric comprises a cosine similarity metric.

10. The apparatus of claim 1 wherein the at least one processing device is further configured to perform the step of generating a graph network of a plurality of images comprising the given image and the one or more other images, the graph network comprising nodes representing respective ones of the plurality of images and edges connecting pairs of images in the plurality of images, the edges being created based at least in part on the determined similarity measures.

11. The apparatus of claim 10 wherein determining the similarity measures between the given image embedding for the given image and the one or more other image embeddings for one or more other images of computing devices utilizing the angular similarity metric comprises generating a similarity matrix having entries comprising the similarity measures.

12. The apparatus of claim 11 wherein identifying the given image as exhibiting at least the threshold level of similarity to said at least one of the one or more other images based at least in part on the determined similarity measures comprises applying a thresholding filter to the similarity matrix to produce an adjacency matrix, the adjacency matrix having entries comprising values defining the edges of the graph network.

13. The apparatus of claim 10 wherein the at least one processing device is further configured to perform the step of detecting one or more clusters of images in the plurality of images by applying one or more community detection algorithms to the graph network.

14. The apparatus of claim 13 wherein the one or more community detection algorithms comprise a Louvain community detection algorithm.

15. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform steps of:

receiving a service request for a given computing device, the service request comprising a given image of the given computing device, the given image comprising user identifying information for a user submitting the service request for the given computing device;

generating, utilizing a machine learning model, a given image embedding for the given image;

determining similarity measures between the given image embedding for the given image and one or more other image embeddings for one or more other images of computing devices utilizing an angular similarity metric;

identifying whether the given image exhibits at least a threshold level of similarity to at least one of the one or more other images based at least in part on the determined similarity measures;

classifying the given image as potentially fraudulent responsive to identifying the given image as exhibiting at least the threshold level of similarity to said at least one of the one or more other images; and

modifying processing of the service request responsive to classifying the given image as potentially fraudulent.

16. The computer program product of claim 15 wherein the given image further comprises device identifying information for the given computing device.

17. The computer program product of claim 16 wherein classifying the given image as potentially fraudulent comprises determining that at least one of the device identifying information and the user identifying information in the given image comprises a modification of at least one of device identifying information and user identifying information in said at least one of the one or more other images.

18. A method comprising steps of:

receiving a service request for a given computing device, the service request comprising a given image of the given computing device, the given image comprising user identifying information for a user submitting the service request for the given computing device;

generating, utilizing a machine learning model, a given image embedding for the given image;

determining similarity measures between the given image embedding for the given image and one or more other image embeddings for one or more other images of computing devices utilizing an angular similarity metric;

identifying whether the given image exhibits at least a threshold level of similarity to at least one of the one or more other images based at least in part on the determined similarity measures;

classifying the given image as potentially fraudulent responsive to identifying the given image as exhibiting at least the threshold level of similarity to said at least one of the one or more other images; and

modifying processing of the service request responsive to classifying the given image as potentially fraudulent;

wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

19. The method of claim 18 wherein the given image further comprises device identifying information for the given computing device.

20. The method of claim 19 wherein classifying the given image as potentially fraudulent comprises determining that at least one of the device identifying information and the user identifying information in the given image comprises a modification of at least one of device identifying information and user identifying information in said at least one of the one or more other images.

Assignments (10)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0280) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0255 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0124) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0012 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0001) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062021/0844 →
RELEASE OF SECURITY INTEREST Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058297/0332 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0124 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0001 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE MISSING PATENTS THAT WERE ON THE ORIGINAL SCHEDULED SUBMITTED BUT NOT ENTERED PREVIOUSLY RECORDED AT REEL: 056250 FRAME: 0541. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 17, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056311/0781 →
SECURITY AGREEMENT Recorded May 14, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056250/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2021
From: FAUBER, BENJAMIN; SAEUGLING, LEE
To: DELL PRODUCTS L.P.
Reel/Frame 055875/0501 →
Continuity (1)
Related Publication 20220327678A1 · Oct 13, 2022