IP Library › Granted Patent US 12,204,619
Granted Patent B1
US 12,204,619 · App. 17/850,531 · Granted Jan 21, 2025

Multiple input neural networks for detecting fraud

Inventor: Gleb Esman (San Francisco, CA)
Assignee: Cisco Technology, Inc.
G06F21/316G06F21/32G06N3/045G06N3/0464G06N3/082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,204,619
App. No.
17/850,531
Granted
Jan 21, 2025
Kind
B1
Abstract

Embodiments of the present invention set forth a technique for predicting fraud based on multiple inputs including user behavior biometric data along with one or more other parameters associated with the user. The technique includes receiving cursor movement data generated via a client device. The technique further includes generating a image based on the cursor movement data. The technique further includes receiving client parameters generated via the client device. The technique further includes analyzing the image and the client parameters based on a model to generate a prediction result, where the model is generated based on second cursor movement data and a second set of client parameters associated with a first group of one or more users. The technique further includes determining, based on the prediction result, that a user of the client device is not a member of the first group.

Claims (62)

1. A computer-implemented method, comprising:

receiving first cursor movement data representing one or more cursor movements captured via a client device, wherein the first cursor movement data comprises coordinates of a cursor during the one or more cursor movements and at least one of a speed of the cursor or a direction of the cursor at each of the coordinates;

generating a visual depiction of the coordinates of the cursor, including a plurality of image parameters, the plurality of image parameters comprising at least a first image parameter that encodes the speed of the cursor, and a second image parameter that encodes the direction of the cursor;

receiving a first set of client parameters that are associated with the client device;

analyzing the visual depiction and the first set of client parameters using a machine learning model to generate a prediction result, wherein the machine learning model is trained based on second cursor movement data and a second set of client parameters associated with a first group of client devices to identify fraudulent activity; and

generating, based on the prediction result, an output indicating whether the client device is associated with particular activity identified by the second cursor movement data and a second set of client parameters as fraudulent.

2. The computer-implemented method of claim 1 , further comprising:

receiving first log data generated via the client device; and

determining whether the first log data includes a value for a field that does not correspond to a stored value for the field, wherein the stored value corresponds to an account associated with a member of a group of users;

wherein the output is further based on the determination.

3. The computer-implemented method of claim 2 , wherein the determination comprises a determination that the value does not correspond to a parameter, and wherein the output is associated with a preventative action.

4. The computer-implemented method of claim 2 , wherein the value comprises at least one of: a screen resolution, a web browser implemented by the client device, an Internet protocol (IP) address of the client device, a financial transaction, a change to a user address, a change to a password, or a change to a notification preference.

5. The computer-implemented method of claim 2 , wherein:

a first layer of the machine learning model processes the visual depiction to generate an initial output; and

a second layer of the machine learning model processes the initial output and the first set of client parameters to generate the prediction result.

6. The method of claim 5 , wherein the machine learning model comprises a neural network that includes at least one two-dimensional convolutional layer for processing the visual depiction.

7. The method of claim 1 , wherein the machine learning model includes at least one dropout layer that reduces a number of nodes in the machine learning model with non-zero weights by at least 75%.

8. The method of claim 1 , wherein a value related to a first client parameter included in the first set of client parameters is embedded in a filename corresponding to the visual depiction.

9. The method of claim 1 , wherein analyzing the visual depiction and the first set of client parameters comprises processing the visual depiction via a first convolutional layer to generate a first set of weights.

10. The method of claim 1 , wherein analyzing the visual depiction and the first set of client parameters comprises:

processing the visual depiction via a first convolutional layer to generate a first set of weights; and

processing the first set of weights via a pooling layer to generate a second set of weights.

11. The method of claim 1 , wherein analyzing the visual depiction and the first set of client parameters comprises:

processing the visual depiction via a first convolutional layer to generate a first set of weights;

processing the first set of weights via a pooling layer to generate a second set of weights; and

processing the second set of weights via a flattening layer to generate a third set of weights.

12. The method of claim 1 , wherein analyzing the visual depiction and the first set of client parameters comprises:

processing the visual depiction via a first convolutional layer to generate a first set of weights;

processing the first set of weights via a pooling layer to generate a second set of weights;

processing the second set of weights via a flattening layer to generate a third set of weights; and

processing the third set of weights via a dense layer to generate a fourth set of weights.

13. The method of claim 1 , wherein analyzing the visual depiction and the first set of client parameters comprises:

processing the visual depiction via a first convolutional layer to generate a first set of weights;

processing the first set of weights via a pooling layer to generate a second set of weights;

processing the second set of weights via a flattening layer to generate a third set of weights;

processing the third set of weights via a dense layer to generate a fourth set of weights; and

processing the fourth set of weights via a dropout layer to generate a fifth set of weights.

14. The method of claim 1 , wherein the machine learning model includes at least one dense layer that performs at least one of a rectified linear unit (ReLU) activation function or a sigmoid activation function.

15. A fraud prediction system, comprising:

a memory storing a fraud prediction application; and

a processor coupled to the memory, wherein, when executed by the processor, the fraud prediction application configures the processor to:

receiving first cursor movement data representing one or more cursor movements captured via a client device, wherein the first cursor movement data comprises coordinates of a cursor during the one or more cursor movements and at least one of a speed of the cursor or a direction of the cursor at each of the coordinates;

generating a first image based on the first cursor movement data, wherein the first image comprises a visual depiction of the coordinates of the cursor, wherein the first image encodes a plurality of image parameters at each of the coordinates of the cursor, wherein the plurality of image parameters comprises a first image parameter that encodes the speed of the cursor when the cursor is at the coordinates and a second image parameter that encodes the direction of the cursor when the cursor is at the coordinates;

receiving a first set of client parameters that are associated with the client device;

analyzing the first image and the first set of client parameters using a machine learning model to generate a prediction result, wherein the machine learning model is trained based on second cursor movement data and a second set of client parameters associated with a first group of client devices to identify fraudulent activity; and

generating, based on the prediction result, an output indicating whether the client device is associated with particular activity identified by the second cursor movement data and a second set of client parameters as fraudulent.

16. The fraud prediction system of claim 15 , wherein the fraud prediction application further configures the processor to:

receive first log data generated via the client device; and

determine whether the first log data includes a value for a field that does not correspond to a stored value for the field, wherein the stored corresponds to an account associated with a member of a group of users;

wherein the output is further based on the determination.

17. The fraud prediction system of claim 16 , wherein the determination comprises a determination that the value does not correspond to a parameter, and wherein the output is associated with a preventative action.

18. One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

receiving first cursor movement data representing one or more cursor movements captured via a client device, wherein the first cursor movement data comprises coordinates of a cursor during the one or more cursor movements and at least one of a speed of the cursor or a direction of the cursor at each of the coordinates;

generating a first image based on the first cursor movement data, wherein the first image comprises a visual depiction of the one or more cursor movements;

receiving a first set of client parameters that are associated with the client device;

analyzing the first image and the first set of client parameters using a machine learning model to generate a prediction result, wherein the machine learning model is trained using at least a plurality of images generated from second cursor movement data to identify fraudulent activity; and

generating, based at least on the prediction result, an output indicating whether the client device is associated with particular activity identified by the machine learning model as fraudulent.

19. The one or more non-transitory computer-readable storage media of claim 18 , further comprising instruction that, when executed by the one or more processors, further cause the one or more processors to perform the steps of:

receive first log data generated via the client device; and

determine whether the first log data includes a value for a field that does not correspond to a stored value for the field, wherein the stored corresponds to an account associated with a member of a group of users;

wherein the output is further based on the determination.

20. The one or more non-transitory computer-readable storage media of claim 19 , wherein the determination comprises a determination that the value does not correspond to a parameter, and wherein the output is associated with a preventative action.

Assignments (3)
CHANGE OF NAME Recorded Jul 22, 2025
From: SPLUNK INC.
To: SPLUNK LLC
Reel/Frame 072170/0599 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2025
From: SPLUNK LLC
To: CISCO TECHNOLOGY, INC.
Reel/Frame 072173/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2022
From: ESMAN, GLEB
To: SPLUNK INC.
Reel/Frame 060325/0037 →
Continuity (2)
Continuation 15665301 · Jul 31, 2017
Continuation In Part 15731059 · Apr 17, 2017
References Cited (114)
US 7937344B2 · Baum et al. · 2011 [cited by applicant]
US 8112425B2 · Baum et al. · 2012 [cited by applicant]
US 8230009B1 · Wong et al. · 2012 [cited by applicant]
US 8401982B1 · Satish et al. · 2013 [cited by applicant]
US 8606725B1 · Agichtein et al. · 2013 [cited by applicant]
US 8751529B2 · Zhang et al. · 2014 [cited by applicant]
US 8788525B2 · Neels et al. · 2014 [cited by applicant]
US 8826434B2 · Merza · 2014 [cited by applicant]
US 8880441B1 · Chen · 2014 [cited by examiner]
US 8983994B2 · Neels et al. · 2015 [cited by applicant]
US 9053424B1 · Lewis et al. · 2015 [cited by applicant]
US 9124612B2 · Vasen et al. · 2015 [cited by applicant]
US 9128980B2 · Neels et al. · 2015 [cited by applicant]
US 9130971B2 · Vasen et al. · 2015 [cited by applicant]
US 9173801B2 · Merza · 2015 [cited by applicant]
US 9185095B1 · Moritz et al. · 2015 [cited by applicant]
US 9215240B2 · Coates et al. · 2015 [cited by applicant]
US 9248068B2 · Merza · 2016 [cited by applicant]
US 9286413B1 · Coates et al. · 2016 [cited by applicant]
US 9426172B2 · Merza · 2016 [cited by applicant]
US 9432396B2 · Merza · 2016 [cited by applicant]
US 9589012B2 · Neels et al. · 2017 [cited by applicant]
US 10127258B2 · Lamas et al. · 2018 [cited by applicant]
US 10210522B1 · Medina, III et al. · 2019 [cited by applicant]
US 20020130838A1 · Feierbach · 2002 [cited by applicant]
US 20060224898A1 · Ahmed · 2006 [cited by applicant]
US 20070126732A1 · Robertson et al. · 2007 [cited by applicant]
US 20070146393A1 · Feldman et al. · 2007 [cited by applicant]
US 20100082400A1 · Bagherjeiran et al. · 2010 [cited by applicant]
US 20110083108A1 · Klein et al. · 2011 [cited by applicant]
US 20120206490A1 · Hikida · 2012 [cited by applicant]
US 20120328190A1 · Bercovich et al. · 2012 [cited by applicant]
US 20130135339A1 · Saini et al. · 2013 [cited by applicant]
US 20130234937A1 · Abe · 2013 [cited by applicant]
US 20150019537A1 · Neels et al. · 2015 [cited by applicant]
US 20150205957A1 · Turgeman et al. · 2015 [cited by applicant]
US 20150254555A1 · Williams, Jr. et al. · 2015 [cited by applicant]
US 20150310196A1 · Turgeman et al. · 2015 [cited by applicant]
US 20160085986A1 · Long · 2016 [cited by applicant]
US 20160088125A1 · Polychronis · 2016 [cited by applicant]
US 20160234023A1 · Mozer et al. · 2016 [cited by applicant]
US 20160350650A1 · Leeman-Munk et al. · 2016 [cited by applicant]
US 20160360202A1 · Xu et al. · 2016 [cited by applicant]
US 20160371823A1 · Kimura · 2016 [cited by applicant]
US 20160378295A1 · Cousins · 2016 [cited by applicant]
US 20170070521A1 · Bailey et al. · 2017 [cited by applicant]
US 20170070534A1 · Bailey et al. · 2017 [cited by applicant]
US 20170140240A1 · Socher · 2017 [cited by applicant]
US 20170140279A1 · Turgeman · 2017 [cited by applicant]
US 20170193526A1 · Turgeman et al. · 2017 [cited by applicant]
US 20170195356A1 · Turgeman et al. · 2017 [cited by applicant]
US 20170206405A1 · Molchanov et al. · 2017 [cited by applicant]
US 20170221064A1 · Turgeman et al. · 2017 [cited by applicant]
US 20170243223A1 · Kolotinsky · 2017 [cited by examiner]
US 20170322637A1 · Cheng · 2017 [cited by applicant]
US 20170353482A1 · Sommer · 2017 [cited by applicant]
US 20180012003A1 · Asulin et al. · 2018 [cited by applicant]
US 20180032835A1 · Shirahata · 2018 [cited by applicant]
US 20180068430A1 · Sang et al. · 2018 [cited by applicant]
US 20180189056A1 · Turakhia et al. · 2018 [cited by applicant]
US 20180211157A1 · Liu et al. · 2018 [cited by applicant]
US 20180218283A1 · Jenson · 2018 [cited by applicant]
US 20190098106A1 · Mungel et al. · 2019 [cited by applicant]
US 20190228268A1 · Zhang et al. · 2019 [cited by applicant]
JP H10207441A · 1998 [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,098 dated Feb. 6, 2024, 53 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,098 Dated Dec. 9, 2022, 40 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 17/162,906 dated Jan. 5, 2023, 52 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/731,104 Dated Oct. 8, 2019, 3 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/731,098 Dated Nov. 21, 2019, 3 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/731,098 dated May 3, 2022, 13 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 17/162,906 dated Aug. 25, 2022, 79 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/162,906 dated Jun. 12, 2023, 34 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,098 dated Jul. 21, 2023, 48 pages. [cited by applicant]
Garvin et al., “Automated 3-D Intraretinal Layer Segmentation of Macular Spectral-Domain Optical Coherence Tomography Images”, IEEE Transactions on Medical Imaging, DOI 10.1109/TML20092016958, vol. 28, No. 9, Sep. 2009,… [cited by applicant]
Pivot Manual, Splunk Enterprise 6.1.3, Aug. 4, 2014, 30 pages. [cited by applicant]
Knowledge Manager Manual, Build a Data Model, Splunk Enterprise 6.1.3, Aug. 25, 2014, pp. 150-204. [cited by applicant]
Canziani et al., “An Analysis of Deep Neural Network Models For Practical Applications” Apr. 14, 2017, pp. 1-7. [cited by applicant]
Khashman et al., “Image Compression Using Neural Networks and Haar Wavelet”, WSEAS Transactions on Signal Processing, Issue 5, vol. 4, May 2008, pp. 330-339. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,098 dated Mar. 8, 2019, 47 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,098 dated Sep. 6, 2019, 40 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,098 dated Nov. 16, 2020, 50 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,098 dated May 7, 2021, 60 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/731,098 dated May 13, 2020, 37 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/665,301, dated Apr. 2, 2021, 55 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,104 dated Mar. 8, 2019, 56 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,104 dated Jul. 25, 2019, 47 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,104 dated Apr. 14, 2020, 50 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/731,104 dated Sep. 28, 2020, 79 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/731,104 dated Apr. 30, 2021, 75 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,059, dated Nov. 18, 2019, 66 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,059, dated May 22, 2020, 51 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/665,301, dated Sep. 24, 2020, 88 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,059, dated Nov. 10, 2020, 61 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,059, dated Jun. 3, 2021, 64 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/665,301, dated Jun. 18, 2021, 13 pages. [cited by applicant]
Splunk Enterprise 8.0.0 Overview, available online, retrieved on May 20, 2020 from docs.splunk.com, 17 pages. [cited by applicant]
Splunk Cloud 8.0.2004 User Manual, available online, retrieved on May 20, 2020 from docs.splunk.com, 66 pages. [cited by applicant]
Splunk Quick Reference Guide, updated 2019, available online at https://www.splunk.com/pdfs/solution-guides/splunk-quick-reference-guide.pdf, retrieved on May 20, 2020, 6 pages. [cited by applicant]
Carraso, David, “Exploring Splunk,” published by CITO Research, New York, NY, Apr. 2012, 156 pages. [cited by applicant]
Bitincka et al., “Optimizing Data Analysis with a Semi-structured Time Series Database,” self-published, first presented at “Workshop on Managing Systems via Log Analysis and Machine Learning Techniques (SLAML)”, Vancou… [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/731,059, dated Sep. 21, 2021, 5 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/665,301, dated Dec. 27, 2021, 17 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/731,059, dated Dec. 16, 2021, 15 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,098 Dated Dec. 9, 2021, 37 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/731,098 dated Jul. 26, 2021, 9 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/665,301, dated Feb. 16, 2022, 9 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/731,059, dated Sep. 22, 2020, 3 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/731,059, dated Sep. 21, 2021, 3 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 15/731,098 dated Jul. 3, 2024, 60 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 15/731,098 dated May 1, 2024, 4 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,098 dated May 5, 2023, 49 pages. [cited by applicant]
Advisory Action received for U.S. Appl. No. 17/162,906 dated Mar. 16, 2023, 3 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 15/731,098 dated Dec. 3, 2024, 55 pages. [cited by applicant]