IP Library Granted Patent US 10,291,646
Granted Patent B2
US 10,291,646 · App. 15/720,064 · Granted May 14, 2019

System and method for audio fingerprinting for attack detection

Inventors: Damien Phelan Stolarz (Los Angeles, CA); Johanna Dwyer (Brookline, MA); Ronald J. Pollack (Clearwater, FL)
Assignee: Telepathy Labs, Inc.
H04L63/1441G06N3/084G06N5/043G06N99/005G10L15/26G10L15/265H04L63/10H04L63/1408H04L63/1416H04L63/1425H04L63/1483H04L67/306H04W12/08H04W12/12H04W4/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,291,646
App. No.
15/720,064
Granted
May 14, 2019
Kind
B2
Abstract

A method, computer program product, and computer system directed toward identification of potential social engineering activity associated with at least a portion of a communication on a communication channel based upon, at least in part, a match between a first set of audio features with a second set of one or more audio features. The first set of one or more audio features are extracted from at least a portion of a communication on a communication channel. The first set of one or more audio features from at least a portion of the communication are compared to a second set of one or more audio features to determine that at least a portion of the first set of audio features matches the second set of one or more audio features.

Claims (29)

1. A computer-implemented method comprising:

extracting, by a computing device, a first set of one or more audio features from at least a portion of a real-time communication on a communication channel, wherein extracting the first set of one or more audio features includes at least one of generating an audio fingerprint of at least the portion of the real-time communication on the communication channel and transcribing at least the portion of the real-time communication on the communication channel;

comparing the first set of one or more audio features from at least the portion of the real-time communication to a second set of one or more audio features from at least a portion of a previous real-time communication;

determining that at least a portion of the first set of one or more audio features matches the second set of one or more audio features;

identifying a potential social engineering attack connected to social engineering activity associated with at least the portion of the real-time communication on the communication channel responsive to, at least in part, matching the first set of one or more audio features from at least the portion of the real-time communication with the second set of one or more audio features from at least the portion of the previous real-time communication; and

performing an action responsive to, at least in part, identifying the potential social engineering attack connected to the social engineering activity associated with at least the portion of the real-time communication on the communication channel, wherein performing the action include providing an alert of the potential social engineering attack.

2. The computer-implemented method of claim 1 wherein the first set of one or more audio features is based upon, at least in part, an audio characteristic of the real-time communication.

3. The computer-implemented method of claim 2 wherein the audio characteristic includes at least one of tone and cadence of a voice identified during the real-time communication.

4. The computer-implemented method of claim 1 wherein at least one of the features of the first set of one or more audio features includes intent.

5. The computer-implemented method of claim 1 wherein at least a portion of the first set of one or more features is extracted across multiple communications on the communication channel.

6. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:

extracting, by a computing device, a first set of one or more audio features from at least a portion of a real-time communication on a communication channel, wherein extracting the first set of one or more audio features includes at least one of generating an audio fingerprint of at least the portion of the real-time communication on the communication channel and transcribing at least the portion of the real-time communication on the communication channel;

comparing the first set of one or more audio features from at least the portion of the real-time communication to a second set of one or more audio features from at least a portion of a previous real-time communication;

determining that at least a portion of the first set of one or more audio features matches the second set of one or more audio features;

identifying a potential social engineering attack connected to social engineering activity associated with at least the portion of the real-time communication on the communication channel responsive to, at least in part, matching the first set of one or more audio features from at least the portion of the real-time communication with the second set of one or more audio features from at least the portion of the previous real-time communication; and

performing an action responsive to, at least in part, identifying the potential social engineering attack connected to the social engineering activity associated with at least the portion of the real-time communication on the communication channel, wherein performing the action include providing an alert of the potential social engineering attack.

7. The computer program product of claim 6 wherein the first set of one or more audio features is based upon, at least in part, an audio characteristic of the real-time communication.

8. The computer program product of claim 7 wherein the audio characteristic includes at least one of tone and cadence of a voice identified during the real-time communication.

9. The computer program product of claim 6 wherein at least one of the features of the first set of one or more audio features includes intent.

10. A computing system including one or more processors and one or more memories configured to perform operations comprising:

extracting, by a computing device, a first set of one or more audio features from at least a portion of a real-time communication on a communication channel, wherein extracting the first set of one or more audio features includes at least one of generating an audio fingerprint of at least the portion of the real-time communication on the communication channel and transcribing at least the portion of the real-time communication on the communication channel;

comparing the first set of one or more audio features from at least the portion of the real-time communication to a second set of one or more audio features from at least a portion of a previous real-time communication;

determining that at least a portion of the first set of one or more audio features matches the second set of one or more audio features;

identifying a potential social engineering attack connected to social engineering activity associated with at least the portion of the real-time communication on the communication channel responsive to, at least in part, matching the first set of one or more audio features from at least the portion of the real-time communication with the second set of one or more audio features from at least the portion of the previous real-time communication; and

performing an action responsive to, at least in part, identifying the potential social engineering attack connected to the social engineering activity associated with at least the portion of the real-time communication on the communication channel, wherein performing the action include providing an alert of the potential social engineering attack.

11. The computing system of claim 10 wherein the first set of one or more audio features is based upon, at least in part, an audio characteristic of the real-time communication.

12. The computing system of claim 11 wherein the audio characteristic includes at least one of tone and cadence of a voice identified during the real-time communication.

13. The computing system of claim 10 wherein at least one of the features of the first set of one or more audio features includes intent.

14. The computing system of claim 10 further comprising a virtual agent for at least one of monitoring and controlling the operations.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2022
From: TELEPATHY IP HOLDINGS
To: TELEPATHY LABS, INC.
Reel/Frame 062026/0304 →
RELEASE OF SECURITY INTEREST Recorded Mar 31, 2020
From: CIRCINUS-UAE, LLC
To: TELEPATHY LABS, INC.
Reel/Frame 052278/0217 →
SECURITY INTEREST Recorded Feb 19, 2019
From: TELEPATHY LABS, INC.
To: CIRCINUS-UAE, LLC
Reel/Frame 048372/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2018
From: TELEPATHY LABS, INC.
To: TELEPATHY IP HOLDINGS
Reel/Frame 046251/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2017
From: STOLARZ, DAMIEN PHELAN; DWYER, JOHANNA; POLLACK, RONALD J.
To: TELEPATHY LABS, INC.
Reel/Frame 043739/0707 →
Continuity (6)
Provisional Application 62403687 · Oct 3, 2016
Provisional Application 62403688 · Oct 3, 2016
Provisional Application 62403691 · Oct 3, 2016
Provisional Application 62403693 · Oct 3, 2016
Provisional Application 62403696 · Oct 3, 2016
Related Publication 20180097838A1 · Apr 5, 2018
Cited By (1)
US 12,294,582