IP Library Granted Patent US 12,032,717
Granted Patent B2
US 12,032,717 · App. 16/832,976 · Granted Jul 9, 2024

Masking personal information in audio recordings

Inventors: Idan Richman Goshen (Beer Sheva, IL); Avitan Gefen (Lehavim, IL)
Assignee: EMC IP HOLDING COMPANY LLC
G06F21/6245G06N20/00G10L15/063G10L15/197G10L15/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,032,717
App. No.
16/832,976
Granted
Jul 9, 2024
Kind
B2
Abstract

One example method includes transcribing a portion of the audio component to create a transcription file that includes text, searching the text of the transcription file and identifying information in the text that may include personal information, defining a textual window that includes the information, evaluating the text in the textual window to identify personal information, and masking the personal information in the audio component of the recording. The personal information may be masked with information of a non-personal nature.

Claims (42)

1. A method, comprising:

creating a recording that includes an audio component of a client;

transcribing a portion of the audio component to create a transcription file;

receiving a regex;

using the regex to search for a matching text between a portion of the transcription file and the regex;

identifying one or more textual windows that include the matching text in the transcription file, wherein each identified textual window includes text preceding and following the matching text, and each identified textual window includes only text associated with the client;

evaluating, by a trained machine learning classifier, the text in each identified textual window based on a bag of words model, in which a word in a bag of words has a relatively higher weight than other words in the bag of words based on a strength of correlation between words and personal information sought to be located;

inferring, based on the evaluating of the text in each identified textual window, presence of personal information of the client in each identified textual window; and

removing the personal information from any identified textual window in which presence of the personal information was inferred.

2. The method as recited in claim 1 , wherein the audio component includes words spoken by a human.

3. The method as recited in claim 1 , wherein the recording is an audio recording, or an audio/video recording.

4. The method as recited in claim 1 , wherein the trained machine learning classifier maps words in the one or more identified textual windows as a vector of real numbers, and the vector is one of a group of vectors in a vector space.

5. The method as recited in claim 1 , wherein each textual window comprises a portion of the recording that is bounded by a start time and an end time.

6. The method as recited in claim 1 , wherein the method is performed on-the-fly as the recording is being created.

7. The method as recited in claim 1 , wherein the personal information does not pertain to any person whose voice is in the recording.

8. The method as recited in claim 1 , wherein the removed personal information is replaced with data of a non-personal nature.

9. The method as recited in claim 1 , further comprising generating a set of training data and using the training data as a basis for searching the text of the transcription file.

10. The method as recited in claim 9 , wherein generating the set of training data comprises:

tagging data in the training data as comprising the personal information;

automatically learning one or more regexes, including the regex; and

training a machine learning classifier to infer presence of the personal information in the identified textual window.

11. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:

creating a recording that includes an audio component of a client;

transcribing a portion of the audio component to create a transcription file;

receiving a regex;

using the regex to search for a matching text between a portion of the transcription file and the regex;

identifying one or more textual windows that include the matching text in the transcription file, wherein each identified textual window includes text preceding and following the matching text, and each identified textual window includes only text associated with the client;

evaluating, by a trained machine learning classifier, the text in each textual window based on a bag of words model, in which a word in a bag of words has a relatively higher weight than other words in the bag of words based on a strength of correlation between words and personal information sought to be located;

inferring, based on the evaluating of the text in each identified textual window, presence of personal information in each textual window; and

removing the personal information of the client from any identified textual window in which presence of the personal information was inferred.

12. The non-transitory storage medium as recited in claim 11 , wherein the audio component includes words spoken by a human.

13. The non-transitory storage medium as recited in claim 11 , wherein the recording is an audio recording, or an audio/video recording.

14. The non-transitory storage medium as recited in claim 11 , wherein the trained machine learning classifier maps words in the one or more identified textual windows as a vector of real numbers, and the vector is one of a group of vectors in a vector space.

15. The non-transitory storage medium as recited in claim 11 , wherein each textual window comprises a portion of the recording that is bounded by a start time and an end time.

16. The non-transitory storage medium as recited in claim 11 , wherein the operations are performed on-the-fly as the recording is being created.

17. The non-transitory storage medium as recited in claim 11 , wherein the personal information does not pertain to any person whose voice is in the recording.

18. The non-transitory storage medium as recited in claim 11 , wherein the removed personal information is replaced with data of a non-personal nature.

19. The non-transitory storage medium as recited in claim 11 , further comprising generating a set of training data and using the training data as a basis for searching the text of the transcription file.

20. The non-transitory storage medium as recited in claim 19 , wherein generating the set of training data comprises:

tagging data in the training data as comprising the personal information;

automatically learning one or more regexes, including the regex; and

training a machine learning classifier to infer presence of the personal information in the identified textual window.

Assignments (11)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0081) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0441 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0917) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0509 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052852/0022) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0582 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST AT REEL 052771 FRAME 0906 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0298 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0081 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0917 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052852/0022 →
SECURITY AGREEMENT Recorded May 28, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052771/0906 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2020
From: GOSHEN, IDAN RICHMAN; GEFEN, AVITAN
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 052248/0826 →