IP Library Granted Patent US 10,275,671
Granted Patent B1
US 10,275,671 · App. 15/205,939 · Granted Apr 30, 2019

Validating identity and/or location from video and/or audio

Inventor: David Newman (Walnut Creek, CA)
Assignee: Wells Fargo Bank, N.A.
G06K9/00892G10L17/02G10L17/04G10L25/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,275,671
App. No.
15/205,939
Granted
Apr 30, 2019
Kind
B1
Abstract

An electronic computing device includes a processing unit and system memory. The system memory includes instructions which, when executed by the processing unit, cause the electronic computing device to: receive a communication containing audio data; automatically identify one or more sounds in the audio data of the communication that can be correlated with a geographical location; use the identification of the one or more sounds to identify the geographical location for the audio data; and verify an identity of an individual using the geographic location from the audio data.

Claims (62)

1. An electronic computing device comprising:

a processing unit; and

system memory, the system memory including instructions which, when executed by the processing unit, cause the electronic computing device to:

receive a communication containing audio data from an individual;

automatically identify one or more sounds in the audio data of the communication that can be correlated with a geographical location;

use the identification of the one or more sounds to identify the geographical location for the audio data; and

obtain a profile of the individual that includes a travel history for the individual;

determine from the travel history that the individual has previously traveled to a location at or near the geographical location identified from the audio data;

obtain information regarding a location of a recent financial transaction made by the individual;

determine whether the location of the recent financial transaction is consistent with the geographical location identified from the audio data; and

when a determination is made that the individual has previously traveled to the location at or near the geographical location identified from the audio data, and when a determination is made that the location of the recent financial transaction is consistent with the geographical location identified from the audio data, verify an identity of the individual using the geographic location from the audio data.

2. The electronic computing device of claim 1 , wherein the communication includes video data, the video data comprising one or more video images, and further comprising:

automatically identify the one or more video images from the video data that can be correlated with the geographical location; and

use a combination of the one or more video images and the one or more sounds to confirm the geographical location for the video data.

3. The electronic computing device of claim 2 , wherein automatically identify the one or more video images from the video data further comprises:

determine a context for an event from the one or more video images,

wherein the context for the event includes one or more of an identification of one or more people, a place and an object associated with the event.

4. The electronic computing device of claim 3 , wherein the instructions further cause the electronic computing device to authenticate the individual using the identification of the individual, the geographic location and the profile of the individual.

5. The electronic computing device of claim 1 , wherein the instructions further cause the electronic computing device to authenticate the individual using the identification of the individual, a geographic location and the profile of the individual.

6. The electronic computing device of claim 1 , wherein the communication containing the audio data is a text message or an email message that includes an audio file or an audio/visual file.

7. The electronic computing device of claim 1 , wherein identify the geographical location for the audio data comprises using one or more algorithms on the electronic computing device to compare patterns in the audio data with audio data patterns associated with specific cities.

8. The electronic computing device of claim 1 , wherein automatically identify the one or more sounds in the audio data of the communication comprises sampling the audio data and extracting one or more acoustic vectors from the audio data.

9. The electronic computing device of claim 1 , wherein automatically identify the one or more sounds in the audio data of the communication comprises sampling the audio data and extracting one or more Mel Frequency Cepstral Coefficient (MFCC) vectors from the audio data.

10. The electronic computing device of claim 9 , wherein automatically identify the one or more sounds in the audio data of the communication further comprises creating a dataset for a city using the MFCC vectors.

11. The electronic computing device of claim 10 , wherein the instructions further cause the electronic computing device to:

compare the dataset created using the MFCC vectors with other datasets that are correlated with specific cities; and

when a determination is made that the dataset created using the MFCC vectors is correlated with a specific location, designate the specific location as the geographical location for the audio data.

12. The electronic computing device of claim 1 , wherein the instructions further cause the electronic computing device to learn a pattern of geolocations of an individual to determine standard locations versus anomalous locations associated with the individual.

13. The electronic computing device of claim 1 , wherein the communication includes an audio/visual file created by the individual, the audio/visual file including an image of the individual and an audio of the individual.

14. The electronic computing device of claim 1 , wherein the communication is a telephone call and wherein the instructions further cause the electronic computing device to:

use the audio data to identify the individual;

determine from a profile of the individual and the location of the recent financial transaction made by the individual whether the individual should be at the geographical location identified by the one or more sounds; and

when a determination is made that the individual should not be at the geographical location identified by the one or more sounds, make a determination that the individual should not be authenticated.

15. A computer-readable data storage memory comprising instructions that, when executed by a processing unit of an electronic computing device, cause the processing unit to:

receive a communication containing audio data and video data;

automatically identify one or more sounds in the audio data of the communication that can be correlated with a geographical location;

automatically identify one or more video images from the video data that can be correlated with the geographical location;

use the identification of the one or more sounds and the one or more video images to identify a common geographical location for the audio data and the video data;

obtain a profile of an individual that includes a travel history for the individual;

determine from the travel history that the individual has previously traveled to a location at or near the common geographical location identified from the audio data and the video data;

obtain information regarding a location of a recent financial transaction made by the individual;

determine whether the location of the recent financial transaction is consistent with the geographical location identified from the audio data; and

when a determination is made that the individual has previously traveled to the location at or near the common geographical location identified from the audio data and the video data, and when a determination is made that the location of the recent financial transaction is consistent with the common geographical location identified from the audio data and the video data, verify an identity of the individual based at least in part upon the common geographic location for the audio data and the video data.

16. The computer-readable data storage memory of claim 15 , wherein the instructions further cause the processing unit to identify the individual from one or more of the sounds from the audio data and the one or more video images from the video data.

17. The computer-readable data storage memory of claim 15 , wherein automatically identify the one or more sounds in the audio data comprises sampling the audio data and extracting one more acoustic vectors from the audio data.

18. The computer-readable data storage memory of claim 17 , wherein automatically identify the one or more sounds in the audio data comprises creating a dataset for a location using the one or more acoustic vectors.

19. The computer-readable data storage memory of claim 18 , wherein the instructions further cause the processing unit to:

compare the dataset created using the one or more acoustic vectors with other datasets that are correlated with specific cities; and

when a determination is made that the dataset created using the one or more acoustic vectors is correlated with a specific location, designate the specific location as the geographical location for the audio data.

20. A method, comprising:

receiving a communication containing audio data;

automatically identifying one or more sounds in the audio data of the communication that can be correlated with a geographical location;

using the identification of the one or more sounds to identify the geographical location of where the audio data was created, the identification of the geographical location comprising:

sampling the audio data and extracting one or more Mel Frequency Cepstral Coefficient (MFCC) vectors from the audio data;

creating a dataset for a city using the MFCC vectors, the dataset being based on a Gaussian Mixture Model (GMM);

comparing the dataset created using the MFCC vectors with other datasets that are correlated with specific cities; and

when a determination is made that the dataset created using the MFCC vectors is correlated with a specific location, designating the specific location as the geographical location for the audio data;

obtaining a profile of an individual that includes a travel history for the individual;

determining from the travel history that the individual has previously traveled to a location at or near the specific location;

obtaining information regarding a location of a recent financial transaction made by the individual;

determining whether the location of the recent financial transaction is consistent with the geographical location identified from the audio data; and

when a determination is made that the individual has previously traveled to the location at or near the specific location, and when a determination is made that the location of the recent financial transaction is consistent with the geographical location identified from the audio data, verifying, at least in part, an identity of the individual based upon the specific location.

Assignments (2)
STATEMENT OF CHANGE OF ADDRESS OF ASSIGNEE Recorded Jun 17, 2025
From: WELLS FARGO BANK, N.A.
To: WELLS FARGO BANK, N.A.
Reel/Frame 071658/0990 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2016
From: NEWMAN, DAVID
To: WELLS FARGO BANK, N.A.
Reel/Frame 039254/0784 →
Continuity (1)
Provisional Application 62192416 · Jul 14, 2015
Cited By (2)
US 12,212,581 US 12,452,827