IP Library Granted Patent US 10,607,148
Granted Patent B1
US 10,607,148 · App. 15/386,393 · Granted Mar 31, 2020

User identification with voiceprints on online social networks

Inventor: Mateusz Marek Niewczas (Palo Alto, CA)
Assignee: Facebook, Inc.
G06N7/005G06Q50/01G10L17/06G10L17/22H04L43/16H04L67/02H04L67/18H04L67/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,148
App. No.
15/386,393
Granted
Mar 31, 2020
Kind
B1
Abstract

In one embodiment, a method includes, by one or more computing devices of an online social network, receiving, from a client system of a first user of the online social network, a first audio input from an unknown user, identifying one or more candidate users, wherein each candidate user is a user of the online social network within a threshold degree of separation of a known user, calculating, for each candidate user, a probability score representing a probability that the unknown user is the candidate user, wherein the probability score is based on a comparison of the first audio input to a voiceprint of the candidate user stored by the online social network, wherein each voiceprint comprises audio data for auditory identification of the candidate user, and identifying one of the candidate users as being the unknown user based on the calculated probability scores of the candidate users.

Claims (44)

1. A method comprising, by one or more computing devices of an online social network:

receiving, from a client system of a first user of the online social network, a first audio input from an unknown user;

identifying one or more candidate users, wherein each candidate user is a user of the online social network within a threshold degree of separation of a known user;

determining, for each candidate user, a proximity of the candidate user to the known user;

calculating, for each candidate user, a probability score representing a probability that the unknown user is the candidate user, wherein the probability score is based on the proximity of the candidate user and a comparison of the first audio input to a voiceprint of the candidate user stored by the online social network, wherein each voiceprint comprises audio data for auditory identification of the candidate user; and

identifying one of the candidate users as being the unknown user based on the calculated probability scores of the candidate users.

2. The method of claim 1 , wherein the client system of the first user comprises one or more of a mobile device, a media device, or a beacon.

3. The method of claim 1 , wherein the known user is the first user, the candidate users comprise the first user, and the probability score is proportional to a number of times the first audio input matches a particular voiceprint.

4. The method of claim 1 , wherein the known user is the first user, the candidate users comprise one or more users within the threshold degree of separation of the first user, and the probability score is lower than a threshold probability score.

5. The method of claim 1 , further comprising:

receiving, at the client system of the first user, a second audio input; and

increasing the probability score in response to the second audio input matching a voiceprint of the known user and the second audio input comprising a name of the candidate user spoken by the known user.

6. The method of claim 1 , wherein the determining that the candidate user is proximate to the known user comprises detecting that the candidate user has checked in at a location proximate to the known user.

7. The method of claim 1 , further comprising:

receiving, by a listening device in a known location, a second audio input; and

increasing the probability score in response to detecting that the candidate user has checked in at a location proximate to the listening device.

8. The method of claim 7 , further comprising increasing the probability score in response to detecting that the known user is located proximate to the listening device.

9. The method of claim 7 , wherein detecting that the known user is located proximate to the listening device comprises one or more of:

detecting that the known user has checked in at a location proximate to the listening device,

detecting that the second audio input matches a voiceprint of the known user, or

detecting that the second audio input comprises a name of the candidate user spoken by the known user.

10. The method of claim 1 , wherein the first user is one or more of a user logged into the client system, a user using an application on the client system, or an owner of the client system.

11. The method of claim 1 , further comprising:

receiving identity information for the unknown user;

generating a new voiceprint based on the first audio input; and

storing the new voiceprint in association with the identity information for subsequent access by the online social network.

12. The method of claim 1 , wherein the probability score is determined based on a behavioral pattern of the first user.

13. The method of claim 12 , wherein the probability score is increased when the behavioral pattern comprises the first user periodically checking in at a location, and a listening device detects the first user's voice at the location.

14. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

receive, from a client system of a first user of an online social network, a first audio input from an unknown user;

identify one or more candidate users, wherein each candidate user is a user of the online social network within a threshold degree of separation of the first a known user;

determine, for each candidate user, a proximity of the candidate user to the known user;

calculate, for each candidate user, a probability score representing a probability that the unknown user is the candidate user, wherein the probability score is based on the proximity of the candidate user and a comparison of the first audio input to a voiceprint of the candidate user stored by the online social network, wherein each voiceprint comprises audio data for auditory identification of the candidate user; and

identify one of the candidate users as being the unknown user based on the calculated probability scores of the candidate users.

15. The media of claim 14 , wherein the client system of the first user comprises one or more of a mobile device, a media device, or a beacon.

16. The media of claim 14 , wherein the known user is the first user, the candidate users comprise the first user, and the probability score is proportional to a number of times the first audio input matches a particular voiceprint.

17. A system comprising: one or more processors; and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:

receive, from a client system of a first user of an online social network, a first audio input from an unknown user;

identify one or more candidate users, wherein each candidate user is a user of the online social network within a threshold degree of separation of the first a known user;

determine, for each candidate user, a proximity of the candidate user to the known user;

calculate, for each candidate user, a probability score representing a probability that the unknown user is the candidate user, wherein the probability score is based on the proximity of the candidate user and a comparison of the first audio input to a voiceprint of the candidate user stored by the online social network, wherein each voiceprint comprises audio data for auditory identification of the candidate user; and

identify one of the candidate users as being the unknown user based on the calculated probability scores of the candidate users.

18. The system of claim 17 , wherein the client system of the first user comprises one or more of a mobile device, a media device, or a beacon.

19. The system of claim 17 , wherein the known user is the first user, the candidate users comprise the first user, and the probability score is proportional to a number of times the first audio input matches a particular voiceprint.

Assignments (2)
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2017
From: NIEWCZAS, MATEUSZ MAREK
To: FACEBOOK, INC.
Reel/Frame 041639/0263 →
Cited By (7)
US 12,525,224 US 12,562,150 US 12,592,220 US 12,592,239 US 12,676,144 US 12,706,098 US 12,711,951