IP Library Granted Patent US 9,141,878
Granted Patent B2
US 9,141,878 · App. 14/013,096 · Granted Sep 22, 2015

Detecting facial similarity based on human perception of facial similarity

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,141,878
App. No.
14/013,096
Granted
Sep 22, 2015
Kind
B2
Abstract

Similar faces may be determined within images based on human perception of facial similarity. The user may provide an image including a query face to which the user wishes to find faces that are similar. Similar faces may be determined based on similarity information. Similarity information may be generated from information related to a human perception of facial similarity. Images that include faces determined to be similar, based on the similarity information, may be provided to the user as search result images. The user then may provide feedback to indicate the user's perception of similarity between the query face and the search result images.

Claims (77)

1. A method for identifying images in an online dating service, the method comprising:

determining, using at least one processor, inequalities between a plurality of training faces associated with one or more images based on received indications of similarity between a plurality of image groupings;

determining, using the at least one processor, a mapping function between an objective feature space and a psychological feature space that indicates human perception of facial similarity based on the inequalities;

receiving a query from a user of an online dating website;

identifying, using the at least one processor, one or more other users of the online dating service responsive to the query based on the mapping function; and

providing search results to the user of the online dating website based on the identified one or more images associated with other users.

2. The method of claim 1 wherein:

receiving a query comprises receiving an image that includes a query face for analysis from the user; and

the one or more search result images comprise images associated with other users of the online dating service who looks similar to the query face.

3. The method of claim 1 wherein the query comprises receiving a name associated with a celebrity.

4. The method of claim 2 , further comprising:

receiving a selection made by the user of characteristics associated with a person in the image that includes a query face; and

removing search result images from the determined one or more search result images based on the received selection.

5. The method of claim 2 , further comprising:

detecting one or more classes associated with the query face;

identifying characteristics of the query face based on at least the determined one or more classes; and

reducing a field of search associated with the received query based on at least on the identified characteristics.

6. The method of claim 1 , further comprising:

identifying a plurality of search image results from among the provided search image results that was accessed by the user;

determining one or more common characteristic of the plurality of accessed search image results;

updating the search results based at least on the determined one or more common characteristics; and

providing the updated search results images to the user.

7. The method of claim 2 , further comprising:

receiving an identifier associated with the query face; and

determining one or more search result images based on the received identifier.

8. A system for determining facial similarity among images within a social networking service, comprising:

a memory device storing a plurality of instructions; and

at least one processor that executes the plurality of instructions to perform operations comprising:

determining inequalities between a plurality of training faces associated with one or more images based on received indications of similarity between a plurality of image groupings;

determining a mapping function between an objective feature space and a psychological feature space that indicates human perception of facial similarity based on the inequalities;

receiving a query from a user of an online dating website;

identifying, using the at least one processor, one or more other users of the online dating service responsive to the query based on the mapping function; and

providing search results to the user of the online dating website based on the identified one or more images associated with other users.

9. The system of claim 8 , wherein:

receiving a query comprises receiving an image that includes a query face for analysis from the user; and

the one or more search result images comprise images associated with other users of the online dating service who looks similar to the query face.

10. The system of claim 8 , wherein the query comprises receiving a name associated with a celebrity.

11. The system of claim 9 , wherein the at least one processor further executes the plurality of instructions to perform operations comprising:

receiving a selection made by the user of characteristics associated with a person in the image that includes a query face; and

removing search result images from the determined one or more search result images based on the received selection.

12. The system of claim 9 , wherein the at least one processor further executes the plurality of instructions to perform operations comprising:

detecting one or more classes associated with the query face;

identifying characteristics of the query face based on at least the determined one or more classes; and

reducing a field of search associated with the received query based on at least on the identified characteristics.

13. The system of claim 8 , wherein the at least one processor further executes the plurality of instructions to perform operations comprising:

identifying a plurality of search image results from among the provided search image results that was accessed by the user;

determining one or more common characteristic of the plurality of accessed search image results;

updating the search results based at least on the determined one or more common characteristics; and

providing the updated search results images to the user.

14. The system of claim 8 , wherein the at least one processor further executes the plurality of instructions to perform operations comprising:

receiving an identifier associated with the query face; and

determining one or more search result images based on the received identifier.

15. A non-transitory computer-useable medium storing a computer program, the computer program including a set of instructions that are executable by at least one processor to perform operations comprising:

determining inequalities between a plurality of training faces associated with one or more images based on received indications of similarity between a plurality of image groupings;

determining a mapping function between an objective feature space and a psychological feature space that indicates human perception of facial similarity based on the inequalities;

receiving a query from a user of an online dating website;

identifying, using the at least one processor, one or more other users of the online dating service responsive to the query based on the mapping function; and

providing search results to the user of the online dating website based on the identified one or more images associated with other users.

16. The medium of claim 15 wherein:

receiving a query comprises receiving an image that includes a query face for analysis from the user; and

the one or more search result images comprise images associated with other users of the online dating service who looks similar to the query face.

17. The medium of claim 15 wherein the query comprises receiving a name associated with a celebrity.

18. The medium of claim 16 , wherein the set of instructions further cause the at least one processor to perform operations comprising:

receiving a selection made by the user of characteristics associated with a person in the image that includes a query face; and

removing search result images from the determined one or more search result images based on the received selection.

19. The medium of claim 16 , wherein the set of instructions further cause the at least one processor to perform operations comprising:

detecting one or more classes associated with the query face;

identifying characteristics of the query face based on at least the determined one or more classes; and

reducing a field of search associated with the received query based on at least on the identified characteristics.

20. The medium of claim 15 , wherein the set of instructions further cause the at least one processor to perform operations comprising:

identifying a plurality of search image results from among the provided search image results that was accessed by the user;

determining one or more common characteristic of the plurality of accessed search image results;

updating the search results based at least on the determined one or more common characteristics; and

providing the updated search results images to the user.

21. The medium of claim 16 , wherein the set of instructions further cause the at least one processor to perform operations comprising:

receiving an identifier associated with the query face; and

determining one or more search result images based on the received identifier.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: VERIZON MEDIA INC.
To: VERIZON PATENT AND LICENSING INC.
Reel/Frame 057453/0431 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
CHANGE OF NAME Recorded Aug 24, 2017
From: AOL INC.
To: OATH INC.
Reel/Frame 043672/0369 →
CHANGE OF NAME Recorded Aug 2, 2016
From: ISIS INNOVATION LIMITED
To: OXFORD UNIVERSITY INNOVATION LIMITED
Reel/Frame 039550/0045 →
CONFIRMATORY LICENSE Recorded Apr 10, 2015
From: CALIFORNIA INSTITUTE OF TECHNOLOGY
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 035414/0188 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2014
From: HOLUB, ALEX; PERONA, PIETRO
To: CALIFORNIA INSTITUTE OF TECHNOLOGY
Reel/Frame 033746/0963 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2013
From: AOL LLC
To: AOL INC.
Reel/Frame 031297/0742 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2013
From: PERLMUTTER, SHARON M.; PERLMUTTER, KEREN O.; ALSPECTOR, JOSHUA
To: AOL LLC
Reel/Frame 031297/0373 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2013
From: EVERINGHAM, MARK; ZISSERMAN, ANDREW
To: ISIS INNOVATION LTD.
Reel/Frame 031297/0637 →