IP Library › Granted Patent US 9,087,233
Granted Patent B2
US 9,087,233 · App. 13/900,609 · Granted Jul 21, 2015

Security by Z-face detection

Inventor: Henrik Heringslack (Lomma, SE)
Assignees: Sony Corporation; Sony Mobile Communications AB
G06K9/00288G06K9/00221G06K9/00268G06K9/00281
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,087,233
App. No.
13/900,609
Granted
Jul 21, 2015
Kind
B2
Abstract

A method for identifying a person using a mobile communication device, having a camera unit adapted for recording three-dimensional (3D) images, by recording a 3D image of the person's face using the camera unit, performing face recognition on the 2D image data in the recorded 3D image to determine at least two facial points on the 3D image the of person's face, determining a first distance between the at least two facial points in the 2D image data, determining a second distance between the at least two facial points using the depth data of the recorded 3D image, determining a third distance between the at least two facial points using the first distance and the second distance, and identifying the person by comparing the determined third distance to stored distances in a database, wherein each of the stored distances are associated with a person.

Claims (22)

1. A method for identifying a person using a mobile communication device having a camera unit adapted for recording a three-dimensional (3D) image, wherein said recorded 3D image comprises two-dimensional (2D) image data and depth data, said method comprises the steps:

recording a 3D image of said person's face using said camera unit;

performing face recognition on the 2D image data in said recorded 3D image to determine at least two facial points on said 3D image of said person's face;

determining a first distance between said at least two facial points in said 2D image data;

determining a second distance between said at least two facial points using said depth data of said recorded 3D image, wherein the determining of said second distance comprises determining the absolute difference of the depth distance of said at least two facial points;

determining a third distance between said at least two facial points using said first distance and said second distance; and

identifying said person by comparing said determined third distance to stored distances in a database, wherein each of said stored distances are associated with a person.

2. The method according to claim 1 , wherein said determining of third distance between said at least two facial points comprises;

calculating the third distance using Pythagoras' theorem wherein said first distance is one side and said second distance is another side in the Pythagorean equation, and the third distance is the hypotenuse.

3. The method according to claim 1 , wherein said determined at least two facial points are predetermined at least two facial points or user defined at least two facial points.

4. The method according to claim 1 , wherein said identifying of said person is further based on said face recognition of the 2D image, wherein said face recognition is compared to stored face recognition data in said database, wherein each of said stored face recognition data are associated with a person.

5. The method according to claim 1 , wherein said at least two facial points are any of the group: nose, left ear, right ear, left eye, right eye, the top of the head, the left cheek bone, the right cheek bone, the chin, the left corner of the mouth, the right corner of the mouth, the left eye brow or the right eye brow.

6. A mobile communication device for identifying a person, said mobile communication device having a camera unit adapted for recording a three-dimensional (3D) image of said person's face, wherein said recorded 3D image comprises two-dimensional (2D) image data and depth data, said mobile communication device further comprises:

a processing unit for performing face recognition on the 2D image data in said recorded 3D image and further adapted to determine at least two facial points on said 3D image of said person's face, said processing unit is further adapted to;

determining a first distance between said at least two facial points in said 2D image data;

determining a second distance between said at least two facial points using said depth data of said recorded 3D image, wherein the determining of said second distance comprises determining the absolute difference of the depth distance of said at least two facial points; and to

determining a third distance between said at least two facial points using said first distance and said second distance;

a memory unit storing a database of third distances, wherein each of said stored distances are associated with a person;

and wherein said processing unit is further adapted to identifying said person by comparing said determined third distance to said stored distances in said database.

7. The mobile communication device according to claim 6 , wherein said processing unit is further adapted to, in the determining of said third distance between said at least two facial points, calculating the third distance using Pythagoras' theorem wherein said first distance is one side and said second distance is another side in the Pythagorean equation, and the third distance is the hypotenuse.

8. The mobile communication device according to claim 6 , wherein said processing unit is further adapted to base the identifying of said person on said face recognition of the 2D image, wherein said face recognition is compared to stored face recognition data in said database in said memory unit, wherein each of said stored face recognition data are associated with a person.

9. A non-transitory computer readable medium with program instructions that when executed on a computer circuit of a mobile communication device causes the mobile communication device to perform the method according to claim 1 .

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2015
From: HERINGSLACK, HENRIK
To: SONY MOBILE COMMUNICATIONS AB
Reel/Frame 035739/0284 →
ASSIGNMENT OF PARTIAL INTEREST Recorded May 29, 2015
From: SONY MOBILE COMMUNICATIONS AB
To: SONY CORPORATION; SONY MOBILE COMMUNICATIONS AB
Reel/Frame 035796/0783 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2013
From: HERINGSLACK, HENRIK
To: SONY MOBILE COMMUNICATIONS AB
Reel/Frame 030472/0047 →
Priority Claims (1)
EP 12182773 · Jun 4, 2012 · regional
Continuity (2)
Provisional Application 61655014 · Jun 4, 2012
Related Publication 20130322708A1 · Dec 5, 2013