Active presence detection with depth sensing
In vision-based authentication platforms for secure resources such as computer systems, false positives and/or false negatives in the detection of walk-away events are reduced or eliminated by incorporating depth information into tracking authenticated system operators.
1. A computer-implemented method for reliably monitoring an operator's use of a secure system to prevent unauthorized use of the secure system while preventing erroneous termination of the operator's use of the secure system, the method comprising:
(a) defining a detection zone extending from an operator terminal of the secure system to a depth boundary spaced apart from the operator terminal and corresponding to a distance from the operator terminal beyond which an operator cannot interact with the secure system;
(b) using a depth-sensing camera system co-located with the operator terminal to acquire a series of images of one or more objects;
(c) using the depth-sensing camera to measure distances from the operator terminal to the one or more objects in the series of images;
(d) computationally determining whether any of the one or more objects is within the detection zone and is a face, and, when the one or more objects is determined to be within the detection zone and determined to be a face, electronically associating the detected face with an operator; and
(e) following association of a detected face with the operator, using the depth-sensing camera to electronically track the distance from the operator terminal to the detected face and, when the distance extends beyond the depth boundary, signaling a walk-away event to prevent unauthorized use of the operator terminal,
wherein (I) step (d) comprises using a face-finding algorithm to detect faces in the images and thereafter computationally determining, based on the distances measured using the depth-sensing camera, which, if any, of the detected faces are present within the detection zone while excluding detected faces disposed at distances, measured using the depth-sensing camera, which are beyond the depth boundary, and (II) steps (b)-(e) are only performed after the operator has logged on to the secure system at the operator terminal.
2. The method of claim 1 , wherein tracking the distance from the operator terminal to the detected face comprises using the distances measured by the depth-sensing camera to discriminate between the operator and background objects present in the series of images.
3. The method of claim 1 , wherein step (d) comprises identifying, among a plurality of faces present within the detection zone, the face closest to the secure system based on distances to the plurality of faces measured using the depth-sensing camera and computationally associating that face with the operator.
4. The method of claim 1 , wherein step (d) comprises analyzing relative depth information measured with the depth-sensing camera to discriminate between faces and two-dimensional images thereof.
5. The method of claim 1 , wherein step (e) comprises tracking a collection of trackable key features associated with the operator between the successive images based, at least in part, on distances associated therewith.
6. The method of claim 5 , wherein tracking the key features comprises matching the key features between the successive images based at least in part on the distances associated therewith.
7. The method of claim 5 , wherein tracking the key features comprises filtering identified matches of key features between the successive images based at least in part on the distances associated therewith.
8. The method of claim 1 , wherein step (e) further comprises periodically restarting the tracking based on at least one of re-detection of the face or detection of a head-shoulder portion associated with the operator, the at least one of re-detection of the face or detection of the head-shoulder portion being based at least in part on the distances measured using the depth-sensing camera.
9. The method of claim 8 , further comprising, repeatedly upon re-detection of the face, saving a face template for subsequent use during re-authentication.
10. The method of claim 9 , further comprising indexing the face templates based, at least in part, on face posture as determined from three-dimensional information contained therein.
11. The method of claim 1 , wherein signaling the walk-away event comprises issuing an alarm.
12. The method of claim 1 , wherein signaling the walk-away event comprises logging the operator out of the secure system.
13. The method of claim 1 , further comprising, after step (d), comparing the detected face to one or more previously acquired face exemplars of the operator.
14. The method of claim 13 , further comprising, when the detected face does not match a face exemplar of the operator, storing the detected face as a face exemplar of the operator.
15. The method of claim 1 , further comprising using a face-finding algorithm to detect, in images acquired by the depth-sensing camera, faces of one or more persons other than the operator and, based on distances measured using the depth-sensing camera, electronically warning the operator only when at least one said person is present within the detection zone.
16. The method of claim 1 , wherein step (d) comprises, when a plurality of objects are determined to be within the detection zone and to be faces, before electronically associating the detected face with the operator, electronically displaying a message on the operator terminal requesting all but one person to clear the detection zone.