System and methods for monitoring user presence in a system having multiple user presence detection (UPD) capable devices
Embodiments of systems and methods are provided to monitor user presence, and manage various actions in response to user presence, within a system comprising multiple UPD-capable devices. In some embodiments, the systems and methods disclosed herein may collect user presence data from a plurality of UPD-capable devices, monitor the user presence data collected from the plurality of UPD-capable devices to accurately identify a user's presence, attention and/or engagement with a particular UPD-capable device, and manage various actions performed within the particular UPD-capable device based on said monitoring. In doing so, the systems and methods disclosed herein may reduce or eliminate problems that may otherwise occur when multiple UPD-capable devices are used within a system to monitor user presence.
1 . A system, comprising:
a plurality of user presence detection (UPD)-capable devices, wherein each UPD-capable device is configured to generate user presence data upon detecting user presence or user absence of a user within a field of view (FOV) of the UPD-capable device, each UPD-capable device having at least one sensor for obtaining biometric data from the user, at least one UPD capable device sensor including a microphone;
wherein a first UPD-capable device of the plurality of UPD-capable devices further includes:
a processing device configured to execute program instructions to:
collect the user presence data generated by the plurality of UPD-capable devices;
generate a trusted multi-user (TMU) status of the user by comparing the biometric data obtained from the user with biometric data stored within a TMU database stored within the first UPD-capable device, the user presence data collected by the processing device including the TMU status of the user and including at least audio data to identify vocal characteristics of the user and generate a speaker identity for the user:
monitor the user presence data collected from the plurality of UPD-capable devices to determine the user's presence, attention or engagement with at least one of the plurality of UPD-capable devices;
manage one or more actions performed within the first UPD-capable device based said monitoring:
aggregate the user presence data collected from each of the plurality of UPD-capable devices:
analyze the aggregated user presence data to: (a) determine if the user is a trusted user or an unknown user based on the TMU status of the user, and (b) identify the user's presence, attention or engagement with a particular UPD-capable device of the plurality of UPD-capable devices;
collect the biometric data generated by each UPD-capable device;
collect the TMU status generated by the first UPD-capable device;
collect the speaker identity generated by the at least one of the UPD-capable devices; and
aggregate the user presence data by combining the biometric data, the TMU status and the speaker identity generated for the user.
2 . The system of claim 1 , wherein the processing device included within the first UPD-capable device executes the program instructions to:
manage one or more actions performed within the particular UPD-capable device based on the user's presence, attention or engagement with the particular UPD-capable device and the determination that the user is a trusted user or an unknown user.
3 . The system of claim 2 , wherein the one or more actions comprise one of the following:
managing a system wake event for the particular UPD-capable device;
locking an active system session for the particular UPD-capable device;
managing system configuration settings specified for the particular UPD-capable device;
managing session revocation requirements specified for the particular UPD-capable device;
enabling or disabling notifications displayed on a display screen of the particular UPD-capable device; and
controlling display screen settings for the display screen of the particular UPD-capable device.
4 . A method to monitor user presence and manage actions in response to user presence within a system comprising a plurality of user presence detection (UPD)-capable devices, the method comprising:
collecting user presence data from the plurality of UPD-capable devices, wherein the user presence data is generated within and collected from each UPD-capable device of the plurality of UPD-capable devices upon detecting user presence or user absence of a user within a FOV of the UPD-capable device, the user presence data including biometric data from the user obtained by at least one sensor, the at least one sensor including a microphone, the collecting including collecting a speaker identity for the user from at least one of the plurality of UPD-capable devices, wherein the speaker identity is generated by receiving audio data detected within the user's environment and analyzing the audio data to identify vocal characteristics of the user and generate a speaker identity for the user;
monitoring the user presence data collected from the plurality of UPD-capable devices to determine the user's presence, attention or engagement with at least one of the plurality of UPD-capable devices, the monitoring including aggregating the user presence data collected from each of the plurality of UPD-capable devices, and analyzing the aggregated user presence data to: (a) determine if the user is a trusted user or an unknown user based on a trusted multi-user (TMU) status, and (b) identify the user's presence, attention or engagement with a particular UPD-capable device of the plurality of UPD-capable devices;
managing one or more actions performed within one or more of the plurality of UPD-capable devices based said monitoring;
collecting biometric data pertaining to user presence when the user is detected within a field of view (FOV) of the at least one sensor;
collecting biometric data pertaining to user absence when the user is not detected within the FOV of the at least one sensor; and
collecting biometric data pertaining to user attention when the user's gaze is directed toward or away from the at least one sensor; and
collecting a TMU status of the user from at least one of the plurality of UPD-capable devices, the TMU status for the user generated by comparing the biometric data collected from the user with biometric data stored within a TMU database containing biometric data corresponding to one or more trusted users, wherein the TMU status identifies the user as: (a) a trusted user when the biometric data collected from the user matches the biometric data contained within the TMU database; or (b) an unknown user when the biometric data collected from the user does not match the biometric data contained within the TMU database;
wherein said aggregating the user presence data collected from each of the plurality of UPD-capable devices comprises combining the biometric data, the TMU status and the speaker identity generated for the user.
5 . The method of claim 4 , wherein said managing one or more actions performed within one or more of the plurality of UPD-capable devices comprises:
managing one or more actions performed within the particular UPD-capable device based on the user's presence, attention or engagement with the particular UPD-capable device and the determination that the user is a trusted user or an unknown user.
6 . The method of claim 5 , wherein the one or more actions comprise waking or locking the particular UPD-capable device.
7 . The method of claim 5 , wherein the one or more actions comprise managing system configuration settings or session revocation requirements specified for the particular UPD-capable device.
8 . The method of claim 5 , wherein the one or more actions comprise managing notifications on a display screen of the particular UPD-capable device or controlling display screen settings for the display screen of the particular UPD-capable device.