IP Library Granted Patent US 11,586,282
Granted Patent B2
US 11,586,282 · App. 17/163,654 · Granted Feb 21, 2023

Method, device, and computer program product for monitoring user

Inventors: Anzhou Hou (Shanghai, CN); Danqing Sha (Shanghai, CN); Zhen Jia (Shanghai, CN); Bin He (Shanghai, CN)
Assignee: EMC IP Holding Company LLC
G06F3/013G02B27/017G06F21/32G06V20/30G06V40/19G06V40/197
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,586,282
App. No.
17/163,654
Granted
Feb 21, 2023
Kind
B2
Abstract

Illustrative embodiments of the present disclosure relate to a method, a wearable device, an electronic device, and a computer program product for monitoring a user. The method includes verifying an identity of the user by analyzing user data related to the user and obtained by a wearable device, the user data including at least a first image of a part of the user's body. The method further includes monitoring a relative position of the wearable device with respect to the user based on sensor data obtained by the wearable device if the verification on the identity of the user succeeds; monitoring a surrounding environment of the user based on a second image of the surrounding environment obtained by the wearable device; and monitoring behaviors of the user based at least in part on the monitored relative position and the monitored surrounding environment.

Claims (63)

1. A wearable device, comprising:

a processing unit, wherein the processing unit is configured to:

verify an identity of a user by analyzing user data related to the user and obtained by the wearable device, the user data comprising at least a first image of a part of the user's body;

if the verification on the identity of the user succeeds,

monitor a relative position of the wearable device with respect to the user based on sensor data obtained by the wearable device;

monitor a surrounding environment external to the user based on a second image of the surrounding environment obtained by the wearable device when mounted on the user; and

monitor behaviors of the user based at least in part on the monitored relative position and the monitored surrounding environment;

wherein monitoring behaviors of the user based at least in part on the monitored relative position and the monitored surrounding environment comprises generating an indication of an abnormal behavior of the user responsive to detection of more than a threshold amount of variation in at least one of the relative position and the surrounding environment.

2. The wearable device according to claim 1 , further comprising at least one of the following:

a first camera configured to capture the first image;

a second camera different from the first camera and configured to capture the second image; and

a set of sensors configured to collect the sensor data.

3. The wearable device according to claim 2 , wherein the set of sensors comprises a set of pressure sensors, and when the wearable device is worn by the user, the set of pressure sensors is distributed at the top side, left side, and right side of the head of the user.

4. The wearable device according to claim 1 , wherein the first image comprises an image of an iris of the user, and wherein the processing unit is configured to:

verify the identity of the user by comparing the image of the iris with predetermined iris information.

5. The wearable device according to claim 1 , wherein the processing unit is configured to:

if it is determined that a change in the relative position exceeds a first threshold, determine whether the second image has changed; and

if it is determined that the second image has changed, provide the indication about the abnormal behavior of the user.

6. The wearable device according to claim 1 , wherein the processing unit is configured to:

if it is determined that there is a person other than the user in the surrounding environment, provide the indication about the abnormal behavior of the user.

7. The wearable device according to claim 1 , wherein the processing unit is further configured to:

if the verification on the identity of the user succeeds, determine whether there is a person other than the user in the surrounding environment by comparing sound data of the user collected by a microphone of the wearable device with predetermined sound features; and

if it is determined that there is the person, provide the indication about the abnormal behavior of the user.

8. The wearable device according to claim 1 , wherein the processing unit is configured to: if the verification on the identity of the user succeeds, obtain and analyze the first image at predetermined time intervals to verify the identity of the user.

9. An electronic device, comprising:

at least one processor; and

at least one memory storing computer program instructions, wherein the at least one memory and the computer program instructions are configured to cause, together with the at least one processor, the electronic device to perform actions comprising:

verifying an identity of a user by analyzing user data related to the user and obtained by a wearable device, the user data comprising at least a first image of a part of the user's body;

if the verification on the identity of the user succeeds,

monitoring a relative position of the wearable device with respect to the user based on sensor data obtained by the wearable device;

monitoring a surrounding environment external to the user based on a second image of the surrounding environment obtained by the wearable device when mounted on the user; and

monitoring behaviors of the user based at least in part on the monitored relative position and the monitored surrounding environment;

wherein monitoring behaviors of the user based at least in part on the monitored relative position and the monitored surrounding environment comprises generating an indication of an abnormal behavior of the user responsive to detection of more than a threshold amount of variation in at least one of the relative position and the surrounding environment.

10. A method for monitoring a user, comprising:

verifying an identity of the user by analyzing user data related to the user and obtained by a wearable device, the user data comprising at least a first image of a part of the user's body;

if the verification on the identity of the user succeeds,

monitoring a relative position of the wearable device with respect to the user based on sensor data obtained by the wearable device;

monitoring a surrounding environment external to the user based on a second image of the surrounding environment obtained by the wearable device when mounted on the user; and

monitoring behaviors of the user based at least in part on the monitored relative position and the monitored surrounding environment;

wherein monitoring behaviors of the user based at least in part on the monitored relative position and the monitored surrounding environment comprises generating an indication of an abnormal behavior of the user responsive to detection of more than a threshold amount of variation in at least one of the relative position and the surrounding environment.

11. The method according to claim 10 , wherein

the first image is captured by a first camera of the wearable device;

the second image is captured by a second camera of the wearable device, the second camera being different from the first camera; and

the sensor data is collected by a set of sensors of the wearable device.

12. The method according to claim 11 , wherein the set of sensors comprises a set of pressure sensors, and when the wearable device is worn by the user, the set of pressure sensors is distributed at the top side, left side, and right side of the head of the user.

13. The method according to claim 10 , wherein the first image comprises an image of an iris of the user, and wherein verifying the identity of the user by analyzing the first image comprises:

verifying the identity of the user by comparing the image of the iris with predetermined iris information.

14. The method according to claim 10 , wherein monitoring the behaviors of the user comprises:

if it is determined that a change in the relative position exceeds a first threshold, determining whether the second image has changed; and

if it is determined that the second image has changed, providing the indication about the abnormal behavior of the user.

15. The method according to claim 10 , wherein monitoring the behaviors of the user comprises:

if it is determined that there is a person other than the user in the surrounding environment, providing the indication about an abnormal behavior of the user.

16. The method according to claim 10 , further comprising:

if the verification on the identity of the user fails, providing an indication that the identity of the user is incorrect.

17. The method according to claim 10 , wherein the user data further comprises at least one of the following:

identity data of the user collected by a near field communication (NFC) sensor of the wearable device, and

sound data collected by a microphone of the wearable device.

18. The method according to claim 10 , further comprising:

if the verification on the identity of the user succeeds, determining whether there is a person other than the user in the surrounding environment by comparing sound data collected by a microphone of the wearable device with predetermined sound features; and

if it is determined that there is the person, providing the indication about the abnormal behavior of the user.

19. The method according to claim 10 , further comprising:

if the verification on the identity of the user succeeds, obtaining and analyzing the first image at predetermined time intervals to verify the identity of the user.

20. A computer program product tangibly stored in a non-volatile computer-readable medium and comprising machine-executable instructions that, when executed by a device, cause the device to execute the method according to claim 10 .

Assignments (10)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0280) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0255 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0124) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0012 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056295/0001) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062021/0844 →
RELEASE OF SECURITY INTEREST Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058297/0332 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0124 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0001 →
SECURITY INTEREST Recorded May 19, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056295/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE MISSING PATENTS THAT WERE ON THE ORIGINAL SCHEDULED SUBMITTED BUT NOT ENTERED PREVIOUSLY RECORDED AT REEL: 056250 FRAME: 0541. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 17, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056311/0781 →
SECURITY AGREEMENT Recorded May 14, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056250/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2021
From: HOU, ANZHOU; SHA, DANQING; JIA, ZHEN; HE, BIN
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 055092/0457 →
Priority Claims (1)
CN 202011633324.0 · Dec 31, 2020 · national
Continuity (1)
Related Publication 20220206568A1 · Jun 30, 2022