IP Library › Granted Patent US 12,196,850
Granted Patent B2
US 12,196,850 · App. 17/817,027 · Granted Jan 14, 2025

Method and system to track and monitor human using an array of radars

Inventors: Satheesh Adimoolam (Bangalore, IN); Tapas Chakravarty (Kolkata, IN); Arindam Ray (Kolkata, IN)
Assignee: Tata Consultancy Services Limited
G01S13/89G01S13/72
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,196,850
App. No.
17/817,027
Granted
Jan 14, 2025
Kind
B2
Abstract

This disclosure relates generally to method and system to track and monitor human using an array of radars. Human tracking is necessarily important in security, especially with the growth of threats and incidents. Conventional systems and method lack in tracking target subject being authenticated to move around the monitoring environment. The present invention provides a method of detect human continually based on radar signals from an array of radars to track the presence of one or more target subjects associated within the monitoring environment. Further, a height surface plot of each target subject present in a radar range is constructed for identification. Then, each target subject present in the radar range of the monitoring environment based on mapping the height surface plot with a predefined height map. The characteristics of each target subject helps in detecting the target subject accurately.

Claims (50)

1. A processor implemented method to track and monitor target subject using an array of radars, the method comprising:

receiving, via one or more hardware processors, a radar signal from an array of radars configured to a monitoring environment, wherein the radar signal continually tracks the presence of one or more target subjects associated within the monitoring environment

authenticating each target subject present in the monitoring environment, via the one or more hardware processors, based on comparing a device ID associated with each target subject with a list of preregistered subject's device IDs;

constructing, via the one or more hardware processors, a height surface plot of each target subject present in a radar range for identification based on (i) the authenticated device ID of each target subject, and a 3D cloud point of the radar signal exhibiting the monitoring environment;

recognizing, via the one or more hardware processors, each target subject present in the radar range of the monitoring environment based on mapping the height surface plot with a predefined height map associated with the data source; and

tracking, via the one or more hardware processors, each target subject present in the radar range of the monitoring environment based on a closest mapped height surface plot and the device ID of each target subject.

2. The method as claimed in claim 1 , constructing the height surface plot of each target subject present in the radar range by,

plotting, the 3D point cloud comprising three co-ordinates (X,Y,Z) with the surface height of each target subject present within the radar range obtained from the radar signal, wherein the surface height of each target subject is computed using the Z coordinate;

forming, a plurality of grids for the 3D point cloud to obtain a field of view (FOV) of the moving target subject within its present radar range in the monitoring environment;

removing, outliers detected from the plurality of grids based on a threshold computed using a mean and a standard deviation, wherein the outliers are detected from each grid using a distance-based k nearest neighbor outlier detection technique; and

performing, interpolation to fill missing spots in the FOV to smoothen height surface plots at a predefined granularity to construct the height surface plot.

3. The method as claimed in claim 2 , wherein each grid of the 3D point cloud is formed by segmenting the monitoring environment into the plurality of grids having concentric circular area with a pre-defined area and a width, and wherein the plurality of grids are divided into patches.

4. The method as claimed in claim 2 , wherein the threshold is the sum of mean and the standard deviation with corresponding neighbors distant average of grids.

5. The method as claimed in claim 1 , wherein the height surface plot of each target subject is mapped based on the closest match with the height map having spatial distribution of height points over X and Y coordinates using standard classifiers.

6. The method as claimed in claim 1 , wherein the height surface plot represents target subjects' motion observed in the radar range of the monitoring environment.

7. The method as claimed in claim 1 , wherein a time spent by each target subject in the radar range of the monitoring environment is computed using the height surface plot and the device ID of corresponding target subject.

8. A system to track and monitor target subject using an array of radars comprises:

a memory ( 102 ) storing instructions;

one or more communication interfaces ( 106 ); and

one or more hardware processors ( 104 ) coupled to the memory ( 102 ) via the one or more communication interfaces ( 106 ), wherein the one or more hardware processors ( 104 ) are configured by the instructions to:

receive, a radar signal from an array of radars configured to a monitoring environment, wherein the radar signal continually tracks the presence of one or more target subjects associated within the monitoring environment;

authenticate, each target subject present in the monitoring environment, based on comparing a device ID associated with each target subject with a list of preregistered subject's device IDs;

construct, a height surface plot of each target subject present in a radar range for identification based on (i) the authenticated device ID of each target subject, and a 3D cloud point of the radar signal exhibiting the monitoring environment;

recognize, each target subject present in the radar range of the monitoring environment based on mapping the height surface plot with a predefined height map associated with the data source; and

track, each target subject present in the radar range of the monitoring environment based on a closest mapped height surface plot and the device ID of each target subject.

9. The system as claimed in claim 8 , constructing the height surface plot of each target subject present in the radar range by,

plotting, the 3D point cloud comprising three co-ordinates (X,Y,Z) with the surface height of each target subject present within the radar range obtained from the radar signal, wherein the surface height of each target subject is computed using the Z coordinate;

forming, a plurality of grids for the 3D point cloud to obtain a field of view (FOV) of the moving target subject within its present radar range in the monitoring environment;

removing, outliers detected from the plurality of grids based on a threshold computed using a mean and a standard deviation, wherein the outliers are detected from each grid using a distance based k nearest neighbor outlier detection technique; and

performing, interpolation to fill missing spots in the FOV to smoothen height surface plots at a predefined granularity to construct the height surface plot.

10. The system as claimed in claim 9 , wherein each grid of the 3D point cloud is formed by segmenting the monitoring environment into the plurality of grids having concentric circular area with a pre-defined area and a width, and wherein the plurality of grids are divided into patches.

11. The system as claimed in claim 9 , wherein the threshold is the sum of mean and the standard deviation with corresponding neighbors distant average of grids.

12. The system as claimed in claim 8 , wherein the height surface plot of each target subject is mapped based on the closest match with the height map having spatial distribution of height points over X and Y coordinates using standard classifiers.

13. The system as claimed in claim 8 , wherein the height surface plot represents target subjects' motion observed in the radar range of the monitoring environment.

14. The system as claimed in claim 8 , wherein a time spent by each target subject in the radar range of the monitoring environment is computed using the height surface plot and the device ID of corresponding target subject.

15. One or more non-transitory machine-readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors perform actions comprising:

receiving, a radar signal from an array of radars configured to a monitoring environment, wherein the radar signal continually tracks the presence of one or more target subjects associated within the monitoring environment

authenticating, each target subject present in the monitoring environment, based on comparing a device ID associated with each target subject with a list of preregistered subject's device IDs;

constructing, a height surface plot of each target subject present in a radar range for identification based on (i) the authenticated device ID of each target subject, and a 3D cloud point of the radar signal exhibiting the monitoring environment;

recognizing, each target subject present in the radar range of the monitoring environment based on mapping the height surface plot with a predefined height map associated with the data source; and

tracking, each target subject present in the radar range of the monitoring environment based on a closest mapped height surface plot and the device ID of each target subject.

16. The one or more non-transitory machine-readable information storage mediums of claim method as claimed in claim 15 , constructing the height surface plot of each target subject present in the radar range by,

plotting, the 3D point cloud comprising three co-ordinates (X,Y,Z) with the surface height of each target subject present within the radar range obtained from the radar signal, wherein the surface height of each target subject is computed using the Z coordinate;

forming, a plurality of grids for the 3D point cloud to obtain a field of view (FOV) of the moving target subject within its present radar range in the monitoring environment;

removing, outliers detected from the plurality of grids based on a threshold computed using a mean and a standard deviation, wherein the outliers are detected from each grid using a distance-based k nearest neighbor outlier detection technique; and

performing, interpolation to fill missing spots in the FOV to smoothen height surface plots at a predefined granularity to construct the height surface plot.

17. The one or more non-transitory machine-readable information storage mediums of claim 16 , wherein each grid of the 3D point cloud is formed by segmenting the monitoring environment into the plurality of grids having concentric circular area with a pre-defined area and a width, and wherein the plurality of grids are divided into patches.

18. The one or more non-transitory machine-readable information storage mediums of claim 16 , wherein the threshold is the sum of mean and the standard deviation with corresponding neighbors distant average of grids.

19. The one or more non-transitory machine-readable information storage mediums of claim 15 , wherein the height surface plot of each target subject is mapped based on the closest match with the height map having spatial distribution of height points over X and Y coordinates using standard classifiers.

20. The one or more non-transitory machine-readable information storage mediums of claim 15 , wherein a time spent by each target subject in the radar range of the monitoring environment is computed using the height surface plot and the device ID of corresponding target subject.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2022
From: ADIMOOLAM, SATHEESH; CHAKRAVARTY, TAPAS; RAY, ARINDAM
To: TATA CONSULTANCY SERVICES LIMITED
Reel/Frame 060704/0387 →
Priority Claims (1)
IN 202121036166 · Aug 10, 2021 · national
Continuity (1)
Related Publication 20230073570A1 · Mar 9, 2023
References Cited (23)
US 6225906B1 · Shore · 2001 [cited by examiner]
US 7567200B1 · Osterweil · 2009 [cited by examiner]
US 7893844B2 · Gottlieb · 2011 [cited by examiner]
US 7916066B1 · Osterweil · 2011 [cited by examiner]
US 8068051B1 · Osterweil · 2011 [cited by examiner]
US 8704702B2 · van Dorp · 2014 [cited by examiner]
US 10314489B2 · Chang · 2019 [cited by examiner]
US 10629049B2 · Hassey · 2020 [cited by examiner]
US 11516625B2 · Lagace · 2022 [cited by examiner]
US 20120001787A1 · van Dorp · 2012 [cited by examiner]
US 20130201316A1 · Binder · 2013 [cited by examiner]
US 20180160943A1 · Fyfe · 2018 [cited by examiner]
US 20190158340A1 · Zhang · 2019 [cited by examiner]
US 20200166611A1 · Lin · 2020 [cited by examiner]
US 20200406860A1 · Mai · 2020 [cited by examiner]
US 20210052221A1 · Panneer Selvam · 2021 [cited by examiner]
US 20210150872A1 · Ten Kate · 2021 [cited by examiner]
US 20210321953A1 · Panneer Selvam · 2021 [cited by examiner]
US 20220392325A1 · Chen · 2022 [cited by examiner]
US 20230000396A1 · Coffey · 2023 [cited by examiner]
US 20230200649A1 · Toth · 2023 [cited by examiner]
Matti Hämäläinen et al., “Ultra-Wideband Radar-Based Indoor Activity Monitoring for Elderly Care,” Sensors, 2020, vol. 21(9), Publisher: MDPI, https://www.mdpi.com/1424-8220/21/9/3158. [cited by applicant]
Peijun Zhao et al, “mID: Tracking and Identifying People with Millimeter Wave Radar,” International Conference on Distributed Computing in Sensor Systems (DCOSS), 2019, IEEE, http://www.cs.ox.ac.uk/files/10889/%5BDCOSS1… [cited by applicant]
Cited By (1)
US 12,626,575