IP Library Granted Patent US 12,183,016
Granted Patent B2
US 12,183,016 · App. 17/992,508 · Granted Dec 31, 2024

System and method for transposition of a detected object and its tracking to a different device

Inventors: Saurav Agarwala (New Delhi, IN); Tushar Chhabra (New Delhi, IN)
Assignee: Mohammad Saud M Alghaith
G06T7/292G06F3/011G06T19/20G06V10/764G06V10/803G06V10/82G06V20/52G06V20/64G06V40/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,183,016
App. No.
17/992,508
Granted
Dec 31, 2024
Kind
B2
Abstract

A method is provided for transposition of a detected object and its tracking from a 3D sensor to a different system in 6 degrees of freedom. The method includes receiving sensing data from the one or more 3D sensors, generating 3D cartesian coordinates of reflections and intensities with respect to the respective 3D sensors, searching, detecting, classifying, segmenting, tracking and forecasting motion of objects in the 3D surrounding keeping the respective 3D sensor as origin, transposing the origin for the coordinates of the searched, detected, classified and tracked object in real time to one or more secondary devices, and providing the real time detection, classification and tracking of the object to a user context application with the one or more secondary devices as origin, without any delay real time covering all 6 Degrees of Freedom.

Claims (30)

1. A method ( 200 ) for transposition of a detected object and its tracking from a 3D sensor to a different system ( 100 ) in 6 degrees of freedom, the method comprising:

receiving ( 210 ) sensing data from the one or more 3D sensors ( 102 );

generating ( 220 ) 3D cartesian coordinates of reflections and intensities with respect to the respective 3D sensors;

searching, detecting, classifying, segmenting and forecasting motion ( 230 ) of objects in the 3D surrounding keeping the respective 3D sensor as origin;

transposing ( 240 ) the origin for the coordinates of the searched, detected, classified and tracked object in real time to one or more secondary devices ( 106 ) using a 4×4 matrix to determine new coordinates of the object covering all 6 degrees of freedom; and

providing ( 250 ) the real time detection, classification and tracking of the object to a user context application with the one or more secondary devices ( 106 ) as origin, without any delay in real time covering all 6 Degrees of Freedom.

2. The method ( 200 ) as claimed in claim 1 , wherein the objects are selected from one or more of living and non-living objects including humans of multiple age groups, animals, plants, furniture, vehicles, natural resources, eatables, crops, infrastructure, stationery, sign boards, wearables, musical instruments, sports equipment, mechanical tools, electrical equipment and electronic equipment.

3. The method ( 200 ) as claimed in claim 1 , wherein the one or more 3D sensors ( 102 ) are selected from a Light Detection and Ranging (LIDAR) sensor, Laser Detection and Ranging (LaDAR), Light Emitting Diode Detection and Ranging (LeDDAR) mmWave Radar, C or K Band Radar, Time of Flight (ToF) sensors, laser scanners or a combination thereof.

4. The method ( 200 ) as claimed in claim 1 , wherein the one or more secondary devices ( 106 ) are selected from one or more cameras, secondary sensors such as secondary LIDAR, RADAR, ultrasonic sensors, infrared sensors, lasers or a combination thereof.

5. The method ( 200 ) as claimed in claim 1 , wherein the step of transposing ( 240 ) the origin for the coordinates of the searched, detected & classified object from respective 3D sensors, further comprises definition and processing of a rotation matrix, a displacement matrix and a coordinate transpose matrix to determine new coordinates of the searched, detected & classified object having the one or more secondary devices ( 106 ) as origin;

wherein the coordinate transpose matrix is only a (4×4) matrix, even for 6 degrees of freedom, thereby keeping the processing power consumption and time complexity to a bare minimum.

6. A system ( 100 ) for transposition of a detected object and its tracking from a 3D sensor to a different system ( 100 ) in 6 degrees of freedom, the system ( 100 ) comprising:

one or more 3D sensors ( 102 );

one or more secondary devices ( 106 ); and

a processing module ( 104 ) connected with each of the one or more 3D sensors ( 102 ), one or more secondary devices ( 106 ) and a data repository ( 108 ), the processing module ( 104 ) comprising:

a memory unit ( 1042 ) configured to store machine-readable instructions; and

a processor ( 1044 ) operably connected with the memory unit ( 1042 ), the processor ( 1044 ) obtaining the machine-readable instructions from the memory unit ( 1042 ), and being configured by the machine-readable instructions to:

receive sensing data from the one or more 3D sensors ( 102 );

generate 3D cartesian coordinates of reflections and intensities with respect to the respective 3D sensors;

search, detect, classify, segment and forecast motion of objects in the 3D surrounding keeping the respective 3D sensor as origin;

transpose the origin for the coordinates of the searched, detected, classified and tracked object in real time to the one or more secondary devices ( 106 ) using a 4×4 matrix to determine new coordinates of the object covering all 6 degrees of freedom; and

provide the real time detection, classification and tracking of the object to a user application with the one or more secondary devices ( 106 ) as origin, without any delay in real time covering all 6 Degrees of Freedom.

7. The system ( 100 ) as claimed in claim 6 , wherein the processing module ( 104 ) further comprising:

a configurable processing unit ( 1046 ) operably connected with the memory unit ( 1042 ) and the processor ( 1044 ), configured to accelerate matrix multiplications by run time creation of soft logic cores to enable hardware threading when processing load increases and hence provide real time results; and

an operating system ( 1048 ) ( 100 ) configured to make the processing on the Software (SW) threads on processor ( 1044 ) and Hardware (HW) threads on configurable processing unit ( 1046 ) transparent to application.

8. The system ( 100 ) as claimed in claim 6 , wherein the objects are selected from one or more of living and non-living objects including humans of multiple age groups, animals, plants, furniture, vehicles, natural resources, eatables, crops, infrastructure, stationery, sign boards, wearables, musical instruments, sports equipment, mechanical tools, electrical equipment and electronic equipment.

9. The system ( 100 ) as claimed in claim 6 , wherein the one or more 3D sensors ( 102 ) are selected from a Light Detection and Ranging (LIDAR) sensor, Laser Detection and Ranging (LaDAR), Light Emitting Diode Detection and Ranging (LeDDAR) mmWave Radar, C or K Band Radar, Time of Flight (ToF) sensors, laser scanners or a combination thereof.

10. The system ( 100 ) as claimed in claim 6 , wherein the one or more secondary devices ( 106 ) are selected from one or more cameras, secondary sensors such as secondary LIDAR, RADAR, ultrasonic sensors, infrared sensors, lasers or a combination thereof.

11. The system ( 100 ) as claimed in claim 6 , wherein for transposing the origin for the coordinates of the searched, detected & classified object from respective 3D sensors, the processor ( 1044 ) is further configured to define and process a rotation matrix, a displacement matrix and a coordinate transpose matrix to determine new coordinates of the searched, detected & classified object having the one or more secondary devices ( 106 ) as origin;

wherein the coordinate transpose matrix is only a (4×4) matrix, even for 6 degrees of freedom, thereby keeping the processing power consumption and time complexity to a bare minimum.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2024
From: CRON AI LTD; CRON SYSTEMS PVT LTD
To: ALGHAITH, MOHAMMAD SAUD M
Reel/Frame 068969/0142 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 23, 2022
From: AGARWALA, SAURAV; CHHABRA, TUSHAR
To: CRON SYSTEMS PVT. LTD.
Reel/Frame 061862/0651 →
Priority Claims (1)
IN 202011021514 · May 22, 2020 · national
Continuity (2)
Continuation PCTIB2021054373 · May 20, 2021
Related Publication 20230089970A1 · Mar 23, 2023