IP Library Granted Patent US 12,314,346
Granted Patent B2
US 12,314,346 · App. 18/988,120 · Granted May 27, 2025

Systems and methods of sensor data fusion

Inventor: Armando Montalvo (Winter Garden, FL)
Assignee: Digital Global Systems, Inc.
G06F18/2431G06F18/25G05D2111/67G06F17/18G06F18/213G06F18/256G06V10/80G08B29/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,314,346
App. No.
18/988,120
Granted
May 27, 2025
Kind
B2
Abstract

Systems and methods of sensor data fusion including sensor data capture, curation, linking, fusion, inference, and validation. The systems and methods described herein reduce computational demand and processing time by curating data and calculating conditional entropy. The system is operable to fuse data from a plurality of sensor types. A computer processor optionally stores fused sensor that the system validates above a mathematical threshold.

Claims (59)

1. A system for sensor data fusion for sensor management and utilization, comprising:

at least one computer processor including a memory;

at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine;

at least one first sensor, being of a first sensor type, operable to measure a first parameter of a machine; and

at least one second sensor, being of a second sensor type, operable to measure a second parameter of the machine;

wherein the at least one computer processor is operable to analyze the first parameter and the second parameter;

wherein the at least one computer processor is operable to receive at least one query;

wherein the at least one curation engine is operable to curate the first parameter and the second parameter, the at least one link engine is operable to link the first parameter and the second parameter via calculating a conditional entropy between the first parameter and the second parameter, the at least one fusion engine is operable to fuse the first parameter and the second parameter, the at least one inference engine is operable to determine an inference from the first parameter and the second parameter, and the at least one validation engine is operable to validate the first parameter and the second parameter;

wherein the at least one curation engine is operable to curate the first parameter and the second parameter by categorizing the first parameter and the second parameter into at least one property and/or sub-property based in part on the at least one query;

wherein the at least one curation engine is operable to filter the first parameter and the second parameter based in part on the at least one property and/or sub-property before storing the first parameter and the second parameter;

wherein the at least one curation engine is operable to calculate a degree of certainty that the at least one property and/or sub-property of the at least one first sensor is correlated to the at least one property and/or sub-property of the at least one second sensor;

wherein the at least one fusion engine is operable to fuse the first parameter and the second parameter, wherein the at least one fusion engine creates at least one new data set;

wherein the at least one computer processor is operable to instruct modification of the machine based on the at least one new data set; and

wherein the modification of the machine includes adjusting an orientation of a satellite.

2. The system of claim 1 , wherein the at least one first sensor and/or the at least one second sensor includes an accelerometer, a gyroscope, a force/torque sensor, a proximity sensor, a gear sensor, a magnetic sensor, a humidity sensor, an angle sensor, a temperature sensor, a 6-axis combo inertial sensor, a current sensor, a Light Detection and Ranging (LiDAR) sensor, radar sensor, ultrasonic sensor, visible spectrum camera, Global Positioning System (GPS) sensor, inertial measurement unit, infrared sensor, depth camera, load sensor, a thermal power sensor, a diode detector, and/or a spectrometer.

3. The system of claim 1 , wherein the at least one property and/or sub-property includes a timestamp and/or a measurement over a common period of time.

4. The system of claim 1 , wherein the at least one curation engine is operable to use artificial intelligence to automatically categorize the first parameter and the second parameter into the at least one property and/or sub-property based in part on historical accuracy of previous categorizations by an artificial intelligence engine.

5. The system of claim 1 , wherein the at least one first sensor and the at least one second sensor are operable to measure heterogeneous, partially heterogeneous, or homogeneous machines.

6. The system of claim 1 , wherein the at least one computer processor is located on or in a machine, an edge device, at least one server, and/or a cloud.

7. A method for sensor data fusion for sensor management and utilization, comprising:

providing at least one computer processor including a memory;

providing at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine;

at least one first sensor, being of a first sensor type, measuring a first parameter of a machine; and

at least one second sensor, being of a second sensor type, measuring a second parameter of the machine;

analyzing by the at least one computer processor the first parameter and the second parameter;

receiving by the computer processor at least one query;

curating the first parameter and the second parameter via the at least one curation engine, linking the first parameter and the second parameter via the at least one link engine via calculating a conditional entropy between the first parameter and the second parameter, fusing the first parameter and the second parameter via the at least one fusion engine, determining an inference from the first parameter and the second parameter via the at least one inference engine, and validating the first parameter and the second parameter via the at least one validation engine;

curating the first parameter and the second parameter by categorizing the first parameter and the second parameter into at least one property and/or sub-property based in part on the at least one query;

filtering by the at least one curation engine the first parameter and the second parameter based in part on the at least one property and/or sub-property before storing the first parameter and the second parameter;

calculating by the at least one curation engine a degree of certainty that the at least one property and/or sub-property of the at least one first sensor is correlated to the at least one property and/or sub-property of the at least one second sensor;

fusing the first parameter and the second parameter;

creating via the at least one fusion engine at least one new data set;

instructing modification of the machine by the at least one computer processor based in part on the at least one new data set; and

wherein the modification of the machine includes adjusting an orientation of a satellite.

8. The method of claim 7 , further comprising conducting pattern recognition via the at least one curation engine to calculate a statistical probability that the at least one property and/or sub-property of the first parameter and the second parameter are correlated.

9. The method of claim 7 , further comprising categorizing via the at least one curation engine using artificial intelligence the at least one property and/or sub-property of the first parameter and the second parameter based in part on historical accuracy of previous categorizations by the at least one curation engine.

10. The method of claim 7 , wherein the at least one first sensor and/or the at least one second sensor includes an accelerometer, a gyroscope, a force/torque sensor, a proximity sensor, a gear sensor, a magnetic sensor, a humidity sensor, an angle sensor, a temperature sensor, a 6-axis combo inertial sensor, a current sensor, a Light Detection and Ranging (LiDAR) sensor, radar sensor, ultrasonic sensor, visible spectrum camera, Global Positioning System (GPS) sensor, inertial measurement unit, infrared sensor, depth camera, load sensor, a thermal power sensor, a diode detector, and/or a spectrometer.

11. The method of claim 7 , further comprising curating the first parameter and the second parameter in real-time.

12. The method of claim 7 , wherein the at least one property and/or sub-property includes a timestamp and/or a measurement over a common period of time.

13. The method of claim 7 , wherein the first parameter and the second parameter are heterogeneous, partially heterogeneous, or homogeneous machines.

14. A system for sensor data fusion for sensor management and utilization, comprising:

at least one computer processor including a memory;

at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine;

at least one first sensor, being of a first sensor type, operable to measure a first parameter of a machine; and

at least one second sensor, being of a second sensor type, operable to measure a second parameter of the machine;

wherein the at least one computer processor is operable to analyze the first parameter and the second parameter;

wherein the at least one computer processor is operable to receive at least one query;

wherein the at least one curation engine is operable to curate the first parameter and the second parameter, the at least one link engine is operable to link the first parameter and the second parameter via calculating a conditional entropy between the first parameter and the second parameter, the at least one fusion engine is operable to fuse the first parameter and the second parameter, the at least one inference engine is operable to determine an inference from the first parameter and the second parameter, and the at least one validation engine is operable to validate the first parameter and the second parameter;

wherein the at least one curation engine is operable to curate the first parameter and the second parameter by categorizing the first parameter and the second parameter into at least one common property and/or common sub-property based in part on the at least one query;

wherein the at least one curation engine is operable to filter the first parameter and the second parameter based in part on the at least one common property and/or common sub-property before storing the first parameter and the second parameter;

wherein the at least one curation engine is operable to calculate a degree of certainty that the at least one common property and/or common sub-property of the at least one first sensor is correlated to the at least one common property and/or common sub-property of the at least one second sensor;

wherein the at least one fusion engine is operable to fuse the first parameter and the second parameter, wherein the at least one fusion engine creates at least one new data set;

wherein the at least one computer processor is operable to modify the machine based in part on the at least one new data set; and

wherein the modification of the machine includes adjusting an orientation of a satellite.

15. The system of claim 14 , wherein the at least one common property and/or common sub-property includes a timestamp and/or a measurement over a common period of time.

16. The system of claim 14 , wherein the at least one first sensor and/or the at least one second sensor includes an accelerometer, a gyroscope, a force/torque sensor, a proximity sensor, a gear sensor, a magnetic sensor, a humidity sensor, an angle sensor, a temperature sensor, a 6-axis combo inertial sensor, a current sensor, a Light Detection and Ranging (LiDAR) sensor, radar sensor, ultrasonic sensor, visible spectrum camera, Global Positioning System (GPS) sensor, inertial measurement unit, infrared sensor, depth camera, load sensor, a thermal power sensor, a diode detector, and/or a spectrometer.

17. The system of claim 14 , wherein the curation engine is operable to curate the first parameter and the second parameter in real-time.

18. The system of claim 14 , wherein the at least one first sensor and the at least one second sensor are operable to measure heterogeneous, partially heterogeneous, or homogeneous machines.

19. The system of claim 14 , wherein the at least one curation engine is operable to use an artificial intelligence engine to automatically categorize the first parameter and the second parameter into the at least one common property and/or common sub-property based in part on historical accuracy of previous categorizations by the at least one curation engine.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2025
From: MONTALVO, ARMANDO
To: DIGITAL GLOBAL SYSTEMS, INC.
Reel/Frame 070214/0056 →
Continuity (1)
Related Publication 20250124112A1 · Apr 17, 2025
References Cited (59)
US 9367683B2 · Kolacinski et al. · 2016 [cited by applicant]
US 10748075B2 · Chowdhary et al. · 2020 [cited by applicant]
US 10766137B1 · Porter et al. · 2020 [cited by applicant]
US 11037320B1 · Ebrahimi Afrouzi et al. · 2021 [cited by applicant]
US 11586865B2 · Brahma et al. · 2023 [cited by applicant]
US 20080312756A1 · Grichnik · 2008 [cited by examiner]
US 20150306770A1 · Mittal et al. · 2015 [cited by applicant]
US 20170004411A1 · Hassan et al. · 2017 [cited by applicant]
US 20180284758A1 · Cella · 2018 [cited by examiner]
US 20190206400A1 · Cui et al. · 2019 [cited by applicant]
US 20190258251A1 · Ditty et al. · 2019 [cited by applicant]
US 20190295001A1 · Fusco et al. · 2019 [cited by applicant]
US 20200026289A1 · Alvarez et al. · 2020 [cited by applicant]
US 20210150230A1 · Smolyanskiy et al. · 2021 [cited by applicant]
US 20210342656A1 · Mittal · 2021 [cited by examiner]
US 20220012562A1 · Lazaro-Gredilla et al. · 2022 [cited by applicant]
US 20220075077A1 · Kato et al. · 2022 [cited by applicant]
US 20220126864A1 · Moustafa et al. · 2022 [cited by applicant]
US 20220146652A1 · Cardei et al. · 2022 [cited by applicant]
US 20220161815A1 · Van Beek et al. · 2022 [cited by applicant]
US 20220179056A1 · Braley et al. · 2022 [cited by applicant]
US 20220324464A1 · Collin et al. · 2022 [cited by applicant]
US 20230082656A1 · Li et al. · 2023 [cited by applicant]
US 20230110027A1 · Bajpayee et al. · 2023 [cited by applicant]
US 20230112441A1 · Tang et al. · 2023 [cited by applicant]
US 20230166765A1 · Yoon et al. · 2023 [cited by applicant]
US 20230182768A1 · Oh · 2023 [cited by applicant]
US 20230342944A1 · Sullivan et al. · 2023 [cited by applicant]
US 20240045426A1 · Ditty et al. · 2024 [cited by applicant]
US 20240112428A1 · Levi et al. · 2024 [cited by applicant]
US 20240123619A1 · Ning · 2024 [cited by applicant]
US 20240142994A1 · Ebrahimi Afrouzi · 2024 [cited by applicant]
US 20240152734A1 · Ye · 2024 [cited by applicant]
US 20240249165A1 · Roche et al. · 2024 [cited by applicant]
US 20240289930A1 · Yang et al. · 2024 [cited by applicant]
US 20240289981A1 · Kuo et al. · 2024 [cited by applicant]
US 20240296044A1 · Day et al. · 2024 [cited by applicant]
US 20240312219A1 · Choi et al. · 2024 [cited by applicant]
US 20240317254A1 · Tran · 2024 [cited by applicant]
US 20240324838A1 · Ebrahimi Afrouzi · 2024 [cited by applicant]
US 20240331403A1 · Shen et al. · 2024 [cited by applicant]
US 20240378412A1 · Schrader · 2024 [cited by applicant]
US 20240408495A1 · Hibi et al. · 2024 [cited by applicant]
US 20250026371A1 · Andert et al. · 2025 [cited by applicant]
CN 110598299A · 2019 [cited by examiner]
CN 110909762A · 2020 [cited by applicant]
CN 115561795A · 2023 [cited by applicant]
CN 116522279A · 2023 [cited by examiner]
CN 118427205A · 2024 [cited by applicant]
WO 2024186551A1 · 2024 [cited by applicant]
WO 2024228863A1 · 2024 [cited by applicant]
Machine translation for CN_116522279_A, downloaded 2025 (Year: 2025). [cited by examiner]
Peli et al., “Feature Level Sensor Fusion” Part of the SPIE Conference on Sensor Fusion: Architectures. Algorithms, and Applications III . Orlando, Florida, Apr. 1999 (Year: 1999). [cited by examiner]
Chen et al., “Track correlation uncertainty evaluation for Multi-sensor Data Fusion System and its application” 2021 IEEE (Year: 2021). [cited by examiner]
Yeong, D. J., Velasco-Hernandez, G., Barry, J., & Walsh, J. (2021). Sensor and sensor fusion technology in autonomous vehicles: A review. Sensors, 21(6), 2140. (Year: 2021). [cited by applicant]
Ebel, Patrick, and et al. “SEN12MS-CR-TS: A remote-sensing data set for multi modal multitemporal cloud removal.” IEEE Transactions on Geoscience and Remote Sensing 60 (2022): 1-14 (Year: 2022). [cited by applicant]
Wei Z, and et al. MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review. Sensors (Basel). Mar. 25, 2022;22(7):2542. doi: 10.3390/s22072542. PMID: 35408157; PMCID: PMC9003130 (Year: 2022). [cited by applicant]
Lanegger et al., “To Fuse or Not to Fuse: Measuring Consistency in Multi-Sensor Fusion for Aerial Robots” Springer, Aug. 2024 (Year: 2024). [cited by applicant]
Liu et al., “A Method for Improving the Pose Accuracy of a Robot Manipulator Based on Multi-Sensor Combined Measurement and Data Fusion” Sensors 2015, 15, 7933-7952 (Year: 2015). [cited by applicant]