IP Library › Granted Patent US 12,596,769
Granted Patent B2
US 12,596,769 · App. 19/301,204 · Granted Apr 7, 2026

Systems and methods of sensor data fusion

Inventor: Armando Montalvo (Winter Garden, FL)
Assignee: Digital Global Systems, Inc.
G06F18/256G06F17/18G06F18/217G06F18/2431G06F18/25G06F18/251G06N3/02B60W2556/35G05D2111/67G06F18/213G06N5/04G06N20/00G08B29/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,596,769
App. No.
19/301,204
Granted
Apr 7, 2026
Kind
B2
Abstract

Systems and methods of sensor data fusion including sensor data capture, curation, linking, fusion, inference, and validation. The systems and methods described herein reduce computational demand and processing time by curating data and calculating conditional entropy. The system is operable to fuse data from a plurality of sensor types. A computer processor optionally stores fused sensor data that the system validates above a mathematical threshold.

Claims (58)

1 . A system for sensor data fusion for sensor management and utilization in robotics, comprising:

at least one computer processor including a memory;

at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine;

at least one first position sensor operable to capture a first position measurement of a robotic component; and

at least one second position sensor operable to capture a second position measurement of the robotic component;

wherein the at least one computer processor is operable to analyze the first position measurement and the second position measurement;

wherein the at least one curation engine is operable to curate the first position measurement and the second position measurement, the at least one link engine is operable to link the first position measurement and the second position measurement, the at least one fusion engine is operable to fuse the first position measurement and the second position measurement, the at least one inference engine is operable to determine at least one inference from the first position measurement and the second position measurement, and the at least one validation engine is operable to validate the first position measurement and the second position measurement;

wherein the at least one link engine is operable to calculate a non-existent link, a weak link, or a strong link via calculating a conditional entropy between the first position measurement and the second position measurement;

wherein the at least one fusion engine is operable to fuse the first position measurement and the second position measurement based in part on the strong link, thereby creating fused data;

wherein the fused data includes at least one new data set;

wherein the at least one validation engine is operable to actively validate the fused data before the at least one computer processor permanently saves the fused data;

wherein the actively validating the fused data includes the at least one first position sensor capturing a third position measurement of the robotic component and the at least one second position sensor capturing a fourth position measurement of the robotic component;

wherein the at least one inference engine is operable to determine improperly wired sensors based in part on the at least one new data set; and

wherein the at least one computer processor is operable to instruct the robotic component to move based on the at least one new data set.

2 . The system of claim 1 , wherein the at least one link engine is operable to dynamically adjust a threshold for calculating the non-existent link, the weak link, or the strong link.

3 . The system of claim 1 , wherein the at least one fusion engine is operable to fuse at least one first position property and/or at least one first position sub-property and at least one second position property and/or at least one second position sub-property.

4 . The system of claim 3 , wherein the at least one first position property and/or the at least one first position sub-property is different than the at least one second position property and/or the at least one second position sub-property.

5 . The system of claim 1 , wherein the at least one fusion engine is operable to fuse the first position measurement and the second position measurement in real-time.

6 . The system of claim 1 , wherein the at least one new data set further includes a prediction about a future event.

7 . The system of claim 1 , wherein the at least one inference engine is operable to determine the at least one inference in real time.

8 . A method for sensor data fusion for sensor management and utilization in robotics, comprising:

providing at least one computer processor including a memory;

providing at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine;

at least one first position sensor capturing a first position measurement of a robotic component;

at least one second position sensor capturing a second position measurement of the robotic component;

analyzing by the at least one computer processor the first position measurement and the second position measurement;

curating by the at least one curation engine the first position measurement and the second position measurement, linking by the at least one link engine the first position measurement and the second position measurement, fusing by the at least one fusion engine the first position measurement and the second position measurement, determining at least one inference by the at least one inference engine from the first position measurement and the second position measurement, and validating by the at least one validation engine the first position measurement and the second position measurement;

calculating by the at least one link engine a non-existent link, a weak link, or a strong link via calculating a conditional entropy between the first position measurement and the second position measurement;

fusing by the at least one fusion engine the first position measurement and the second position measurement based in part on the strong link, thereby creating fused data;

wherein the fused data includes at least one new data set;

wherein the at least one validation engine is operable to actively validate the fused data before the at least one computer processor permanently saves the fused data;

wherein the actively validating the fused data includes the at least one first position sensor capturing a third position measurement of the robotic component and the at least one second position sensor capturing a fourth position measurement of the robotic component;

determining by the at least one inference engine improperly wired sensors based in part on the at least one new data set; and

instructing by the at least one computer processor the robotic component to move based on the at least one new data set.

9 . The method of claim 8 , further comprising predicting a future event based in part on the fused data.

10 . The method of claim 8 , further comprising dynamically adjusting via the at least one link engine a threshold for calculating the non-existent link, the weak link, or the strong link.

11 . The method of claim 8 , wherein the at least one inference engine is operable to determine the at least one inference in real time.

12 . The method of claim 8 , further comprising fusing via the at least one fusion engine at least one first position property and/or at least one first position sub-property and at least one second position property and/or at least one second position sub-property.

13 . The method of claim 12 , wherein the at least one first position property and/or the at least one first sub-property is different than the at least one second position property and/or the at least one second position sub-property.

14 . The method of claim 8 , wherein fusing the first position measurement and the second position measurement occurs in real-time.

15 . A system for sensor data fusion for sensor management and utilization in robotics, comprising:

at least one computer processor including a memory;

at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine; and

at least two sensors, each of the at least two sensors operable to measure a first position of a robotic component and a second position of the robotic component;

wherein the at least one computer processor is operable to analyze the first position and the second position;

wherein the at least one curation engine is operable to curate the first position and the second position, the at least one link engine is operable to link the first position and the second position, the at least one fusion engine is operable to fuse the first position and the second position, the at least one inference engine is operable to determine at least one inference from the first position and the second position, and the at least one validation engine is operable to validate the first position and the second position;

wherein the at least one link engine is operable to iteratively calculate a non-existent link, a weak link, or a strong link via calculating a conditional entropy between the first position and the second position;

wherein the at least one fusion engine is operable to fuse the first position, the second position, at least one first position property and/or at least one first position sub-property, and at least one second position property and/or at least one second position sub-property based in part on the strong link thereby creating fused data;

wherein the fused data includes at least one new data set;

wherein the at least one validation engine is operable to actively validate the fused data before the at least one computer processor permanently saves the fused data;

wherein the actively validating the fused data includes the at least one first position sensor capturing a third position measurement of the robotic component and the at least one second position sensor capturing a fourth position measurement of the robotic component;

wherein the at least one inference engine is operable to determine improperly wired sensors based in part on the at least one new data set; and

wherein the at least one computer processor is operable to instruct the robotic component to move based on the at least one new data set.

16 . The system of claim 15 , wherein the at least one new data set further includes a prediction about a future event.

17 . The system of claim 15 , wherein the at least one inference engine is operable to determine the at least one inference in real time.

18 . The system of claim 15 , wherein the at least one fusion engine is operable to fuse the first position, the second position, the at least one first position property and/or the at least one first position sub-property, and the at least one second position property and/or the at least one second position sub-property in real-time.

19 . The system of claim 15 , wherein the at least one first position property and/or the at least one first position sub-property is the same as the at least one second position property and/or the at least one second position sub-property.

20 . The system of claim 15 , wherein the at least one first position property and/or the at least one first position sub-property is different than the at least one second position property and/or the at least one second position sub-property.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2025
From: MONTALVO, ARMANDO
To: DIGITAL GLOBAL SYSTEMS, INC.
Reel/Frame 072212/0650 →
Continuity (4)
Continuation 19016249 · Jan 10, 2025
Continuation 18990145 · Dec 20, 2024
Continuation 18988120 · Dec 19, 2024
Related Publication 20250378141A1 · Dec 11, 2025
References Cited (181)
US 3924094A · Hansen et al. · 1975 [cited by applicant]
US 6026340A · Corrado et al. · 2000 [cited by applicant]
US 9367683B2 · Kolacinski et al. · 2016 [cited by applicant]
US 9383753B1 · Templeton et al. · 2016 [cited by applicant]
US 10073456B2 · Mudalige et al. · 2018 [cited by applicant]
US 10095230B1 · Hardin · 2018 [cited by applicant]
US 10748075B2 · Chowdhary et al. · 2020 [cited by applicant]
US 10766137B1 · Porter et al. · 2020 [cited by applicant]
US 10959371B2 · Zhou et al. · 2021 [cited by applicant]
US 11037320B1 · Ebrahimi Afrouzi et al. · 2021 [cited by applicant]
US 11040444B2 · Cristache · 2021 [cited by applicant]
US 11436429B2 · Jaganathan et al. · 2022 [cited by applicant]
US 11586865B2 · Brahma et al. · 2023 [cited by applicant]
US 11688074B2 · Puri et al. · 2023 [cited by applicant]
US 11966413B2 · Latapie et al. · 2024 [cited by applicant]
US 11983625B2 · Ahuja et al. · 2024 [cited by applicant]
US 12105211B2 · Carcanague et al. · 2024 [cited by applicant]
US 12112174B2 · Sodani et al. · 2024 [cited by applicant]
US 12174301B2 · Hu et al. · 2024 [cited by applicant]
US 12217831B2 · Jaganathan et al. · 2025 [cited by applicant]
US 12287851B1 · Montalvo · 2025 [cited by applicant]
US 20040019575A1 · Talbot et al. · 2004 [cited by applicant]
US 20050110620A1 · Takeichi et al. · 2005 [cited by applicant]
US 20070239314A1 · Kuvich · 2007 [cited by applicant]
US 20080005075A1 · Horvitz et al. · 2008 [cited by applicant]
US 20080312756A1 · Grichnik et al. · 2008 [cited by applicant]
US 20100164787A1 · Khosravy et al. · 2010 [cited by applicant]
US 20120100799A1 · Tsuchimoto et al. · 2012 [cited by applicant]
US 20120134280A1 · Rotvold et al. · 2012 [cited by applicant]
US 20130325241A1 · Lombrozo et al. · 2013 [cited by applicant]
US 20140070945A1 · Dave et al. · 2014 [cited by applicant]
US 20140114464A1 · Williams et al. · 2014 [cited by applicant]
US 20150306770A1 · Mittal et al. · 2015 [cited by applicant]
US 20160033965A1 · Kopetz · 2016 [cited by applicant]
US 20170004411A1 · Hassan et al. · 2017 [cited by applicant]
US 20170048010A1 · Chowdhery et al. · 2017 [cited by applicant]
US 20170195090A1 · Boidol et al. · 2017 [cited by applicant]
US 20170250751A1 · Kargieman et al. · 2017 [cited by applicant]
US 20180021908A1 · Veittinger · 2018 [cited by applicant]
US 20180032891A1 · Ba et al. · 2018 [cited by applicant]
US 20180284758A1 · Cella et al. · 2018 [cited by applicant]
US 20180343072A1 · Kiannejad · 2018 [cited by applicant]
US 20190049970A1 · Djuric et al. · 2019 [cited by applicant]
US 20190158581A1 · Giannella et al. · 2019 [cited by applicant]
US 20190206400A1 · Cui et al. · 2019 [cited by applicant]
US 20190258251A1 · Ditty et al. · 2019 [cited by applicant]
US 20190294999A1 · Guttmann · 2019 [cited by applicant]
US 20190295001A1 · Fusco et al. · 2019 [cited by applicant]
US 20200026289A1 · Alvarez et al. · 2020 [cited by applicant]
US 20200049511A1 · Sithiravel et al. · 2020 [cited by applicant]
US 20200116837A1 · Aghari et al. · 2020 [cited by applicant]
US 20200219316A1 · Baik et al. · 2020 [cited by applicant]
US 20200265247A1 · Musk et al. · 2020 [cited by applicant]
US 20200300658A1 · Zhang et al. · 2020 [cited by applicant]
US 20200303033A1 · Benz et al. · 2020 [cited by applicant]
US 20200380338A1 · Matsumura · 2020 [cited by applicant]
US 20200405403A1 · Shelton, IV · 2020 [cited by examiner]
US 20210033735A1 · Kleeman · 2021 [cited by applicant]
US 20210150230A1 · Smolyanskiy et al. · 2021 [cited by applicant]
US 20210194988A1 · Chaysinh et al. · 2021 [cited by applicant]
US 20210246003A1 · Wu et al. · 2021 [cited by applicant]
US 20210278523A1 · Urtasun et al. · 2021 [cited by applicant]
US 20210290311A1 · Fuerst et al. · 2021 [cited by applicant]
US 20210318121A1 · Laroche et al. · 2021 [cited by applicant]
US 20210331695A1 · Ramakrishnan et al. · 2021 [cited by applicant]
US 20210342656A1 · Mittal et al. · 2021 [cited by applicant]
US 20210406560A1 · Park et al. · 2021 [cited by applicant]
US 20220012562A1 · Lazaro-Gredilla et al. · 2022 [cited by applicant]
US 20220035376A1 · Laddah et al. · 2022 [cited by applicant]
US 20220075077A1 · Kato et al. · 2022 [cited by applicant]
US 20220126864A1 · Moustafa et al. · 2022 [cited by applicant]
US 20220146652A1 · Cardei et al. · 2022 [cited by applicant]
US 20220161356A1 · Fujiwara et al. · 2022 [cited by applicant]
US 20220161815A1 · Van Beek et al. · 2022 [cited by applicant]
US 20220179056A1 · Braley et al. · 2022 [cited by applicant]
US 20220266399A1 · Griffin et al. · 2022 [cited by applicant]
US 20220289175A1 · Kasarla et al. · 2022 [cited by applicant]
US 20220324464A1 · Collin et al. · 2022 [cited by applicant]
US 20220348223A1 · Zhao et al. · 2022 [cited by applicant]
US 20220396281A1 · Brännström et al. · 2022 [cited by applicant]
US 20230038842A1 · Yu et al. · 2023 [cited by applicant]
US 20230079238A1 · Cristache · 2023 [cited by applicant]
US 20230082656A1 · Li et al. · 2023 [cited by applicant]
US 20230110027A1 · Bajpayee et al. · 2023 [cited by applicant]
US 20230112441A1 · Tang et al. · 2023 [cited by applicant]
US 20230149101A1 · Mottram et al. · 2023 [cited by applicant]
US 20230166765A1 · Yoon et al. · 2023 [cited by applicant]
US 20230182768A1 · Oh · 2023 [cited by applicant]
US 20230190204A1 · Helm et al. · 2023 [cited by applicant]
US 20230191608A1 · Horowitz et al. · 2023 [cited by applicant]
US 20230191617A1 · Kim et al. · 2023 [cited by applicant]
US 20230215028A1 · Kim et al. · 2023 [cited by applicant]
US 20230244996A1 · Kumar et al. · 2023 [cited by applicant]
US 20230256618A1 · Park et al. · 2023 [cited by applicant]
US 20230270506A1 · Goodchild et al. · 2023 [cited by applicant]
US 20230331235A1 · Shuman et al. · 2023 [cited by applicant]
US 20230342944A1 · Sullivan et al. · 2023 [cited by applicant]
US 20230347517A1 · Ma et al. · 2023 [cited by applicant]
US 20230394334A1 · Kang et al. · 2023 [cited by applicant]
US 20240038076A1 · Omi et al. · 2024 [cited by applicant]
US 20240045426A1 · Ditty et al. · 2024 [cited by applicant]
US 20240046612A1 · Panetta et al. · 2024 [cited by applicant]
US 20240058948A1 · Zhai et al. · 2024 [cited by applicant]
US 20240112428A1 · Levi et al. · 2024 [cited by applicant]
US 20240123619A1 · Ning · 2024 [cited by applicant]
US 20240138926A1 · Goodchild et al. · 2024 [cited by applicant]
US 20240142994A1 · Ebrahimi Afrouzi · 2024 [cited by applicant]
US 20240144082A1 · Tarapov et al. · 2024 [cited by applicant]
US 20240152734A1 · Ye · 2024 [cited by applicant]
US 20240159891A1 · Patel · 2024 [cited by applicant]
US 20240175893A1 · Kimishima et al. · 2024 [cited by applicant]
US 20240246559A1 · Agrawal · 2024 [cited by applicant]
US 20240249165A1 · Roche et al. · 2024 [cited by applicant]
US 20240267779A1 · Wu et al. · 2024 [cited by applicant]
US 20240289930A1 · Yang et al. · 2024 [cited by applicant]
US 20240289981A1 · Kuo et al. · 2024 [cited by applicant]
US 20240296044A1 · Day et al. · 2024 [cited by applicant]
US 20240312219A1 · Choi et al. · 2024 [cited by applicant]
US 20240317254A1 · Tran · 2024 [cited by applicant]
US 20240324838A1 · Ebrahimi Afrouzi · 2024 [cited by applicant]
US 20240331403A1 · Shen et al. · 2024 [cited by applicant]
US 20240378353A1 · Hansen et al. · 2024 [cited by applicant]
US 20240378412A1 · Schrader · 2024 [cited by applicant]
US 20240382216A1 · Hage et al. · 2024 [cited by applicant]
US 20240400100A1 · Harihara Gupta et al. · 2024 [cited by applicant]
US 20240408495A1 · Hibi et al. · 2024 [cited by applicant]
US 20240412494A1 · Balachandran et al. · 2024 [cited by applicant]
US 20240419974A1 · Nehmadi et al. · 2024 [cited by applicant]
US 20250026371A1 · Andert et al. · 2025 [cited by applicant]
US 20250053731A1 · Kantimahanti et al. · 2025 [cited by applicant]
US 20250130316A1 · Asghari et al. · 2025 [cited by applicant]
US 20250139807A1 · Zou et al. · 2025 [cited by applicant]
US 20250141504A1 · Himmelfarb · 2025 [cited by applicant]
US 20250148053A1 · Montalvo · 2025 [cited by applicant]
US 20250165120A1 · Amitay et al. · 2025 [cited by applicant]
US 20250200431A1 · Marzban et al. · 2025 [cited by applicant]
US 20250217863A1 · Tunkelang et al. · 2025 [cited by applicant]
US 20250224236A1 · Kabalar et al. · 2025 [cited by applicant]
US 20250237504A1 · Kuhlmann et al. · 2025 [cited by applicant]
US 20250293764A1 · Darabi et al. · 2025 [cited by applicant]
US 20250295461A1 · Brubaker et al. · 2025 [cited by applicant]
CN 105956290B · 2016 [cited by applicant]
CN 110598299A · 2019 [cited by applicant]
CN 110909762A · 2020 [cited by applicant]
CN 113291493A · 2021 [cited by applicant]
CN 115561795A · 2023 [cited by applicant]
CN 116522279A · 2023 [cited by applicant]
CN 118419285A · 2024 [cited by applicant]
CN 118427205A · 2024 [cited by applicant]
CN 118764836A · 2024 [cited by applicant]
DE 102018220024 · 2020 [cited by applicant]
EP 4008497A1 · 2022 [cited by examiner]
WO 2010107379A1 · 2010 [cited by applicant]
WO 2022072921A1 · 2022 [cited by applicant]
WO 2024186551A1 · 2024 [cited by applicant]
WO 2024228863A1 · 2024 [cited by applicant]
Brush, “Measurement of microwave power—A review of techniques used for measurement of high-frequency RF power” IEEE Instrumentation & Measurement Magazine Apr. 2007 (Year: 2007). [cited by applicant]
Chen et al., “Track correlation uncertainty evaluation for Multi-sensor Data Fusion System and its application” 2021 IEEE (Year: 2021). [cited by applicant]
Chung et al., “Entropy-Based Markov Chains for Multisensor Fusion” Journal of Intelligent and Robotic Systems 29: 161a189, 2000 (Year: 2000). [cited by applicant]
CN110598299—English translation, submitted 2025. [cited by applicant]
CN115561795—English translation, Submitted 2025. [cited by applicant]
DE-102018220024-B3 machine translation, downloaded Jul. 2025 (Year: 2025). [cited by applicant]
Ebel, Patrick, and et al. “SEN12MS-CR-TS: A remote-sensing data set for multi modal multitemporal cloud removal.” IEEE Transactions on Geoscience and Remote Sensing 60 (2022): 1-14 (Year: 2022). [cited by applicant]
Eenennaam, Providing over-the-horizon awareness to driver support systems by means of multi-hop ad hoc vehicle -to-vehicle communication (thesis); 2008 [retrieved Jul. 25, 2025], University of Twente, 204 pages.https://… [cited by applicant]
Kleber et al., “Cooperative Cross-Correlation Algorithm to Optimize Linearity of Fused RF Sensors” IEEE Sensors Journal, vol. 20, No. 7, Apr. 1, 2020 (Year: 2020). [cited by applicant]
Lanegger et al., “To Fuse or Not to Fuse: Measuring Consistency in Multi-Sensor Fusion for Aerial Robots” Springer, Aug. 2024 (Year: 2024). [cited by applicant]
Li, Belief Space-Guided Navigation for Robots and Autonomous Vehicles (thesis), May 2021 [retrieved Jul. 24, 2025], Texas A&M University, 123 pages. Retrieved: https://oaktrust.library. tamu.edu/server/api/core/bitstrea… [cited by applicant]
Liu et al., “A Method for Improving the Pose Accuracy of a Robot Manipulator Based on Multi-Sensor Combined Measurement and Data Fusion” Sensors 2015, 15, 7933-7952 (Year: 2015). [cited by applicant]
Peli et al., “Feature Level Sensor Fusion” Part of the SPIE Conference on Sensor Fusion: Architectures. Algorithms, and Applications III. Orlando, Florida, Apr. 1999 (Year: 1999). [cited by applicant]
Rumfelt et al., “Radio Frequency Power Measurements” Proceedings of the IEEE, vol. 55, No. 6, Jun. 1967 (Year: 1967). [cited by applicant]
Scibelli et al., “Low-cost Stellar Sensor for Attitude Control of Small Satellites” 2019 Photonics & Electromagnetics Research Symposium—Spring (PIERS-SPRING), Rome, Italy, Jun. 17-20, 2019. [cited by applicant]
Shen, Security Challenges and Defense Opportunities of Connected and Autonomous Vehicle Systems in the Physical World (thesis), 2022 (retrieved Jul. 24, 2025), University of California, Irvine, 304 pages. Retrieved: htt… [cited by applicant]
Tan et al., “A New Approach for Small Satellite Gyroscope and Star Tracker Fusion” Indian Journal of Science and Technology, vol. 9(17), May 2016 (Year: 2016). [cited by applicant]
Wei Z, and et al. MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review. Sensors (Basel). Mar. 25, 2022;22(7):2542. doi: 10.3390/s22072542. PMID: 35408157; PMCID: PMC9003130 (Year: 2022). [cited by applicant]
Yeong, D. J., Velasco-Hernandez, G., Barry, J., & Walsh, J. (2021). Sensor and sensor fusion technology in autonomous vehicles: A review. Sensors, 21(6), 2140. (Year: 2021). [cited by applicant]
Zhang, Compiler Support for Robust and High Performance Autonomous Driving Environments (thesis), 2022 (retrieved Jul. 24, 2025], University of Michigan Library, 125 pages. https://dx.doi.org/10. 7302/6919 (Year: 2022). [cited by applicant]
Kong, Lingbao, ant et al. “Multi-sensor measurement and data fusion technology for manufacturing process monitoring: a literature review.” International journal of extreme manufacturing 2, No. 2 (2020): 022001 (Year: 20… [cited by applicant]
Long et al., “The Design of Automated Validation System for Satellite Data Transmission System Based on AOS” 2022 15th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-… [cited by applicant]
Rizal, Muhammad, ant et al. “An embedded multi-sensor system on the rotating dynamometer for real-time condition monitoring in milling” Int J Adv Manuf Technol, https://doi.org/10.1007/s001 70-017-1251-8, (Year: 2017). [cited by applicant]
Machine translation for CN-113291493-A, downloaded 2025 (Year: 2025). [cited by applicant]
Machine translation for CN-118419285-A, downloaded 2025 (Year: 2025). [cited by applicant]