Systems and methods of sensor data fusion
Systems and methods of sensor data fusion including sensor data capture, curation, linking, fusion, inference, and validation. The systems and methods described herein reduce computational demand and processing time by curating data and calculating conditional entropy. The system is operable to fuse data from a plurality of sensor types. A computer processor optionally stores fused sensor data that the system validates above a mathematical threshold.
1 . A system for sensor data fusion for sensor management and utilization in robotics, comprising:
at least one computer processor including a memory;
at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine;
at least one first position sensor operable to capture a first position measurement corresponding to a first position of a robotic component; and
at least one second position sensor operable to capture a second position measurement corresponding to the first position of the robotic component;
wherein the at least one computer processor is operable to analyze the first position measurement and the second position measurement;
wherein the at least one computer processor is operable to receive at least one query;
wherein the at least one curation engine is operable to curate the first position measurement and the second position measurement, the at least one link engine is operable to link the first position measurement and the second position measurement via calculating a conditional entropy between the first position measurement and the second position measurement, the at least one fusion engine is operable to fuse the first position measurement and the second position measurement, thereby creating fused data, the at least one inference engine is operable to determine at least one inference from the first position measurement and the second position measurement, and the at least one validation engine is operable to validate the first position measurement and the second position measurement;
wherein the fused data includes at least one new data set;
wherein the at least one inference engine determines the at least one inference by using artificial intelligence based in part on the at least one query and/or the at least one new data set;
wherein the at least one validation engine is operable to actively validate the fused data;
wherein the actively validating the fused data includes modification of position of the at least one first position sensor, and the at least one first position sensor is operable to capture a third position measurement at the modified position to generate a second data set;
wherein the actively validating the fused data further includes the at least one validation engine comparing the fused data to the second data set via a statistical comparison;
wherein the at least one inference engine is operable to respond to the at least one query based in part on the at least one inference;
wherein the at least one inference engine is operable to determine internal sensor damage for the at least one first position sensor and the at least one second position sensor based on the at least one inference; and
wherein the at least one computer processor is operable to instruct the robotic component to move to a second position based on the at least one new data set and the first position measurement and the second position measurement.
2 . The system of claim 1 , wherein the response to the at least one query includes a position of the robotic component.
3 . The system of claim 1 , wherein the at least one query is user and/or computer generated.
4 . The system of claim 1 , wherein the at least one inference engine is operable to determine which of the at least one first position sensor and/or the at least one second position sensor the at least one computer processor responds to based in part on the at least one inference.
5 . The system of claim 1 , wherein the at least one inference includes a numerical value.
6 . The system of claim 1 , wherein the at least one inference includes a prediction of a future event based in part on the fused data.
7 . A method for sensor data fusion for sensor management and utilization in robotics, comprising:
providing at least one computer processor including a memory;
providing at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine;
at least one first position sensor capturing a first position measurement corresponding to a first position of a robotic component;
at least one second position sensor capturing a second position measurement corresponding to the first position of the robotic component;
analyzing by the at least one computer processor the first position measurement and the second position measurement;
receiving by the at least one computer processor at least one query;
curating by the at least one curation engine the first position measurement and the second position measurement, linking by the at least one link engine the first position measurement and the second position measurement via calculating a conditional entropy between the first position measurement and the second position measurement, fusing by the at least one fusion engine the first position measurement and the second position measurement, thereby creating fused data, determining at least one inference by the at least one inference engine from the first position measurement and the second position measurement, and validating by the at least one validation engine the first position measurement and the second position measurement;
wherein the fused data includes at least one new data set;
determining via the at least one inference engine the at least one inference by using artificial intelligence based in part on the at least one query and/or the at least one new data set;
actively validating by the at least one validation engine the fused data;
wherein the actively validating the fused data includes modifying position of the at least one first position sensor, and the at least one first position sensor is operable to capture a third position measurement at the modified position to generate a second data set;
comparing via the at least one validation engine as part of the actively validating the fused data to the second data set via a statistical comparison;
determining by the at least one validation engine if the statistical comparison exceeds a predefined threshold to automatically validate the at least one inference in real time;
responding via the at least one inference engine the at least one query based in part on the at least one inference;
determining via the at least one inference engine internal sensor damage for the at least one first position sensor and the at least one second position sensor based on the at least one inference;
instructing by the at least one computer processor movement of the robotic component to a second position based on the at least one new data set and the first position measurement and the second position measurement.
8 . The method of claim 7 , wherein responding via the at least one inference engine to the at least one query includes a position of the robotic component.
9 . The method of claim 7 , wherein the at least one inference includes a numerical value.
10 . The method of claim 7 , further comprising predicting via the at least one inference engine a future event based in part on the fused data.
11 . The method of claim 7 , wherein the at least one query is user and/or computer generated.
12 . The method of claim 7 , further comprising determining via the at least one inference engine which of the at least one first position sensor and/or the at least one second position sensor the at least one computer processor responds to based in part on the at least one inference.
13 . A system for sensor data fusion for sensor management and utilization in robotics, comprising:
at least one computer processor including a memory;
at least one curation engine, at least one link engine, at least one fusion engine, at least one inference engine, and at least one validation engine; and
at least two sensors, each of the at least two sensors operable to measure a first position of a robotic component and a second position of the robotic component;
wherein the at least one computer processor is operable to analyze the first position and the second position;
wherein the at least one computer processor is operable to receive at least one query;
wherein the at least one curation engine is operable to curate the first position and the second position, the at least one link engine is operable to link the first position and the second position via calculating a conditional entropy between the first position measurement and the second position measurement, the at least one fusion engine is operable to fuse the first position and the second position, thereby creating fused data, the at least one inference engine is operable to determine at least one inference from the first position and the second position, and the at least one validation engine is operable to validate the first position and the second position;
wherein the fused data includes at least one new data set;
wherein the at least one inference engine determines the at least one inference by using artificial intelligence based in part on the at least one query and/or the at least one new data set;
wherein the at least one inference engine is operable to respond to the at least one query based in part on the at least one inference;
wherein the at least one validation engine is operable to actively validate the fused data;
wherein the actively validating the fused data includes modification of position of the at least one first position sensor, and the at least one first position sensor is operable to capture a third position measurement at the modified position to generate a second data set;
wherein the actively validating the fused data further includes the at least one validation engine comparing the fused data to the second data set via a statistical comparison;
wherein the at least one inference engine is operable to determine internal sensor damage for the at least two sensors based on the at least one inference; and
wherein the at least one computer processor is operable to instruct the robotic component to move to the third position based on the at least one new data set and the first position and the second position.
14 . The system of claim 13 , wherein the response to the at least one query includes a position of the robotic component.
15 . The system of claim 13 , wherein the at least one inference engine is operable to determine which of the at least one first position sensor and/or the at least one second position sensor the at least one computer processor responds to based in part on the at least one inference.
16 . The system of claim 13 , wherein the at least one inference includes a numerical value.
17 . The system of claim 13 , wherein the at least one inference engine is operable to determine the at least one inference in real-time.
18 . The system of claim 13 , wherein the at least one inference includes a prediction of a future event based in part on the fused data.
19 . The system of claim 13 , wherein the at least one new data set includes an accuracy value for the at least two sensors.