System, device and method for functional plausibility checking of sensor data
A device, a sensor arrangement, a system and a method are provided for checking the plausibility of sensor data. The plausibility of the results of processing of sensor data is checked with an independent module by an alternative verification method at each stage, and quality indicators are calculated for the reliability of the calculated data from this plausibility check, which can be taken into account during further processing.
1. A system for checking the plausibility of sensor data, comprising:
a sensor arrangement including at least one sensor of a vehicle configured to generate the sensor data,
a first module configured and arranged to execute a processing algorithm to process the sensor data,
a second module configured and arranged to check the plausibility of the processed sensor data, and
a third module configured and arranged to monitor the plausibility check of the processed sensor data by calculating quality indicators for the at least one sensor that supplies the sensor data on the basis of results of the plausibility check,
wherein:
the first module has a first input, a first output and a second output,
the second module has a second input and a third output,
the third module has a third input and a fourth output, and
the modules are respectively further configured so that:
the sensor data is input into the first input of the first module, which processes the input sensor data by executing the processing algorithm, to produce processed sensor data that is output at the first output of the first module,
second data for checking plausibility is output at the second output of the first module and input into the second input of the second module,
the second module checks the plausibility of the sensor data by executing an alternative verification method, and accordingly produces the plausibility check results that are output at the third output of the second module and input into the third input of the third module, and
the third module weights the plausibility check results and therefrom calculates the quality indicators, wherein the calculated quality indicators indicate a quality of the at least one sensor supplying the sensor data and are output at the fourth output of the third module.
2. The system according to claim 1 ,
comprising a plurality of the first modules and a plurality of the second modules,
wherein the first modules are connected in series to associated ones of the second modules, and
wherein the processed sensor data of a preceding one of the first modules in series is input into the first input of a following one of the first modules in series.
3. The system according to claim 2 ,
wherein all of the sensor data input into the first inputs of the first modules and all of the processed sensor data output at the first outputs of the first modules is checked for plausibility by the second modules by executing the alternative verification method, and
wherein the plausibility check results that are output at the respective third outputs of the second modules are input into respective third inputs of the third module.
4. The system according to claim 1 , wherein the second data for checking the plausibility is identical to the processed sensor data.
5. The system according to claim 1 ,
wherein the first module has a further input, and
wherein the plausibility check results from the second module are input as plausibility check result feedback data into the further input of the first module.
6. The system according to claim 1 , wherein the alternative verification method includes the use of a second source of information to check the plausibility of the sensor data.
7. The system according to claim 1 ,
wherein the second module stores the plausibility check results of previous plausibility checks, and
wherein the second module uses the previous plausibility check results for checking the plausibility of the current sensor data.
8. A device for checking the plausibility of sensor data, comprising:
a sensor arrangement including at least one sensor of a vehicle configured to generate the sensor data,
a first module for processing the sensor data, having a first input, a first output and a second output,
a second module for checking the plausibility of the processed sensor data, having a second input and a third output,
a third module for monitoring the plausibility check of the processed sensor data, having a third input and a fourth output,
wherein the device is configured and adapted:
to input the sensor data, which is received from the at least one sensor, into the first input of the first module, and to output the processed sensor data at the first output of the first module,
to output plausibility checking data at the second output of the first module, and to input the plausibility checking data into the second input of the second module,
to output plausibility check results at the third output of the second module, and to input the plausibility check results into the third input of the third module, and
to out put quality indicators calculated by the third module for the at least one sensor at the fourth output of the third module.
9. A method of operating the system according to claim 1 for checking the plausibility of the sensor data, comprising the steps:
generating the sensor data with the at least one sensor of the vehicle,
inputting the sensor data into the first input of the first module,
with the first module processing the sensor data by executing the processing algorithm to produce the processed sensor data and to produce the second data for checking plausibility,
outputting the processed sensor data at the first output of the first module,
outputting the second data for checking plausibility at the second output of the first module,
inputting the second data for checking plausibility into the second input of the second module,
with the second module checking the plausibility of the sensor data by executing the alternative verification method, to produce and output the plausibility check results at the third output of the second module,
inputting the plausibility check results into the third input of the third module,
with the third module weighting the plausibility check results and therefrom calculating the quality indicators that indicate the quality of the at least one sensor on the basis of the plausibility check results, and
outputting the quality indicators at the fourth output of the third module.
10. The method according to claim 9 ,
further comprising evaluating the quality indicators, and
disabling functionality of a lane assistant system of the vehicle when the quality indicators indicate that the quality of the at least one sensor supplying the sensor data is not sufficiently reliable.
11. A method of checking the plausibility of sensor data, comprising the steps:
generating the sensor data with at least one sensor of a vehicle,
processing the sensor data by executing a predefined processing algorithm on the sensor data to produce processed sensor data,
periodically checking the plausibility of the processed sensor data by periodically performing an alternative verification method different from the predefined processing algorithm,
calculating quality indicators for the at least one sensor that generates the sensor data on the basis of results of the periodic checking of the plausibility,
evaluating the quality indicators, and
disabling functionality of a driver assistance system of the vehicle when the quality indicators indicate that the quality of the at least one sensor supplying the sensor data is not sufficiently reliable.
12. The method according to claim 11 , wherein said step of checking the plausibility of the processed sensor data is carried out every 60 ms.
13. The method according to claim 11 , wherein the driver assistance system is a lane assistant system of the vehicle.
14. A method of checking a plausibility of sensor data, comprising the steps:
generating sensor data with at least one camera sensor of a vehicle,
processing said sensor data by executing a predefined processing algorithm on said sensor data to produce processed sensor data, wherein said predefined processing algorithm comprises an edge detection algorithm,
performing a plausibility check by executing an alternative algorithm on plausibility checking data based on said sensor data, wherein said alternative algorithm is different from said predefined processing algorithm and comprises an optical flow algorithm,
comparing said processed sensor data with a result of said plausibility check to produce a plausibility result that indicates a plausibility of said processed sensor data, and
based on said plausibility result, calculating a quality indicator that indicates a quality of said at least one camera sensor that generated said sensor data.
15. The method according to claim 14 , wherein said processed sensor data is used as said plausibility checking data.
16. The method according to claim 14 , wherein said sensor data is used as said plausibility checking data.
17. The method according to claim 14 ,
wherein said at least one camera sensor consists of one single camera sensor of said vehicle, and
wherein said sensor data is generated by only said one single camera sensor.
18. A method comprising the steps:
generating camera data with a camera sensor of a vehicle,
executing an edge detection algorithm on said camera data to produce a first result,
executing an optical flow algorithm on said camera data to produce a second result,
performing a plausibility check by comparing said first result with said second result to produce a plausibility check result, and
controlling a driver assistance system based on said first result dependent on said plausibility check result.
19. A system for checking a plausibility of sensor data, comprising:
a sensor arrangement including at least one camera sensor of a vehicle configured to produce sensor data,
a processing module configured to execute a processing algorithm to process the sensor data and produce processed sensor data and plausibility checking data, wherein the processing algorithm comprises an edge detection algorithm,
a plausibility checking module that is configured to execute an alternative algorithm on the plausibility checking data, wherein the alternative algorithm is different from the processing algorithm and comprises an optical flow algorithm, and wherein the plausibility checking module is further configured to compare the processed sensor data with a result of the alternative algorithm executed on the plausibility checking data, and based thereon to produce a plausibility check result, and
a monitoring module configured to calculate, based on the plausibility check result, a quality indicator that indicates a quality of the at least one camera sensor that produced the sensor data.
20. The system according to claim 19 ,
wherein the at least one camera sensor consists of one single camera sensor of the vehicle, and
wherein the sensor arrangement includes only the one single camera sensor.
21. The method according to claim 14 , further comprising a step of controlling a driver assistance system of the vehicle based on said processed sensor data dependent on said quality indicator.