Automotive AI Sensor Fusion
A motor vehicle includes a plurality of sensors that collect data indicative of an emotional state of an occupant of the motor vehicle. The sensors transmit sensor signals including the data. An infotainment system plays advertisements such that the occupant can hear the advertisements. An electronic processor is communicatively coupled to the sensing devices and to the infotainment system. The electronic processor receives the sensor signals, and wirelessly transmits a report signal indicative of the received sensor signals and indicative of which of the advertisements correspond to the received sensor signals. The report signal is wirelessly transmitted to a remote datacenter which runs an artificial intelligence-based algorithm to determine emotional states of the occupant of the motor vehicle as a result of the advertisements. The running of the algorithm is based on the received sensor signals.
1 . A motor vehicle, comprising:
a plurality of sensors configured to:
collect data indicative of emotional states of an occupant of the motor vehicle; and
transmit sensor signals including the data;
an infotainment system configured to play advertisements such that the occupant can hear the advertisements; and
an electronic processor communicatively coupled to the sensing devices and to the infotainment system and configured to:
receive the sensor signals; and
wirelessly transmit a report signal indicative of the received sensor signals and indicative of which of the advertisements correspond to the received sensor signals, the report signal being wirelessly transmitted to a remote datacenter configured to run an artificial intelligence-based algorithm to determine the emotional states of the occupant of the motor vehicle as a result of the advertisements, the algorithm being run based on the received sensor signals.
2 . The vehicle of claim 1 wherein the electronic processor is configured to keep a record of which of the sensor signals are received during which of the advertisements.
3 . The vehicle of claim 1 wherein the sensor signals and the advertisements each include a time stamp, and the electronic processor is configured to use the time stamps to match each of the sensor signals to a corresponding one of the advertisements.
4 . The vehicle of claim 1 wherein the report signal is indicative of which of the advertisements correspond timewise to the received sensor signals.
5 . The vehicle of claim 1 wherein the artificial intelligence-based algorithm is trained by use of machine learning.
6 . The vehicle of claim 1 wherein the sensors include a camera and a microphone.
7 . The vehicle of claim 1 wherein the sensors include biometric sensors.
8 . A method of evaluating advertisements in a motor vehicle, the method comprising:
playing the advertisements such that an occupant of the motor vehicle can hear the advertisements;
collecting sensor data from sensors inside the vehicle, the sensor data being indicative of an emotional state of the occupant of the motor vehicle;
wirelessly transmitting a report signal to a remote datacenter, the report signal being indicative of the sensor data and indicative of which of the advertisements correspond to the sensor data; and
running an artificial intelligence-based algorithm to determine emotional states of the occupant of the motor vehicle as a result of the advertisements, the algorithm being run based on the report signal, the algorithm being run at a location remote from the motor vehicle.
9 . The method of claim 8 comprising the further step of keeping a record of which of the sensor data are collected during which of the advertisements.
10 . The method of claim 8 wherein the sensor data and the advertisements each include a time stamp, the method comprising the further step of using the time stamps to match the sensor data to a corresponding one of the advertisements.
11 . The method of claim 8 wherein the report signal is indicative of which of the advertisements correspond timewise to the sensor data.
12 . The method of claim 8 comprising the further step of training the artificial intelligence-based algorithm by use of machine learning.
13 . The method of claim 8 wherein the sensors include a camera and a microphone.
14 . The method of claim 8 wherein the sensors include biometric sensors.
15 . An advertisement evaluation arrangement for an automotive environment, the arrangement comprising:
a motor vehicle including:
a plurality of sensors configured to:
collect data indicative of emotional states of an occupant of the motor vehicle; and
transmit sensor signals including the data;
an infotainment system configured to play advertisements such that the occupant can hear the advertisements; and
an electronic processor communicatively coupled to the sensing devices and to the infotainment system and configured to:
receive the sensor signals; and
wirelessly transmit a report signal indicative of the received sensor signals and indicative of which of the advertisements correspond to the received sensor signals; and
a datacenter disposed remote from the motor vehicle and configured to:
receive the report signal; and
run an artificial intelligence-based algorithm to determine the emotional states of the occupant of the motor vehicle as a result of the advertisements, the algorithm being run based on the received report signal.
16 . The arrangement of claim 15 wherein the electronic processor is configured to keep a record of which of the sensor signals are received during which of the advertisements.
17 . The arrangement of claim 15 wherein the sensor signals and the advertisements each include a time stamp, and the electronic processor is configured to use the time stamps to match each of the sensor signals to a corresponding one of the advertisements.
18 . The arrangement of claim 15 wherein the report signal is indicative of which of the advertisements correspond timewise to the received sensor signals.
19 . The arrangement of claim 15 wherein the artificial intelligence-based algorithm is trained by use of machine learning.
20 . The arrangement of claim 15 wherein the sensors include a camera and a microphone.
21 . The arrangement of claim 15 wherein the sensors include biometric sensors.