System and method for classifying a mode of operation of a mobile communication device in a volume based on sensor fusion
A system and method for classifying a mode of operation of a mobile communication device within a defined volume, based on multiple sensors are provided herein. The method may include the following steps: determining a position of the mobile communication device relative to a frame of reference of the defined volume, based on any of: angle of arrival, time of flight, or received intensity of radio frequency (RF) signals transmitted by the mobile communication device and received by a phone location unit located within the defined volume configured to wirelessly communicate with the at least one mobile communication device; obtaining at least one sensor measurement related to the mobile communication device from various non-RF sensors; and using a computer processor to classify the mobile communication device into one of many predefined modes of operation of the mobile communication device, based on the position and the sensor readings.
1. A method of classifying a mode of operation of at least one mobile communication device within a defined volume, based on at least one sensor, the method comprising:
determining, by a phone location unit, a position of the at least one mobile communication device relative to a frame of reference of the defined volume, based on at least one of: angle of arrival, time of flight, or received intensity of radio frequency (RF) signals transmitted by the at least one mobile communication device and received by the phone location unit located within the defined volume and comprising a transceiver and antennas and further configured to wirelessly communicate with the at least one mobile communication device;
obtaining at least one sensor measurement related to the at least one mobile communication device, from a sensor located on at least one of: the at least one mobile communication device, within the defined volume, or outside of the defined volume; and
using a computer processor to classify the at least one mobile communication device into at least one of a plurality of predefined modes of operation of the mobile communication device, based on the position and the at least one sensor reading,
wherein inside the defined volume there is at least one person interacting with the at least one mobile communication device and wherein the mode of operation further comprises information about the at least one person, wherein the defined volume is a vehicle; and
wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a proximity sensor, said proximity sensor providing information on the proximity between the at least one mobile communication device and the at least one person, and wherein the proximity is factored in classifying the likelihood of the mode of operation, wherein a closer proximity infers a higher probability of an on-call mode of operation.
2. The method according to claim 1 , wherein the classification by the computer processor is carried out by assigning to the at least one mobile communication device a respective likelihood, to at least one mode of operation selected from a plurality of modes of operation.
3. The method according to claim 1 , wherein the modes of operation comprise at least one of: idle, on-call, sending a text message, audio input, touch screen in use, and streaming data.
4. The method according to claim 1 , wherein the obtaining the sensor measurement related to the at least one mobile communication device is from at least two inertial measurement units (IMU), wherein at least one of the IMU is located on the mobile communication device and at least one of the IMUs is located on the vehicle, and wherein a differential measurement of the IMU is used to deduce internal movement of the at least one mobile communication device within the vehicle.
5. The method according to claim 1 , wherein the position of the mobile communication unit within the defined volume is further determined to be in the vehicle's driver area, wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a motion sensor, said sensor providing information related to the vehicle's speed and wherein the vehicle's speed is factored in classifying the likelihood of the mode of operation, wherein for a mobile communication device located in the driver's area, a higher speed infers a higher probability of idle mode of operation.
6. The method according to claim 1 , wherein the vehicle comprises at least one seat with a pressure sensor indicating that said seat is occupied by the at least one person, and wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a seat pressure sensor and wherein the seat pressure sensor indication is factored in classifying the likelihood of the mode of operation, wherein a positive indication of a seat pressure sensor infers a higher probability of a use of a mobile communicating device by the at least one person occupying that seat.
7. The method according to claim 1 , wherein the at least one person is sensed by at least one vital signs sensor, and wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from at least one vital signs sensor and wherein a vital signs measurement is factored in classifying the likelihood of the mode of operation, wherein a level of vital signs outside a certain threshold or limit infers a higher probability of a non-idle mode of operation of the at least one mobile communicating device.
8. A system for classifying a mode of operation of at least one mobile communication device within a defined volume, based on at least one sensor, the system comprising:
a phone locating unit configured to determine a position of the at least one mobile communication device relative to a frame of reference of the defined volume, based on at least one of: angle of arrival, time of flight, or received intensity of radio frequency (RF) signals transmitted by the at least one mobile communication device and received by the phone location unit located within the defined volume and comprising a transceiver and antennas and further configured to wirelessly communicate with the at least one mobile communication device;
a plurality of non-RF sensors configured to obtain at least one sensor measurement related to the at least one mobile communication device, from a sensor located on at least one of: the at least one mobile communication device, within the defined volume, or outside of the defined volume; and
a computer processor configured to classify the at least one mobile communication device into at least one of a plurality of predefined modes of operation of the mobile communication device, based on the position and the at least one sensor reading,
wherein inside the defined volume there is at least one person interacting with the at least one mobile communication device and wherein the mode of operation further comprises information about the at least one person;
wherein the defined volume is a vehicle; and
wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a proximity sensor, said proximity sensor providing information on the proximity between the at least one mobile communication device and the at least one person, and wherein the proximity is factored in classifying the likelihood of the mode of operation, wherein a closer proximity infers a higher probability of an on-call mode of operation.
9. The system according to claim 8 , wherein the classification by the computer processor is carried out by assigning to the at least one mobile communication device a respective likelihood, to at least one mode of operation selected from a plurality of modes of operation.
10. The system according to claim 8 , wherein the modes of operation comprise at least one of: idle, on-call, sending a text message, audio input, touch screen in use, and streaming data.
11. The system according to claim 8 , wherein the obtaining the sensor measurement related to the at least one mobile communication device is from at least two inertial measurement units (IMU), wherein at least one of the IMU is located on the mobile communication device and at least one of the IMUs is located on the vehicle, and wherein a differential measurement of the IMU is used to deduce internal movement of the at least one mobile communication device within the vehicle.
12. The system according to claim 8 , wherein the position of the mobile communication unit within the defined volume is further determined to be in the vehicle's driver area, wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a motion sensor, said sensor providing information related to the vehicle's speed and wherein the vehicle's speed is factored in classifying the likelihood of the mode of operation, wherein for a mobile communication device located in the driver's area, a higher speed infers a higher probability of idle mode of operation.
13. The system according to claim 8 , wherein the vehicle comprises at least one seat with a pressure sensor indicating that said seat is occupied by the at least one person, and wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a seat pressure sensor and wherein the seat pressure sensor indication is factored in classifying the likelihood of the mode of operation, wherein a positive indication of a seat pressure sensor infers a higher probability of a use of a mobile communicating device by a person occupying that seat.
14. The system according to claim 8 , wherein the at least one person is sensed by at least one vital signs sensor, and wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from at least one vital signs sensor and wherein a vital signs measurement is factored in classifying the likelihood of the mode of operation, wherein a level of vital signs outside a certain threshold or limit infers a higher probability of a non-idle mode of operation of the at least one mobile communicating device.
15. A non-transitory computer-readable medium for classifying a mode of operation of at least one mobile communication device within a defined volume, based on at least one sensor, the computer-readable medium comprising a set of instructions that when executed cause at least one computer processor to:
determine a position of the at least one mobile communication device relative to a frame of reference of the defined volume, based on at least one of: angle of arrival, time of flight, or received intensity of radio frequency (RF) signals transmitted by the at least one mobile communication device and received by a phone location unit located within the defined volume and comprising a transceiver and antennas and further configured to wirelessly communicate with the at least one mobile communication device;
obtain at least one sensor measurement related to the at least one mobile communication device, from a sensor located on at least one of: the at least one mobile communication device, within the defined volume, or outside of the defined volume; and
classify the at least one mobile communication device into at least one of a plurality of predefined modes of operation of the mobile communication device, based on the position and the at least one sensor reading,
wherein inside the defined volume there is at least one person interacting with the at least one mobile communication device and wherein the mode of operation further comprises information about the at least one person;
wherein the defined volume is a vehicle; and
wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a proximity sensor, said proximity sensor providing information on the proximity between the at least one mobile communication device and the at least one person, and wherein the proximity is factored in classifying the likelihood of the mode of operation, wherein a closer proximity infers a higher probability of an on-call mode of operation.
16. A server for classifying a mode of operation of at least one mobile communication device within a defined volume, based on at least one sensor, the server comprising:
a network interface configured to receive, from a phone location unit, a position of the at least one mobile communication device relative to a frame of reference of the defined volume, based on at least one of: angle of arrival, time of flight, or received intensity of radio frequency (RF) signals transmitted by the at least one mobile communication device and received by the phone location unit located within the defined volume and comprising a transceiver and antennas and further configured to wirelessly communicate with the at least one mobile communication device;
a memory interface configured to store at least one sensor measurement related to the at least one mobile communication device, from a sensor located on at least one of: the at least one mobile communication device, within the defined volume, or outside of the defined volume; and
a processing device configured to classify the at least one mobile communication device into at least one of a plurality of predefined modes of operation of the mobile communication device, based on the position and the at least one sensor reading,
wherein inside the defined volume there is at least one person interacting with the at least one mobile communication device and wherein the mode of operation further comprises information about the at least one person;
wherein the defined volume is a vehicle; and
wherein the obtaining at least one sensor measurement related to the at least one mobile communication device is from a proximity sensor, said proximity sensor providing information on the proximity between the at least one mobile communication device and the at least one person, and wherein the proximity is factored in classifying the likelihood of the mode of operation, wherein a closer proximity infers a higher probability of an on-call mode of operation.