IP Library Granted Patent US 11,134,360
Granted Patent B2
US 11,134,360 · App. 15/486,053 · Granted Sep 28, 2021

Methods and systems for orienting a mobile device to a vehicle's reference frame

Inventors: Brad Cordova (Cambridge, MA); Sanujit Sahoo (Boston, MA); Sushrut Karnik (Cambridge, MA)
Assignee: CAMBRIDGE MOBILE TELEMATICS INC.
H04W4/029G01C21/20H04M1/725H04W4/026H04M2250/10H04M2250/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,134,360
App. No.
15/486,053
Granted
Sep 28, 2021
Kind
B2
Abstract

A method of orienting a mobile device to a vehicle includes determining an orientation of a gravity vector and aligning a first axis of the mobile device with respect to the gravity vector. The method also includes determining an orientation of a magnetic direction and aligning a second axis of the mobile device with respect to the magnetic direction. The method further includes determining a direction of travel for the vehicle and orienting the mobile device to the vehicle.

Claims (71)

1. A method comprising:

operating a first sensor and a second sensor of a mobile device to collect movement measurements at specified time steps during a driving event, the mobile device being associated with a reference frame defined by a first axis and a second axis;

aligning the first axis of the reference frame of the mobile device with respect to a gravity vector at each time step during the driving event to generate a gravity-aligned reference frame;

generating, based on aligning the first axis of the reference frame of the mobile device with respect of the gravity vector, a first quaternion;

operating a third sensor of the mobile device at the specified time steps during the driving event to determine an orientation of a magnetic direction;

aligning the second axis of the gravity-aligned reference frame of the mobile device with respect to the magnetic direction;

generating, based on aligning the second axis of the gravity-aligned reference frame of the mobile device with respect to the magnetic direction, a second quaternion;

determining a direction of travel for a vehicle;

generating, based on the direction of travel, a third quaternion;

performing a first quaternion multiplication between the first quaternion and the second quaternion to generate an intermediate quaternion;

performing a second quaternion multiplication between the intermediate quaternion and the third quaternion to generate a final quaternion; and

transforming, using the final quaternion, sensor data collected by the mobile device from the reference frame of the mobile device to a reference frame of the vehicle;

determining, based on the transformed sensor data, a movement of the mobile device with respect to the vehicle; and

detecting a distracted driving behavior of a driver of the vehicle based on the movement of the mobile device with respect to the vehicle.

2. The method of claim 1 , wherein the first axis of the reference frame is a negative y-axis of the reference frame.

3. The method of claim 2 , wherein the mobile device includes a screen and a positive z-axis of the reference frame is normal to the screen.

4. The method of claim 1 , wherein the magnetic direction comprises magnetic north.

5. The method of claim 4 , wherein the second axis of the reference frame is a negative z-axis of the reference frame.

6. The method of claim 1 , wherein determining the direction of travel for the vehicle comprising determining a GPS course for the vehicle.

7. The method of claim 6 , wherein the third quaternion is generated based on aligning a negative z-axis of the reference frame with the direction of travel.

8. The method of claim 1 , further comprising:

determining an inclination angle of the vehicle; and

adjusting the gravity-aligned reference frame to compensate for the inclination angle of the vehicle.

9. The method of claim 8 , further comprising:

generating a fourth quaternion based on the inclination angle,

wherein the final quaternion is generated based on performing a third quaternion multiplication between the first quaternion, the second quaternion, the third quaternion, and the fourth quaternion.

10. The method of claim 1 , wherein:

the first sensor comprises an accelerometer, and

the second sensor comprises a gyroscope.

11. The method of claim 1 , wherein the third sensor comprises a magnetometer.

12. The method of claim 1 , wherein the direction of travel is determined based on data from a global positioning system (GPS).

13. The method of claim 1 , further comprising:

determining a first rotation axis based on the first axis and the gravity vector;

rotating the reference frame around the first rotation axis by a first rotation angle to align the first axis of the reference frame of the mobile device with respect to the gravity vector;

determining a second rotation axis based on the second axis of the gravity-aligned reference frame and a vector of the magnetic direction; and

rotating the gravity-aligned reference frame around the second rotation axis by a second rotation angle to align the second axis of the gravity-aligned reference frame of the mobile device with respect to the magnetic direction,

wherein the first quaternion is generated based on the first rotation axis and the first rotation angle; and

wherein the second quaternion is generated based on the second rotation axis and the second rotation angle.

14. A mobile device, comprising:

a first sensor;

a second sensor;

a third sensor;

a memory configured to store a set of instructions; and

a processor configured to execute the set of instructions to:

operate the first sensor and the second sensor to collect movement measurements at specified time steps during a driving event, the mobile device being associated with a reference frame defined by a first axis and a second axis;

align the first axis of the reference frame of the mobile device with respect to a gravity vector at each time step during the driving event to generate a gravity-aligned reference frame;

generate, based on aligning the first axis of the reference frame of the mobile device with respect of the gravity vector, a first quaternion;

operate the third sensor at the specified time steps during the driving event to determine an orientation of a magnetic direction;

align the second axis of the gravity-aligned reference frame of the mobile device with respect to the magnetic direction;

generate, based on aligning the second axis of the gravity-aligned reference frame of the mobile device with respect to the magnetic direction, a second quaternion;

determine a direction of travel for a vehicle;

generate, based on the direction of travel, a third quaternion;

perform a first quaternion multiplication between the first quaternion and the second quaternion to generate an intermediate quaternion;

perform a second quaternion multiplication between the intermediate quaternion and the third quaternion to generate a final quaternion; and

transform, using the final quaternion, sensor data collected by at least one of the first sensor, the second sensor, of the third sensor from the reference frame of the mobile device to a reference frame of the vehicle;

determine, based on the transformed sensor data, a movement of the mobile device with respect to the vehicle; and

detect a distracted driving behavior of a driver of the vehicle based on the movement of the mobile device with respect to the vehicle.

15. A non-transitory computer readable medium storing instructions that, when executed by a processor of a mobile device, causes the processor to perform:

operating a first sensor and a second sensor of the mobile device to collect movement measurements at specified time steps during a driving event, the mobile device being associated with a reference frame defined by a first axis and a second axis;

aligning the first axis of the reference frame of the mobile device with respect to a gravity vector at each time step during the driving event to generate a gravity-aligned reference frame;

generating, based on aligning the first axis of the reference frame of the mobile device with respect of the gravity vector, a first quaternion;

operating a third sensor at the specified time steps during the driving event to determine an orientation of a magnetic direction;

aligning the second axis of the gravity-aligned reference frame of the mobile device with respect to the magnetic direction;

generating, based on aligning the second axis of the gravity-aligned reference frame of the mobile device with respect to the magnetic direction, a second quaternion;

determining a direction of travel for a vehicle;

generating, based on the direction of travel, a third quaternion;

performing a first quaternion multiplication between the first quaternion and the second quaternion to generate an intermediate quaternion;

performing a second quaternion multiplication between the intermediate quaternion and the third quaternion to generate a final quaternion;

transforming, using the final quaternion, sensor data collected by the mobile device from the reference frame of the mobile device to a reference frame of the vehicle;

determining, based on the transformed sensor data, a movement of the mobile device with respect to the vehicle; and

detecting a distracted driving behavior of a driver of the vehicle based on the movement of the mobile device with respect to the vehicle.

Assignments (2)
MERGER Recorded Aug 19, 2021
From: TRUEMOTION, INC.
To: CAMBRIDGE MOBILE TELEMATICS INC.
Reel/Frame 057233/0616 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2017
From: CORDOVA, BRAD; SAHOO, SANUJIT; KARNIK, SUSHRUT
To: TRUEMOTION, INC.
Reel/Frame 042332/0738 →
Continuity (2)
Provisional Application 62324168 · Apr 18, 2016
Related Publication 20170303095A1 · Oct 19, 2017
Cited By (2)
US 12,258,036 US 12,340,638