IP Library Granted Patent US 12,210,968
Granted Patent B2
US 12,210,968 · App. 17/371,721 · Granted Jan 28, 2025

Technology for analyzing sensor data to detect configurations of vehicle operation

Inventors: Vinay Kumar (Fremont, CA); Kenneth J. Sanchez (San Francisco, CA)
Assignee: QUANATA, LLC
G06N3/08G07C5/008G07C5/0858
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,210,968
App. No.
17/371,721
Granted
Jan 28, 2025
Kind
B2
Abstract

Systems and methods for using collecting and analyzing device sensor data to determine whether an individual is an operator or a passenger of a vehicle are disclosed. According to certain aspects, an electronic device associated with the individual may collect or access sensor data that is indicative of or associated with an operation of the vehicle. The electronic device may transmit pertinent portion(s) of the sensor data to a backend server, which may input the portion(s) into a neural network for analysis. The neural network may output a probability metric(s) indicative of whether the individual is a passenger or an operator of the vehicle.

Claims (67)

1. A method implemented by one or more processors for determining a role of an individual associated with a vehicle, the method comprising:

receiving, by the one or more processors, a set of sensor data associated with an electronic device of the individual, the set of sensor data corresponding to a first set of timing data;

receiving, by the one or more processors, a set of location data corresponding to a second set of timing data;

determining, by the one or more processors, a time of interest that corresponds to when the electronic device is located in proximity to a designated vehicle location based upon the set of location data;

identifying, by the one or more processors, a first portion of the set of sensor data corresponding to the time of interest;

inputting, by the one or more processors, the first portion of the set of sensor data into a trained neural network; and

determining, by the one or more processors using the trained neural network, a probability of the individual being an operator of the vehicle based at least in part upon the first portion of the set of sensor data.

2. The method of claim 1 , further comprising:

determining, by the one or more processors, that the individual is either the operator or a passenger of the vehicle based upon the probability.

3. The method of claim 2 , further comprising:

processing, by the one or more processors, an account of the individual based upon determining that the individual is either the operator or the passenger of the vehicle.

4. The method of claim 1 , wherein the determining, by the one or more processors using the trained neural network, the probability comprises:

inputting a first initial probability representative of a first feature and a second initial probability representative of a second feature into a softmax function,

wherein an output of the softmax function includes a first final probability representative of the first feature and a second final probability representative of the second feature.

5. The method of claim 1 , wherein the determining, by the one or more processors using the trained neural network, the probability comprises:

inputting a first probability representative of a first feature and a second probability representative of a second feature into an affine layer of the trained neural network; and

processing an output of the affine layer by a sigmoid function.

6. The method of claim 1 , further comprising:

identifying, by the one or more processors, a second portion of the set of sensor data that is indicative of a set of movements of the electronic device in association with the vehicle; and

determining, by the one or more processors using the trained neural network, the probability based at least in part upon the second portion of the set of sensor data.

7. The method of claim 1 , further comprising:

detecting an instance of the electronic device connecting to the vehicle based upon the set of sensor data; and

identifying a third portion of the set of sensor data that is in temporal proximity to the instance of the electronic device connecting to the vehicle.

8. The method of claim 7 , further comprising:

determining, by the one or more processors using the trained neural network, the probability based at least in part upon the third portion of the set of sensor data.

9. A computing system for determining a role of an individual associated with a vehicle, the computing system comprising:

a processor; and

a memory storing computer-executable instructions, that when executed by the processor, cause the processor to perform operations comprising:

receiving a set of sensor data associated with an electronic device of the individual, the set of sensor data corresponding to a first set of timing data;

receiving a set of location data corresponding to a second set of timing data;

determining a time of interest that corresponds to when the electronic device is located in proximity to a designated vehicle location based upon the set of location data;

identifying a first portion of the set of sensor data corresponding to the time of interest;

inputting the first portion of the set of sensor data into a trained neural network; and

determining, using the trained neural network, a first probability of the individual being an operator of the vehicle based at least in part upon the first portion of the set of sensor data.

10. The computing system of claim 9 , wherein the operations further comprise:

determining that the individual is either the operator or a passenger of the vehicle based upon the first probability.

11. The computing system of claim 10 , wherein the operations further comprise:

processing an account of the individual based upon determining that the individual is either the operator or the passenger of the vehicle.

12. The computing system of claim 10 , wherein the operations further comprise:

determining a second probability of the individual being the passenger of the vehicle.

13. The computing system of claim 12 , wherein the operations further comprise:

comparing the first probability and the second probability with a threshold value to generate a comparison result; and

determining that the individual is either the operator or the passenger of the vehicle based at least in part upon the comparison result.

14. The computing system of claim 9 , wherein the operations further comprise:

identifying a second portion of the set of sensor data that is indicative of a set of movements of the electronic device in association with the vehicle; and

determining, using the trained neural network, the first probability based at least in part upon the second portion of the set of sensor data.

15. The computing system of claim 9 , wherein the operations further comprise:

detecting an instance of the electronic device connecting to the vehicle based upon the set of sensor data; and

identifying a third portion of the set of sensor data that is in temporal proximity to the instance of the electronic device connecting to the vehicle.

16. The computing system of claim 9 , wherein the operations further comprise:

determining, using the trained neural network, the first probability based at least in part upon the third portion of the set of sensor data.

17. A non-transitory computer-readable storage medium having stored thereon a set of instructions, executable by a processor, for determining a role of an individual associated with a vehicle, the set of instructions comprising instructions for:

receiving a set of sensor data associated with an electronic device of the individual, the set of sensor data corresponding to a first set of timing data;

receiving a set of location data corresponding to a second set of timing data;

determining a time of interest that corresponds to when the electronic device is located in proximity to a designated vehicle location based upon the set of location data;

identifying a first portion of the set of sensor data corresponding to the time of interest;

inputting the first portion of the set of sensor data into a trained neural network; and

determining, by the one or more processors using the trained neural network, a probability of the individual being an operator of the vehicle based at least in part upon the first portion of the set of sensor data.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the set of instructions further comprise:

inputting a first initial probability representative of a first feature and a second initial probability representative of a second feature into a softmax function,

wherein an output of the softmax function includes a first final probability representative of the first feature and a second final probability representative of the second feature.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the set of instructions further comprise:

inputting a first probability representative of a first feature and a second probability representative of a second feature into an affine layer of the trained neural network; and

processing an output of the affine layer by a sigmoid function.

20. The non-transitory computer-readable storage medium of claim 17 , further comprising:

determining a second portion of the set of sensor data that is indicative of a set of movements of the electronic device in association with the vehicle; and

determining, using the trained neural network, the probability based at least in part upon the second portion of the set of sensor data.

Assignments (2)
CHANGE OF NAME Recorded May 29, 2024
From: BLUEOWL, LLC
To: QUANATA, LLC
Reel/Frame 067558/0600 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2023
From: KUMAR, VINAY; SANCHEZ, KENNETH J.
To: BLUEOWL, LLC
Reel/Frame 065603/0293 →
Continuity (2)
Continuation 15656883 · Jul 21, 2017
Related Publication 20210334660A1 · Oct 28, 2021
References Cited (9)
US 8290480B2 · Abramson et al. · 2012 [cited by applicant]
US 8731530B1 · Breed et al. · 2014 [cited by applicant]
US 9888392B1 · Snyder et al. · 2018 [cited by applicant]
US 11087209B1 · Kumar · 2021 [cited by examiner]
US 20110281564A1 · Armitage et al. · 2011 [cited by applicant]
US 20160039429A1 · Abou-Nasr et al. · 2016 [cited by applicant]
US 20170142556A1 · Matus · 2017 [cited by applicant]
US 20180300629A1 · Kharaghani et al. · 2018 [cited by applicant]
Bo et al. (“You're Driving and Texting: Detecting Drivers Using Personal Smart Phones by Leveraging Inertial Sensors”). (Year:2013). [cited by applicant]