IP Library Granted Patent US 10,223,603
Granted Patent B1
US 10,223,603 · App. 15/888,203 · Granted Mar 5, 2019

Apparatuses, systems, and methods for determining when a vehicle occupant is using a mobile telephone

Inventors: Aaron Scott Chan (Bloomington, IL); Kenneth J. Sanchez (San Francisco, CA)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
G06K9/00845B60W40/08G06F17/30244G06K9/6202G06K9/6277G06N7/005G06Q40/08H04N5/247H04N7/181B60W2420/42G06K9/68
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,223,603
App. No.
15/888,203
Granted
Mar 5, 2019
Kind
B1
Abstract

Apparatuses, systems and methods are provided for determining when a vehicle occupant is using a mobile telephone. More particularly, apparatuses, systems and methods are provided for determining when a vehicle occupant is using a mobile telephone based on digital image data.

Claims (26)

1. A device for determining when a vehicle occupant is using a mobile telephone, the device comprising:

a previously classified image data receiving module stored on a memory that, when executed by a processor, causes the processor to receive previously classified image data from at least one previously classified image database, wherein the previously classified image data is representative of a three-dimensional representation of at least one occupant within the vehicle interior;

a current image data receiving module stored on a memory that, when executed by a processor, causes the processor to receive current image data from at least one vehicle interior sensor, wherein the current image data includes images and/or extracted image features that are representative of a vehicle occupant using a cellular telephone; and

a vehicle occupant mobile telephone detection module stored on a memory that, when executed by a processor, causes the processor to detect whether a vehicle occupant is using a mobile telephone based upon a comparison of the current image data with the previously classified image data, wherein detecting whether a vehicle occupant is using a mobile telephone is further based on a range of movement of the vehicle occupant posture that is associated with using the mobile telephone.

2. The device as in claim 1 , wherein the at least one vehicle interior sensor is selected from: at least one digital image sensor, at least one ultra-sonic sensor, at least one radar-sensor, at least one infrared light sensor, or at least one laser light sensor.

3. The device as in claim 1 , wherein the vehicle occupant using a mobile telephone is detected using a probability function, wherein each term of the probability function is a weighted factor derived from image data.

4. The device as in claim 3 , wherein the current image data is representative of a three-dimensional representation of at least one occupant within the vehicle interior.

5. The device as in claim 3 , wherein the current image data also includes images and/or extracted image features that are representative of a vehicle occupant looking out a vehicle side window, a vehicle occupant adjusting a vehicle radio, a vehicle occupant adjusting a vehicle heating, ventilation and air conditioning system, two vehicle occupants talking with one-another, a vehicle occupant reading a book or magazine, a vehicle occupant putting on makeup, or a vehicle occupant looking at themselves in a mirror.

6. The device as in claim 3 , wherein the previously classified image data includes images and/or extracted image features that have previously been classified as being representative of a vehicle occupant using a cellular telephone, a vehicle occupant looking out a vehicle side window, a vehicle occupant adjusting a vehicle radio, a vehicle occupant adjusting a vehicle heating, ventilation and air conditioning system, two vehicle occupants talking with one-another, a vehicle occupant reading a book or magazine, a vehicle occupant putting on makeup, or a vehicle occupant looking at themselves in a mirror.

7. A computer-implemented method for determining when a vehicle occupant is using a mobile telephone, the method comprising:

receiving, at a processor of a computing device, previously classified imaged data from at least one previously classified image database in response to the processor executing a previously classified imaged data receiving module, wherein the previously classified image data is representative of a three-dimensional representation of at least one occupant within the vehicle interior;

receiving, at a processor of a computing device, current image data from at least one vehicle interior sensor a current image data receiving module, in response to the processor executing a current image data receiving module, wherein the current image data includes image and/or extracted image features that are representative of a vehicle occupant using a cellular telephone; and

determining, using a processor of a computing device, whether a vehicle occupant is using a mobile telephone, based upon a comparison of the current image data with the previously classified image data, wherein detecting whether a vehicle occupant is using a mobile telephone is further based on a range of movement of the vehicle occupant posture that is associated with using the mobile telephone.

8. The method as in claim 7 , wherein the at least one vehicle interior sensor is selected from: at least one digital image sensor, at least one ultra-sonic sensor, at least one radar-sensor, at least one infrared light sensor, or at least one laser light sensor.

9. The method as in claim 7 , wherein the previously classified image data is representative of a three-dimensional representation of at least one occupant within the vehicle interior.

10. The method as in claim 7 , wherein the vehicle occupant using a mobile telephone is detected using a probability function, wherein each term of the probability function is a weighted factor derived from image data.

11. The method as in claim 7 , wherein the current image data further includes images and/or extracted image features that are representative of a vehicle occupant looking out a vehicle side window, a vehicle occupant adjusting a vehicle radio, a vehicle occupant adjusting a vehicle heating, ventilation and air conditioning system, two vehicle occupants talking with one-another, a vehicle occupant reading a book or magazine, a vehicle occupant putting on makeup, or a vehicle occupant looking at themselves in a mirror.

12. The method as in claim 7 , wherein the previously classified image data includes images and/or extracted image features that have previously been classified as being representative of known vehicle occupant locations/orientations, known cellular telephone locations/orientations, known vehicle occupant eye locations/orientations, known vehicle occupant head location/orientation, known vehicle occupant hand location/orientation, a known vehicle occupant torso location/orientation, a known seat belt location, or a known vehicle seat location/orientation.

13. A non-transitory computer-readable medium storing computer-readable instructions that, when executed by a processor, cause the processor to determining when a vehicle occupant is using a mobile telephone, the non-transitory computer-readable medium comprising:

a previously classified image data receiving module that, when executed by a processor, causes the processor to receive previously classified image data from at least one previously classified image database, wherein the previously classified image data is representative of a three-dimensional representation of at least one occupant within the vehicle interior;

a current image data receiving module that, when executed by a processor, causes the processor to receive current image data from at least one vehicle interior sensor, wherein the current image data includes images and/or extracted image features that are representative of a vehicle occupant using a cellular telephone; and

a vehicle occupant mobile telephone detection module that, when executed by a processor, causes the processor to detect whether the vehicle occupant is using a mobile telephone based upon a comparison of the current image data with the previously classified image data, wherein detecting whether a vehicle occupant is using a mobile telephone is further based on a range of movement of the vehicle occupant posture that is associated with using the mobile telephone.

14. The non-transitory computer-readable medium as in claim 13 , wherein the vehicle occupant using a mobile telephone is detected using a probability function, wherein each term of the probability function is a weighted factor derived from image data.

15. The non-transitory computer-readable medium as in claim 13 , wherein the current image data is representative of a three-dimensional representation of at least one occupant within the vehicle interior.

16. The non-transitory computer-readable medium as in claim 13 , wherein the previously classified image data is representative of rotated and scaled postures that are normalized for a range of different vehicle occupants.

17. The non-transitory computer-readable medium as in claim 13 , wherein the previously classified image data includes images and/or extracted image features that have previously been classified as being representative of a vehicle occupant using a cellular telephone, a vehicle occupant looking out a vehicle side window, a vehicle occupant adjusting a vehicle radio, a vehicle occupant adjusting a vehicle heating, ventilation and air conditioning system, two vehicle occupants talking with one-another, a vehicle occupant reading a book or magazine, a vehicle occupant putting on makeup, a vehicle occupant looking at themselves in a mirror, known vehicle occupant locations/orientations, known cellular telephone locations/orientations, known vehicle occupant eye locations/orientations, known vehicle occupant head location/orientation, known vehicle occupant hand location/orientation, a known vehicle occupant torso location/orientation, a known seat belt location, or a known vehicle seat location/orientation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2018
From: CHAN, AARON SCOTT; SANCHEZ, KENNETH J.
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 044829/0352 →
Continuity (1)
Continuation 15181642 · Jun 14, 2016