IP Library Granted Patent US 11,450,210
Granted Patent B2
US 11,450,210 · App. 16/929,722 · Granted Sep 20, 2022

Facial recognition technology for improving driver safety

Inventors: Evaline Shin-Tin Tsai (Cupertino, CA); Alan Guihong Liu (San Francisco, CA); Ijeoma Emeagwali (San Francisco, CA); Ishaan Kansal (San Francisco, CA); Saleh ElHattab (San Francisco, CA); Bodecker John DellaMaria (San Francisco, CA); Eliott Ray Chapuis (San Francisco, CA); Jason Noah Laska (San Francisco, CA); Jennifer Kao (San Francisco, CA); Sean Kyungmok Bae (San Francisco, CA); Sylvie Lee (San Francisco, CA); Brian Tuan (Cupertino, CA)
Assignee: Samsara Networks Inc.
G08G1/20B60R11/04G06N20/00G06T7/74G06V20/59G06V40/173B60R2300/8006G06T2200/24G06T2207/30201G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,450,210
App. No.
16/929,722
Filed
Jul 15, 2020
Granted
Sep 20, 2022
Kind
B2
Art Unit
2685
USPC
340/439
Abstract

Methods for performing operations for improving driver safety across a fleet of vehicles are disclosed. A plurality of safety events pertaining to a driving of a fleet of vehicles by a plurality of drivers are detected. A subset of the events is identified. The subset corresponds to one or more safety events of the plurality of safety events involving one or more vehicles of the fleet of vehicles to which drivers have not been assigned. A user interface is generated for presentation on a client device, the user interface including an interactive user interface element for accessing the subset of the events. One or more user interface elements are provided for accepting or rejecting recommendations for assignments of one of the plurality of drivers to each of the vehicles. The recommendations are generated based on an application of a machine-learned model to images of faces captured.

Claims (36)

1. A system comprising:

one or more computer processors;

one or more computer memories; and

a set of instructions incorporated into the one or more computer processors, the set of instruction configuring the one or more computer processors to perform operations for improving driver safety across a fleet of vehicles, the operations comprising:

detecting a plurality of safety events pertaining to a driving of a fleet of vehicles by a plurality of drivers;

identifying a subset of the events, the subset corresponding to one or more safety events of the plurality of safety events involving one or more vehicles of the fleet of vehicles to which drivers have not been assigned;

generating a user interface for presentation on a client device, the user interface including an interactive user interface element for accessing the subset of the events; and

based on an accessing of the subset of events, providing one or more user interface elements for accepting or rejecting recommendations for assignments of one of the plurality of drivers to each of the vehicles, the recommendations generated based on an application of a machine-learned model to images of faces captured inside the one or more vehicles when the safety events occurred.

2. The system of claim 1 , the operations further comprising displaying, in the user interface, one or more of the images of the faces captured inside the one or more vehicles when the safety events occurred in conjunction with a display of a listing of the subject of the events.

3. The system of claim 2 , wherein the one or more images of the faces are selected from a set of the images of the faces based on one or more quality metrics associated with the one or more images and a proximity of a time of a capturing of the one or more images to a time of occurrence of the safety event.

4. The system of claim 1 , further comprising sorting the subset of events based on severity levels associated with the safety events and, based on the accessing of the subset of the events, generating a list of the subset of events for displaying on the client device in the order of the severity levels.

5. The system of claim 1 , further comprising updating the machine-learned model based on the accepting or rejecting of the recommendations, the updating including adding an image of a face to or removing an image of a face from a club of images of faces associated with one of the plurality of drivers.

6. The system of claim 1 , further comprising, based on an accepting of one of the recommendations, generating user interface elements for viewing a set of safety events associated with a driver of the plurality of drivers, the driver corresponding to the accepting of the recommendation.

7. The system of claim 6 , further comprising sorting the additional safety events based on their level of severity and providing one or more user interface elements for accepting or rejecting a corrective action for the driver, the corrective action including providing a notification to the driver to complete an online learning module pertaining to the set of safety events.

8. A method comprising:

performing operations for improving driver safety across a fleet of vehicles, the operations comprising:

detecting a plurality of safety events pertaining to a driving of a fleet of vehicles by a plurality of drivers;

identifying a subset of the events, the subset corresponding to one or more safety events of the plurality of safety events involving one or more vehicles of the fleet of vehicles to which drivers have not been assigned;

generating a user interface for presentation on a client device, the user interface including an interactive user interface element for accessing the subset of the events; and

based on an accessing of the subset of events, providing one or more user interface elements for accepting or rejecting recommendations for assignments of one of the plurality of drivers to each of the vehicles, the recommendations generated based on an application of a machine-learned model to images of faces captured inside the one or more vehicles when the safety events occurred.

9. The method of claim 8 , the operations further comprising displaying, in the user interface, one or more of the images of the faces captured inside the one or more vehicles when the safety events occurred in conjunction with a display of a listing of the subject of the events.

10. The method of claim 9 , wherein the one or more images of the faces are selected from a set of the images of the faces based on one or more quality metrics associated with the one or more images and a proximity of a time of a capturing of the one or more images to a time of occurrence of the safety event.

11. The method of claim 8 , further comprising sorting the subset of events based on severity levels associated with the safety events and, based on the accessing of the subset of the events, generating a list of the subset of events for displaying on the client device in the order of the severity levels.

12. The method of claim 8 , further comprising updating the machine-learned model based on the accepting or rejecting of the recommendations, the updating including adding an image of a face to or removing an image of a face from a club of images of faces associated with one of the plurality of drivers.

13. The method of claim 8 , further comprising, based on an accepting of one of the recommendations, generating user interface elements for viewing a set of safety events associated with a driver of the plurality of drivers, the driver corresponding to the accepting of the recommendation.

14. The method of claim 13 , further comprising sorting the additional safety events based on their level of severity and providing one or more user interface elements for accepting or rejecting a corrective action for the driver, the corrective action including providing a notification to the driver to complete an online learning module pertaining to the set of safety events.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations for improving driver safety, the operations comprising:

detecting a plurality of safety events pertaining to a driving of a fleet of vehicles by a plurality of drivers;

identifying a subset of the events, the subset corresponding to one or more safety events of the plurality of safety events involving one or more vehicles of the fleet of vehicles to which drivers have not been assigned;

generating a user interface for presentation on a client device, the user interface including an interactive user interface element for accessing the subset of the events; and

based on an accessing of the subset of events, providing one or more user interface elements for accepting or rejecting recommendations for assignments of one of the plurality of drivers to each of the vehicles, the recommendations generated based on an application of a machine-learned model to images of faces captured inside the one or more vehicles when the safety events occurred.

16. The non-transitory machine-readable storage medium of claim 15 , the operations further comprising displaying, in the user interface, one or more of the images of the faces captured inside the one or more vehicles when the safety events occurred in conjunction with a display of a listing of the subject of the events.

17. The non-transitory machine-readable storage medium of claim 16 , wherein the one or more images of the faces are selected from a set of the images of the faces based on one or more quality metrics associated with the one or more images and a proximity of a time of a capturing of the one or more images to a time of occurrence of the safety event.

18. The non-transitory machine-readable storage medium of claim 15 , further comprising sorting the subset of events based on severity levels associated with the safety events and, based on the accessing of the subset of the events, generating a list of the subset of events for displaying on the client device in the order of the severity levels.

19. The non-transitory machine-readable storage medium of claim 15 , further comprising updating the machine-learned model based on the accepting or rejecting of the recommendations, the updating including adding an image of a face to or removing an image of a face from a club of images of faces associated with one of the plurality of drivers.

20. The non-transitory machine-readable storage medium of claim 15 , further comprising, based on an accepting of one of the recommendations, generating user interface elements for viewing a set of safety events associated with a driver of the plurality of drivers, the driver corresponding to the accepting of the recommendation.

Assignments (2)
CHANGE OF NAME Recorded Jan 17, 2024
From: SAMSARA NETWORKS INC.
To: SAMSARA INC.
Reel/Frame 066154/0870 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: TSAI, EVALINE SHIN-TIN; LIU, ALAN GUIHONG; EMEAGWALI, IJEOMA; KANSAL, ISHAAN; ELHATTAB, SALEH; DELLAMARIA, BODECKER JOHN; CHAPUIS, ELIOTT RAY; LASKA, JASON NOAH; KAO, JENNIFER; BAE, SEAN KYUNGMOK; LEE, SYLVIE; TUAN, BRIAN
To: SAMSARA NETWORKS INC.
Reel/Frame 054170/0350 →
Continuity (2)
Provisional Application 62909327 · Oct 2, 2019
Related Publication 20210104159A1 · Apr 8, 2021