IP Library Granted Patent US 10,573,183
Granted Patent B1
US 10,573,183 · App. 16/255,824 · Granted Feb 25, 2020

Mobile real-time driving safety systems and methods

Inventors: Xinyu Li (Jersey City, NY); Chen-Ping Yu (Santa Clara, CA); Aaditya Chandrasekhar (San Francisco, CA)
Assignee: Phiar Technologies, Inc.
G08G1/166B60Q9/008G06N20/00G07C5/008G07C5/085
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,573,183
App. No.
16/255,824
Filed
Jan 24, 2019
Granted
Feb 25, 2020
Kind
B1
Art Unit
3662
USPC
701/301
Abstract

A system and method may track data from one or more sensors during vehicle driving. Based on the sensors data, one or more alerts or potential hazards may be identified. The system and method may generate a drive summary including information and optional statistics about the alerts or potential hazards.

Claims (49)

1. A method, comprising:

obtaining an image of a driving scene for a vehicle during a drive using a first device;

obtaining motion sensor data during the drive using the first device;

identifying an object based on the image using a machine learning model;

identifying a potential hazard associated with the object based on the image and the motion sensor data;

generating an alert associated with the potential hazard for a driver of the vehicle;

displaying the alert in an augmented related interface with an augmented reality hazard marker to identify the potential hazard;

displaying a drive summary for the drive, the drive summary including information associated with the alert;

wherein the information associated with the alert includes at least one of an alert type, a vehicle speed, a vehicle acceleration, and a time of the alert;

wherein the drive summary includes a visual summary comprising a map of a route of the drive, the map including a visual indicator of the alert at a location on the map where the alert occurred, the visual indicator being selectable to display the information associated with the alert;

wherein the drive summary includes statistics for alerts encountered during the drive and a comparison to statistics for other drivers;

wherein the drive summary includes a plurality of scores associated with different alert types and an aggregate score based on combining the plurality of scores.

2. The method of claim 1 , wherein obtaining the image comprises obtaining the image with a camera of a mobile phone in the vehicle.

3. The method of claim 2 , wherein obtaining the motion sensor data comprises obtaining the motion sensor data from one or more sensors of the mobile phone.

4. The method of claim 3 , wherein the one or more sensors include an accelerometer and a gyroscope.

5. The method of claim 4 , further comprising displaying a real-time global-positioning-system map with a display of the mobile phone during the drive.

6. The method of claim 5 , wherein generating the alert comprises adding a visible alert to the real-time global-positioning-system map at a location of the object.

7. The method of claim 1 , further comprising sending the image and the motion sensor data to a remote server.

8. The method of claim 7 , further comprising:

generating the drive summary at the remote server; and

receiving the drive summary from the remote server.

9. The method of claim 8 , wherein generating the drive summary comprises generating one or more driving safety statistics based on the images and the motion sensor data.

10. The method of claim 9 , further comprising generating one or more ranking and/or score of each of the one or more driving safety statistics.

11. The method of claim 8 , further comprising generating a ranking and/or score of the drive summary.

12. The method of claim 8 , wherein the drive summary comprises generating a map view of each alert associated with each of the potential hazards displayed on the map view.

13. A system comprising one or more non-transitory computer-readable media storing computer-executable instructions that, when executed on one or more processors, cause the one or more processors to perform acts comprising:

obtain an image of a driving scene for a vehicle during a drive using a first device;

obtain motion sensor data during the drive using the first device;

identify an object based on the image using a machine learning model;

identify a potential hazard associated with the object based on the image and the motion sensor data;

generate an alert associated with the potential hazard for a driver of the vehicle;

display the alert in an augmented related interface with an augmented reality hazard marker to identify the potential hazard;

display a drive summary for the drive, the drive summary including information associated with the alert;

wherein the information associated with the alert includes at least one of an alert type, a vehicle speed, a vehicle acceleration, and a time of the alert;

wherein the drive summary includes a visual summary comprising a map of a route of the drive, the map including a visual indicator of the alert at a location on the map where the alert occurred, the visual indicator being selectable to display the information associated with the alert;

wherein the drive summary includes statistics for alerts encountered during the drive and a comparison to statistics for other drivers;

wherein the drive summary includes a plurality of scores associated with different alert types and an aggregate score based on combining the plurality of scores.

14. The system of claim 13 , further comprising instructions to send the image and the motion sensor data to a remote server.

15. The system of claim 14 , further comprising instructions to:

generate the drive summary at the remote server; and

receive the drive summary from the remote server.

16. The system of claim 15 , wherein generating the drive summary comprises generating one or more driving safety statistics based on the images and the motion sensor data.

17. The system of claim 16 , further comprising instructions to generate one or more ranking and/or score of each of the one or more driving safety statistics.

18. The system of claim 13 , wherein obtaining the image comprises obtaining the image with a camera of a mobile phone in the vehicle.

19. The system of claim 18 , wherein obtaining the motion sensor data comprises obtaining the motion sensor data from one or more sensors of the mobile phone.

20. The system of claim 19 , wherein the one or more sensors include an accelerometer and a gyroscope.

21. The method of claim 1 , further comprising generating a prediction corresponding to a number of alerts that may be encountered in a future driving session.

22. The method of claim 1 , further comprising comparing the drive summary with a drive summary generated for a group of individuals.

23. The method of claim 1 , further comprising generating an individualized risk profile for a particular driver.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2022
From: PHIAR TECHNOLOGIES, INC.
To: GOOGLE LLC
Reel/Frame 061919/0013 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2019
From: LI, XINYU; YU, CHEN-PING; CHANDRASEKHAR, AADITYA
To: PHIAR TECHNOLOGIES, INC.
Reel/Frame 048144/0102 →
Continuity (1)
Provisional Application 62737665 · Sep 27, 2018
Cited By (39)
US 1,123,950 US 12,197,610 US 12,213,090 US 12,228,944 US 12,253,617 US 12,256,021 US 12,260,616 US 12,269,498 US 12,289,181 US 12,306,010 US 12,327,445 US 12,328,639 US 12,344,168 US 12,346,712 US 12,367,718 US 12,391,256 US 12,426,007 US 12,438,947 US 12,441,347 US 12,445,285 US 12,450,329 US 12,464,045 US 12,479,446 US 12,501,178 US 12,511,947 US 12,534,097 US 12,561,624 US 12,565,143 US 12,626,200 US 12,630,050 US 12,646,402 US 12,651,529 US 12,662,152 US 12,665,989 US 12,671,464 US 12,675,419 US 12,682,753 US 12,701,004 US 12,720,017