IP Library Granted Patent US 10,460,577
Granted Patent B2
US 10,460,577 · App. 15/908,272 · Granted Oct 29, 2019

Directed alert notification by autonomous-driving vehicle

Inventors: Hao Song (Sunnyvale, CA); Zhuo Zhang (Fremont, CA); Sinan Xiao (Fremont, CA); Xiang Yu (Santa Clara, CA); Tiancheng Lou (Milpitas, CA); Jun Peng (Fremont, CA); Jie Hou (San Francisco, CA); Tianyi Li (San Jose, CA); Yiming Liu (San Jose, CA)
Assignee: PONY AI INC.
G08B7/06G05D1/0088G05D1/0214G05D1/0248G08G1/166B60Q1/506B60Q1/525B60Q9/008B60W30/08G08G1/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,460,577
App. No.
15/908,272
Granted
Oct 29, 2019
Kind
B2
Abstract

A system included and a computer-implemented method performed in an autonomous-driving vehicle are described. The system performs: detecting one or more movable objects; determining a target movable object from the one or more detected objects; determining a manner of generating a directed alert notification selectively toward the target movable object; and causing a directed alert notification of the determined manner to be generated toward the target movable object.

Claims (52)

1. A system for an autonomous-driving vehicle, comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:

detect one or more movable objects;

determine a target movable object from the one or more detected movable objects;

determine a manner of generating a directed alert notification selectively toward the target movable object; and

cause a directed alert notification of the determined manner to be generated toward the target movable object, wherein the determining the target movable object comprises:

determining a risk of a traffic incident caused by each of the one or more movable objects; and

selecting a movable object determined to have a highest risk as the target movable object; and

wherein the determining the manner of generating the directed alert notification selectively toward the target movable object comprises:

determining an item or a position that the target movable object is looking at and generating the directed alert notification directly to the item or the position without harming the target movable object.

2. The system of claim 1 , wherein the instructions cause the one or more processors to:

determine a vehicle route of the autonomous-driving vehicle;

determine predicted moving paths of the detected one or more movable objects;

determine one or more of the detected movable objects that are predicted to be within a predetermined distance from the autonomous-driving vehicle as one or more candidate movable objects, based on the vehicle route and the predicted moving paths of the one or more movable objects; and

determine the target movable object from the one or more candidate movable objects.

3. The system of claim 1 , wherein the instructions cause the one or more processors to determine one or more perceptibility parameters corresponding to the target movable object at least based on a portion of image data corresponding to the target movable object.

4. The system of claim 3 , wherein the one or more perceptibility parameters comprises at least one of a visual perceptibility level, an acoustic perceptibility level, a somatosensory perceptibility level, and a via-electronic-device perceptibility level.

5. The system of claim 3 , wherein the instructions cause the one or more processors to determine the one or more perceptibility parameters corresponding to the target movable object also based on one or more environmental attributes, including one or more of weather condition, an ambient brightness level, and an ambient noise level.

6. The system of claim 3 , wherein the manner of generating a directed alert notification comprises a type of the directed alert notification, and

the instructions cause the one or more processors to further select the type of the directed alert notification from a group including one or more of a visual directed alert notification, an acoustic directed alert notification, a somatosensory directed alert notification, and an electromagnetic directed alert notification, at least based on the one or more perceptibility parameters.

7. The system of claim 3 , wherein the manner of generating a directed alert notification comprises a position to which the directed alert notification is directed, and

the instructions cause the one or more processors to further determine the position to which the directed alert notification is directed, at least based on the one or more perceptibility parameters.

8. The system of claim 3 , wherein the manner of generating a directed alert notification comprises timing at which the directed alert notification is generated, and

the instructions cause the one or more processors to further determine the timing at which the directed alert notification is generated, at least based on the one or more perceptibility parameters.

9. The system of claim 1 , wherein the target movable object is one of a pedestrian, a person on a human-powered vehicle, a person on a motor vehicle, and an animal.

10. The system of claim 1 , wherein the instructions cause the one or more processors to:

determine a predicted movement of the target movable object in response to the directed alert notification; and

control a locomotive mechanism of the autonomous-driving vehicle based on the predicted movement of the target movable object.

11. A computer-implemented method performed in an autonomous-driving vehicle comprising:

detecting one or more movable objects;

determining a target movable object from the one or more detected movable objects, comprising:

determining a risk of a traffic incident caused by each of the one or more movable objects; and

selecting a movable object determined to have a highest risk as the target movable object;

determining a manner of generating a directed alert notification selectively toward the target movable object, comprising:

determining an item or a position that the target movable object is looking at and generating the directed alert notification directly to the item or the position without harming the target movable object; and

causing a directed alert notification of the determined manner to be generated toward the target movable object.

12. The computer-implemented method of claim 11 , wherein said determining the target movable object comprises:

determining a vehicle route of the autonomous-driving vehicle;

determining predicted moving paths of the detected one or more movable objects;

determining one or more of the detected one or more movable objects that are predicted to be within a predetermined distance from the autonomous-driving vehicle as one or more candidate movable objects, based on the vehicle route and the predicted moving paths of the one or more movable objects; and

determining the target movable object from the one or more candidate movable objects.

13. The computer-implemented method of claim 11 , further comprising determining one or more perceptibility parameters corresponding to the target movable object at least based on a portion of image data corresponding to the target movable object.

14. The computer-implemented method of claim 13 , wherein the one or more perceptibility parameters comprises at least one of a visual perceptibility level, an acoustic perceptibility level, a somatosensory perceptibility level, and a via-electronic-device perceptibility level.

15. The computer-implemented method of claim 13 , wherein the one or more perceptibility parameters corresponding to the target movable object are determined also based on one or more environmental attributes, including one or more of weather condition, an ambient brightness level, and an ambient noise level.

16. The computer-implemented method of claim 13 , wherein the manner of generating a directed alert notification comprises a type of the directed alert notification, and said determining the manner of generating the directed alert notification comprises selecting the type of the directed alert notification from a group including one or more of a visual directed alert notification, an acoustic directed alert notification, a somatosensory directed alert notification, and an electromagnetic directed alert notification, at least based on the one or more perceptibility parameters.

17. The computer-implemented method of claim 13 , wherein the manner of generating a directed alert notification comprises a position to which the directed alert notification is directed, and said determining the manner of generating the directed alert notification comprises determining the timing at which the directed alert notification is generated, at least based on the one or more perceptibility parameters.

18. The computer-implemented method of claim 13 , wherein the manner of generating a directed alert notification comprises timing at which the directed alert notification is generated, and said determining the manner of generating the directed alert notification comprises determining the timing at which the directed alert notification is generated, at least based on the one or more perceptibility parameters.

19. The computer-implemented method of claim 11 , wherein the target movable object is one of a pedestrian, a person on a human-powered vehicle, a person on a motor vehicle, and an animal.

20. The computer-implemented method of claim 11 , further comprising:

determining a predicted movement of the target movable object in response to the directed alert notification; and

controlling a locomotive mechanism of the autonomous-driving vehicle based on the predicted movement of the target movable object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2019
From: PONY.AI, INC.
To: PONY AI INC.
Reel/Frame 049434/0372 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2018
From: SONG, HAO; ZHANG, ZHUO; XIAO, SINAN; YU, XIANG; LOU, TIANCHENG; PENG, JUN; HOU, JIE; LI, TIANYI; LIU, YIMING
To: PONY.AI, INC.
Reel/Frame 045068/0178 →
Continuity (1)
Related Publication 20190266859A1 · Aug 29, 2019