IP Library Granted Patent US 11,491,979
Granted Patent B2
US 11,491,979 · App. 17/087,136 · Granted Nov 8, 2022

Automated vehicle actions such as lane departure warning, and associated systems and methods

Inventor: Mingyu Wang (Shenzhen, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
B60W30/12B60W40/06B60W40/105B60W40/13B60W50/16G06V20/588B60W2040/1307B60W2422/70B60W2422/95B60W2710/207
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,491,979
App. No.
17/087,136
Granted
Nov 8, 2022
Kind
B2
Abstract

Mappings of keys to actions can automate various vehicle systems. Some automations can provide lane departure warnings. Keys for lane departure mappings can specify vibration patterns expected when a vehicle drives over lane delineators. These vibration-based mappings can include keys with vibration patterns, e.g., defining vibration frequencies or vibration locations. Keys for emergency light mappings can be based on conditions such as (1) the vehicle being on the road, stopped, not in traffic, and not at a stop signal; (2) components of the vehicle having failed; or (3) weather conditions.

Claims (66)

1. A method for providing a lane departure warning in a vehicle, the method comprising:

obtaining one or more vibration signals;

adjusting the one or more vibration signals based on specifics of the vehicle;

determining, based on the adjusted one or more vibration signals, a vibration pattern for the vehicle that includes an identification of a first vibration frequency;

determining that the vibration pattern matches a second vibration frequency pre-determined to correspond to driving over lane delineators; and

in response to the determining that the vibration pattern matches the second vibration frequency, providing the lane departure warning,

wherein the specifics of the vehicle comprise at least specifics of a suspension in the vehicle, an amount of wear on the suspension and a weight of the vehicle.

2. The method of claim 1 , wherein the vibration pattern for the vehicle further includes identifications of one or more vibration locations.

3. The method of claim 2 , wherein determining the one or more vibration locations is based on measurements, from a vehicle sensor network, of vibration levels per tire of the vehicle.

4. The method of claim 3 ,

wherein the vehicle has four tires; with two tires on the vehicle's left side and two tires on the vehicle's right side;

wherein determining that the vibration pattern matches the second vibration frequency comprises determining that the vibration location is determined to be only the left side of the vehicle or only the right side of the vehicle;

wherein the vibration location is determined as only the vehicle's left side if only one or both measurements of vibrations for the tires on the vehicle's left side are identified as matching the second vibration frequency; and

wherein the vibration location is determined as only the vehicle's right side if only one or both measurements of vibrations for the tires on the vehicle's right side are identified as matching the second vibration frequency.

5. The method of claim 4 , further comprising

obtaining an indication of a steering direction for the vehicle;

wherein; when the steering direction indicates the vehicle is traveling generally straight,

the vibration location is determined as only the vehicle's left side only if both measurements of vibrations for the tires on the vehicle's left side are identified as matching the second vibration frequency; and

the vibration location is determined as only the vehicle's right side only if both measurements of vibrations for the tires on the vehicle's right side are identified as matching the second vibration frequency; and

wherein, when the steering direction indicates the vehicle is not traveling generally, straight,

the vibration location is determined as only the vehicle's left side only if the steering direction is to the left and the measurement of vibrations for only the vehicle's front-left tire is identified as matching the second vibration frequency; and

the vibration location is determined as only the vehicle's right side only if the steering direction is to the right and the measurement of vibrations for only the vehicle's front-right tire is identified as matching the second vibration frequency.

6. The method of claim 1 , wherein the second vibration frequency pre-determined to correspond to driving over lane delineators is based on an identification of a type of lane delineator used on a roadway on which the vehicle is operating.

7. The method of claim 6 , wherein determining the type of lane delineator is based on object recognition performed on images captured by one or more cameras on the vehicle, or based on previously determined correspondences between multiple roadways, including the roadway, and types of lane delineators.

8. The method of claim 1 , wherein the one or more vibration signals are further adjusted based on one or more of:

identified road conditions,

a current speed or acceleration of the vehicle, or

any combination thereof.

9. The method of claim 1 ,

wherein the vehicle includes a lane deviation warning system (LDWS); and

wherein providing the lane departure warning is further in response to a combination of (a) the determination that the vibration pattern matches the second vibration frequency and (b) a lane deviation determination by the LIM'S.

10. The method of claim 9 , wherein the combination is performed in part by weighting (i) either or both of a value produced for the LDWS lane deviation determination or a value produced for the determination that the vibration pattern matches the second vibration frequency by (ii) either or both of a reliability factor or a confidence score.

11. A system for automating vehicle actions of a vehicle, the system comprising:

one or more vehicle sensors that provide one or more vibration signals;

one or more processors; and

a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

adjusting the one or more vibration signals based on specifics of the vehicle;

determining, based on the adjusted one or more vibration signals, a vibration pattern for the vehicle that includes an identification of a first vibration frequency;

determining that the vibration pattern matches a second vibration frequency pre-determined to correspond to driving over lane delineators; and

in response to the determining that the vibration pattern matches the second vibration frequency, providing the lane departure warning,

wherein the specifics of the vehicle comprise at least specifics of a suspension in the vehicle, an amount of wear on the suspension, and a weight of the vehicle.

12. The system of claim 11 , wherein the vibration pattern for the vehicle further includes identifications of one or more vibration locations.

13. The system of claim 12 , wherein determining the one or more vibration locations is based on measurements, from a vehicle sensor network, of vibration levels per tire of the vehicle.

14. The system of claim 13 ,

wherein the vehicle has four tires, with two tires on the vehicle's left side and two tires on the vehicle's right side;

wherein determining that the vibration pattern matches the second vibration frequency comprises determining that the vibration location is determined to be only the left side of the vehicle or only the right side of the vehicle;

wherein the vibration location is determined as only the vehicle's left side if only one or both measurements of vibrations for the tires on the vehicle's left side are identified as matching the second vibration frequency; and

wherein the vibration location is determined as only the vehicle's right side if only one or both measurements of vibrations for the tires on the vehicle's right side are identified as matching the second vibration frequency.

15. The system of claim 14 ,

wherein, said one or more vehicle sensors further provide an indication of a steering direction for the vehicle;

wherein, when the steering direction indicates the vehicle is traveling generally straight,

the vibration location is determined as only the vehicle's left side only if both measurements of vibrations for the tires on the vehicle's left side are identified as matching the second vibration frequency; and

the vibration location is determined as only the vehicle's right side only if both measurements of vibrations for the tires on the vehicle's right side are identified as matching the second vibration frequency; and

wherein, when the steering direction indicates the vehicle is not traveling generally straight,

the vibration location is determined as only the vehicle's left side only if the steering direction is to the left and the measurement of vibrations for only, the vehicle's front-left tire is identified as matching the second vibration frequency; and

the vibration location is determined as only the vehicle's right side only if the steering direction is to the right and the measurement of vibrations for only the vehicle's front-right, tire is identified as matching the second vibration frequency.

16. The system of claim 11 , wherein the second vibration frequency pre-determined to correspond to driving over lane delineators is based on an identification of a type of lane delineator used on a roadway on which the vehicle is operating.

17. The system of claim 16 , wherein the type of lane delineator is determined based on object recognition performed on images captured by one or more cameras on the vehicle, or based on previously determined correspondences between multiple roadways, including the roadway, and types of lane delineators.

18. The system of claim 11 , wherein the one or more vibration signals are further adjusted based on one or more of:

identified road conditions,

a current speed or acceleration of the vehicle, or

any combination thereof.

19. The system of claim 11 ,

wherein the vehicle includes a lane deviation warning system (LDWS); and

wherein the lane departure warning is provided further in response to a combination of (a) the determination that the vibration pattern matches the second vibration frequency and (b) a lane deviation determination by the LDWS.

20. The system of claim 19 , wherein the combination is performed in part by weighting (i) either or both of a value produced for the LDWS lane deviation determination or a value produced for the determination that the vibration pattern matches the second vibration frequency by (ii) either or both of a reliability factor or a confidence score.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2024
From: SZ DJI TECHNOLOGY CO., LTD.
To: SHENZHEN ZHUOYU TECHNOLOGY CO., LTD.
Reel/Frame 067452/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2020
From: WANG, MINGYU
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 054245/0264 →
Continuity (2)
Continuation PCTCN2018112166 · Oct 26, 2018
Related Publication 20210046930A1 · Feb 18, 2021
Cited By (5)
US 12,228,936 US 12,252,153 US 12,409,824 US 12,594,967 US 12,662,159