IP Library › Granted Patent US 9,715,769
Granted Patent B2
US 9,715,769 · App. 15/161,709 · Granted Jul 25, 2017

Process for determining state of a vehicle

Inventors: William J. Chundrlik, Jr. (Rochester Hills, MI); Nathaniel Johnson (Royal Oak, MI); Marc Wimmershoff (Aachen, DE)
Assignee: MAGNA ELECTRONICS INC.
G07C5/02B60R1/00B60T7/12B60W30/08B60W30/12B60W40/114B60W50/0098G01P3/50G01P13/00G06K9/00798G07C5/08H04N5/23229H04N5/374H04N7/183B60R2300/804B60T7/22B60W2050/0049B60W2420/42B60W2520/10B60W2520/14G01J5/024G01J5/34G01J2005/0077
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,715,769
App. No.
15/161,709
Granted
Jul 25, 2017
Kind
B2
Abstract

A process for determining a stationary state of a vehicle includes providing a camera and a control having an image processor. Vehicle data is provided to the control by an accelerometer of the vehicle and by at least one of (i) a transmission sensor of the vehicle and (ii) a speed sensor of the vehicle. A determination that the vehicle is stationary is made when at least one of (i) the control determines a jerk value that is approximately zero for a selected duration of time and the control receives vehicle data indicating that the speed of the vehicle was approximately zero for the selected duration of time and (ii) the control determines a jerk value that is approximately zero for a selected duration of time and the control receives vehicle data indicating that the transmission of the vehicle was in ‘Park’ for the selected duration of time.

Claims (70)

1. A process for robustly determining a stationary state of a vehicle equipped with a driver assistance system, said process comprising:

providing a camera comprising a lens and a photosensor array;

said photosensor array comprising a plurality of photosensor elements arranged in a matrix that comprises multiple columns of photosensor elements and multiple rows of photosensor elements;

disposing said camera at or proximate to an in-cabin portion of a windshield of an equipped vehicle;

wherein said camera has a forward field of view to the exterior of the equipped vehicle through the windshield of the equipped vehicle;

operating said camera to capture image data;

providing a control comprising an image processor;

providing image data captured by said camera to said image processor;

operating said image processor to process captured image data to determine lane delimiters present in the field of view of said camera;

connecting said control to a vehicle communication bus of the equipped vehicle;

receiving vehicle data at said control via said vehicle communication bus;

wherein vehicle data is provided to said control via said vehicle communication bus by an accelerometer of the equipped vehicle and by at least one of (i) a transmission sensor of the equipped vehicle and (ii) a speed sensor of the equipped vehicle;

executing at said control a vehicle stationary detection routine wherein longitudinal acceleration of the equipped vehicle is provided by said accelerometer over a selected duration of time to said control;

determining at said control a rate of change of acceleration of the equipped vehicle to establish a jerk value;

at least one of (i) receiving at said control speed of the equipped vehicle as sensed by said speed sensor and (ii) receiving at said control transmission status of the equipped vehicle as sensed by said transmission sensor; and

determining that the equipped vehicle is stationary when at least one of (i) said control determines a jerk value that is approximately zero for the selected duration of time and said control receives vehicle data indicating that the speed of the equipped vehicle was approximately zero kilometer/hour for the selected duration of time and (ii) said control determines a jerk value that is approximately zero for the selected duration of time and said control receives vehicle data indicating that the transmission of the equipped vehicle was in ‘Park’ for the selected duration of time.

2. The process of claim 1 , wherein the selected duration of time is 0.5 seconds.

3. The process of claim 1 , wherein said camera is part of at least one of (i) a collision avoidance system of the equipped vehicle, (ii) a collision mitigation system of the equipped vehicle and (iii) a stability control system of the equipped vehicle.

4. The process of claim 1 , wherein said camera is part of at least one of (i) a lane departure warning system of the equipped vehicle, (ii) a lane keeping system of the equipped vehicle, (iii) a vehicle detection system of the equipped vehicle, (iv) an object detection system of the equipped vehicle, (v) a traffic sign recognition system of the equipped vehicle, (vi) a distance measurement system of the equipped vehicle and (vii) a headlamp control system of the equipped vehicle.

5. The process of claim 1 , wherein, responsive at least in part to processing of captured image data by said image processor, the heading of the equipped vehicle is determined.

6. The process of claim 1 , wherein the number of rows of photosensor elements of said photosensor array is at least about 480 rows and wherein the number of columns of photosensor elements of said photosensor array is at least about 640 columns.

7. The process of claim 1 , wherein said control determines, at least in part, that the equipped vehicle is moving straight responsive to processing of captured image data by said image processor determining that lane delimiters present in the field of view of said camera are straight.

8. The process of claim 1 , wherein said control, responsive at least in part to processing of captured image data by said image processor, detects colored lane markers present in the field of view of said camera.

9. The process of claim 1 , wherein said vehicle communication bus comprises a controller-area network.

10. The process of claim 1 , wherein said vehicle communication bus comprises a local interconnect network.

11. The process of claim 1 , wherein said image processor comprises one of (i) an EyeQ2 image processing chip and (ii) an EyeQ3 image processing chip.

12. A process for robustly determining a stationary state of a vehicle equipped with a driver assistance system, said process comprising:

providing a camera comprising a lens and a photosensor array;

said photosensor array comprising a plurality of photosensor elements arranged in a matrix that comprises multiple columns of photosensor elements and multiple rows of photosensor elements;

wherein the number of rows of photosensor elements of said photosensor array is at least about 480 rows and wherein the number of columns of photosensor elements of said photosensor array is at least about 640 columns;

disposing said camera at or proximate to an in-cabin portion of a windshield of an equipped vehicle;

wherein said camera is part of at least one of (i) a lane departure warning system of the equipped vehicle, (ii) a lane keeping system of the equipped vehicle, (iii) a vehicle detection system of the equipped vehicle, (iv) an object detection system of the equipped vehicle, (v) a traffic sign recognition system of the equipped vehicle, (vi) a distance measurement system of the equipped vehicle and (vii) a headlamp control system of the equipped vehicle;

wherein said camera has a forward field of view to the exterior of the equipped vehicle through the windshield of the equipped vehicle;

operating said camera to capture image data;

providing a control comprising an image processor;

providing image data captured by said camera to said image processor;

operating said image processor to process captured image data to determine lane delimiters present in the field of view of said camera;

connecting said control to a vehicle communication bus of the equipped vehicle;

receiving vehicle data at said control via said vehicle communication bus;

wherein vehicle data is provided to said control via said vehicle communication bus by an accelerometer of the equipped vehicle and by at least one of (i) a transmission sensor of the equipped vehicle and (ii) a speed sensor of the equipped vehicle;

executing at said control a vehicle stationary detection routine wherein longitudinal acceleration of the equipped vehicle is provided by said accelerometer over a selected duration of time to said control;

determining at said control a rate of change of acceleration of the equipped vehicle to establish a jerk value;

at least one of (i) receiving at said control speed of the equipped vehicle as sensed by said speed sensor and (ii) receiving at said control transmission status of the equipped vehicle as sensed by said transmission sensor; and

determining that the equipped vehicle is stationary when at least one of (i) said control determines a jerk value that is approximately zero for the selected duration of time and said control receives vehicle data indicating that the speed of the equipped vehicle was approximately zero kilometer/hour for the selected duration of time and (ii) said control determines a jerk value that is approximately zero for the selected duration of time and said control receives vehicle data indicating that the transmission of the equipped vehicle was in ‘Park’ for the selected duration of time.

13. The process of claim 12 , wherein said camera is part of at least one of (i) a collision avoidance system of the equipped vehicle, (ii) a collision mitigation system of the equipped vehicle and (iii) a stability control system of the equipped vehicle.

14. The process of claim 12 , wherein, responsive at least in part to processing of captured image data by said image processor, the heading of the equipped vehicle is determined.

15. The process of claim 12 , wherein said vehicle communication bus comprises a controller-area network.

16. A process for robustly determining a stationary state of a vehicle equipped with a driver assistance system, said process comprising:

providing a camera comprising a lens and a photosensor array;

said photosensor array comprising a plurality of photosensor elements arranged in a matrix that comprises multiple columns of photosensor elements and multiple rows of photosensor elements;

wherein the number of rows of photosensor elements of said photosensor array is at least about 480 rows and wherein the number of columns of photosensor elements of said photosensor array is at least about 640 columns;

disposing said camera at or proximate to an in-cabin portion of a windshield of an equipped vehicle;

wherein said camera is part of at least one of (i) a lane departure warning system of the equipped vehicle, (ii) a lane keeping system of the equipped vehicle, (iii) a vehicle detection system of the equipped vehicle, (iv) an object detection system of the equipped vehicle, (v) a traffic sign recognition system of the equipped vehicle, (vi) a distance measurement system of the equipped vehicle and (vii) a headlamp control system of the equipped vehicle;

wherein said camera has a forward field of view to the exterior of the equipped vehicle through the windshield of the equipped vehicle;

operating said camera to capture image data;

providing a control comprising an image processor;

providing image data captured by said camera to said image processor;

operating said image processor to process captured image data to determine lane delimiters present in the field of view of said camera;

processing captured image data by said image processor to determine that lane delimiters present in the field of view of said camera are straight;

connecting said control to a vehicle communication bus of the equipped vehicle;

receiving vehicle data at said control via said vehicle communication bus;

wherein vehicle data is provided to said control via said vehicle communication bus by an accelerometer of the equipped vehicle and by at least one of (i) a transmission sensor of the equipped vehicle and (ii) a speed sensor of the equipped vehicle;

executing at said control a vehicle stationary detection routine wherein longitudinal acceleration of the equipped vehicle is provided by said accelerometer over a selected duration of time to said control;

determining at said control a rate of change of acceleration of the equipped vehicle to establish a jerk value;

at least one of (i) receiving at said control speed of the equipped vehicle as sensed by said speed sensor and (ii) receiving at said control transmission status of the equipped vehicle as sensed by said transmission sensor; and

determining that the equipped vehicle is stationary when at least one of (i) said control determines a jerk value that is approximately zero for the selected duration of time and said control receives vehicle data indicating that the speed of the equipped vehicle was approximately zero kilometer/hour for the selected duration of time and (ii) said control determines a jerk value that is approximately zero for the selected duration of time and said control receives vehicle data indicating that the transmission of the equipped vehicle was in ‘Park’ for the selected duration of time.

17. The process of claim 16 , wherein said vehicle communication bus comprises a controller-area network.

18. The process of claim 17 , wherein said control, responsive at least in part to processing of captured image data by said image processor, detects colored lane markers present in the field of view of said camera.

19. The process of claim 17 , wherein said image processor comprises one of (i) an EyeQ2 image processing chip and (ii) an EyeQ3 image processing chip.

20. The process of claim 19 , wherein said camera is part of at least one of (i) a collision avoidance system of the equipped vehicle, (ii) a collision mitigation system of the equipped vehicle and (iii) a stability control system of the equipped vehicle.

Continuity (5)
Continuation 14499784 · Sep 29, 2014
Continuation 14246495 · Apr 7, 2014
Continuation 13779881 · Feb 28, 2013
Provisional Application 61605516 · Mar 1, 2012
Related Publication 20160267725A1 · Sep 15, 2016