IP Library Granted Patent US 10,803,741
Granted Patent B2
US 10,803,741 · App. 16/220,166 · Granted Oct 13, 2020

System and method for recording an image sequence

Inventors: Travis G Ramler (Fairfield, UT); Andreas U Kuehnle (Villa Park, CA); Jeffrey R Coleman (Santa Ana, CA); Hans M Molin (Mission Viejo, CA)
Assignee: Bendix Commercial Vehicle Systems LLC
G08G1/0175B60Q1/0023B60Q1/50B60R1/002B60R11/04G07C5/0891B60R2300/102B60R2300/105B60R2300/607B60R2300/802
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,803,741
App. No.
16/220,166
Granted
Oct 13, 2020
Kind
B2
Abstract

A controller is adapted to receive respective images from a sensors of a first vehicle. The images provide a gapless view along, and within a predetermined perpendicular distance away from, a side of the first vehicle. Movement of a second vehicle along, and within the predetermined perpendicular distance away from, the side of the first vehicle, is detected based on at least one of the images. A position of a front of the second vehicle is predicted based on the movement of the second vehicle. An image sequence is recorded at the position.

Claims (73)

1. A controller, the controller being adapted to:

receive respective images from a sensor of a first vehicle, the images providing a gapless view along, and within a predetermined perpendicular distance away from, a side of the first vehicle;

detect movement of a second vehicle along, and within the predetermined perpendicular distance away from, the side of the first vehicle, based on at least one of the images and by analyzing movement of a wave form generated by a time-differenced cross-lane projection from the sensor;

control the sensor to record the image sequence at a leading edge of the wave form;

receive second respective images from a second sensor of the first vehicle, the second images providing a second gapless view along, and within the predetermined perpendicular distance away from, the side of the first vehicle;

control the second sensor to record the image sequence at the leading edge of the wave form, wherein when the leading edge is within a range of a border between images from the sensor and the second sensor, the sensor and the second sensor are controlled to record the image sequence about the leading edge of the wave form; and

predict a position of a front of the second vehicle based on the movement of the second vehicle and record an image sequence at the position.

2. The controller as set forth in claim 1 , wherein the controller is further adapted to:

record the image sequence based on a status of a stop notification.

3. The controller as set forth in claim 2 , wherein the controller is further adapted to:

receive a notification image of a notification sign on the first vehicle, the notification image being obtained by the sensor; and

identify, based on the notification image, the status of the stop notification to the second vehicle.

4. The controller as set forth in claim 3 , wherein:

if the notification image indicates the notification sign is extended a predetermined distance from the side of the first vehicle, the controller is adapted to identify the status of the stop notification as initiated.

5. The controller as set forth in claim 4 , wherein:

the controller is adapted to compare the notification image with a template image to determine if the notification sign is extended the predetermined distance.

6. The controller as set forth in claim 2 , wherein the controller is further adapted to:

receive a notification image of a notification flasher on the first vehicle, the notification image being obtained by the sensor; and

identify, based on the notification image, the status of the stop notification to the second vehicle.

7. The controller as set forth in claim 1 , wherein:

the predetermined perpendicular distance is between about 5 m and 15 m.

8. The controller as set forth in claim 1 , wherein the controller is further adapted to:

evaluate the leading edge in the image sequence for identifying at least one of a vehicle leading edge region and a license plate identifier.

9. The controller as set forth in claim 8 , wherein the controller is adapted to:

transmit the image sequence to a processor remote from the vehicle for identifying at least one of a character sequence of the vehicle leading edge region and the license plate.

10. The controller as set forth in claim 1 , wherein the controller is further adapted to:

identify an additional lane based on a lane marking;

determine an expected direction of the second vehicle based on the lane marking of the additional lane; and

detect the movement of the second vehicle in the expected direction of the second vehicle.

11. The method as set forth in claim 10 , wherein the controller is further adapted to:

identify another additional lane based on an additional lane marking;

determine an expected direction of a third vehicle based on the additional lane marking of the other additional lane; and

predict movement of the third vehicle in the expected direction of the third vehicle.

12. The controller as set forth in claim 1 , wherein the sensor is a camera.

13. A vehicle system, comprising:

a plurality of sensors providing a gapless view along, and within a predetermined perpendicular distance away from, a side of a vehicle including the vehicle system; and

a controller, included in a surround view system on the vehicle, receiving respective signals representing images taken by the plurality of sensors included in the surround view system on the vehicle, the controller identifying movement of another vehicle along, and within the predetermined perpendicular distance away from, the side of the vehicle, based on the signals representing the respective image from at least one of the sensors and detecting the movement of the other vehicle by analyzing movement of a wave form generated by a time-differenced cross-lane projection from at least one of the sensors, the controller predicting a position of a license plate of the other vehicle based on the movement of the other vehicle and recording an image sequence at the predicted position, wherein when the license plate is within a range of a border between images from two of the plurality of sensors, the plurality of sensors are controlled to record the image sequence about a leading edge of a waveform of the license plate.

14. The vehicle system as set forth in claim 13 , wherein:

the predetermined perpendicular distance is between about 5 m and 15 m.

15. The vehicle system as set forth in claim 14 , wherein:

the sensors include wide-angle lenses for recording the respective image sequences at the predicted position.

16. The vehicle system as set forth in claim 13 , further including:

a notification sign to notify a driver of the other vehicle to not enter within the predetermined perpendicular distance away from the side of the vehicle because passengers are loading/unloading to/from the vehicle.

17. The vehicle system as set forth in claim 16 , wherein:

the signals received from at least one of the sensors include an image of the notification sign; and

the controller determines a status of the notification sign to notify the driver of the other vehicle based on the image of the notification sign.

18. The vehicle system as set forth in claim 17 , wherein:

the controller determines the status of the notification sign by comparing the image of the notification sign with a template image.

19. A method for recording an image sequence, the method comprising:

receiving respective images from a plurality of sensors of a first vehicle, the images providing a gapless view along, and within a predetermined perpendicular distance away from, a side of the first vehicle;

detecting movement of a second vehicle along, and within the predetermined perpendicular distance away from, the side of the first vehicle, based on at least one of the images and by analyzing movement of a wave form generated by a time-differenced cross-lane projection from the plurality of sensors;

controlling the plurality of sensors to record the image sequence at a leading edge of the wave form, wherein when the leading edge is within a range of a border between images from two of the plurality of sensors, the plurality of sensors are controlled to record the image sequence about the leading edge of the wave form;

predicting a position of a front of the second vehicle based on the movement of the second vehicle; and

recording an image sequence at the position.

20. The method as set forth in claim 19 , wherein the recording step includes:

recording the image sequence based on a status of a stop notification.

21. The method as set forth in claim 20 , further including:

receiving a notification image of a notification sign on the first vehicle, the notification image being obtained by at least one of the plurality of sensors; and

identifying, based on the notification image, the status of the stop notification to the second vehicle.

22. The method as set forth in claim 21 , wherein the identifying step includes:

if the notification image indicates the notification sign is extended a predetermined distance from the side of the first vehicle, identifying the status of the stop notification as initiated.

23. The method as set forth in claim 19 , further including:

evaluating the leading edge in the image sequence for identifying an identifier on the license plate.

24. The method as set forth in claim 19 , further including:

detecting the movement of the second vehicle based on a gray level of an adjacent lane.

25. The method as set forth in claim 19 , further including:

identifying an additional lane based on a lane marking;

determining an expected direction of the second vehicle based on the lane marking of the additional lane; and

detecting the movement of the second vehicle in the expected direction of the second vehicle.

26. The method as set forth in claim 25 , further including:

identifying another additional lane based on a lane marking;

determining an expected direction of a third vehicle based on the lane marking of the other additional lane; and

predicting movement of the third vehicle in the expected direction of the third vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2024
From: BENDIX COMMERCIAL VEHICLE SYSTEMS LLC
To: RM ACQUISITION, LLC
Reel/Frame 067824/0004 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: RAMLER, TRAVIS G; KUEHNLE, ANDREAS U; COLEMAN, JEFFREY R; MOLIN, HANS M
To: BENDIX COMMERCIAL VEHICLE SYSTEMS LLC
Reel/Frame 048344/0775 →
Continuity (1)
Related Publication 20200193816A1 · Jun 18, 2020
Cited By (1)
US 12,270,931