IP Library Granted Patent US 9,185,363
Granted Patent B2
US 9,185,363 · App. 14/185,283 · Granted Nov 10, 2015

Vehicle imaging system and method for categorizing objects using relative motion analysis

Inventors: Sergio E. Murillo Amaya (Holland, MI); David M. Falb (Grand Rapids, MI)
Assignee: GENTEX CORPORATION
H04N7/183B60Q1/085G06K9/00798G06K9/00825
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,185,363
App. No.
14/185,283
Granted
Nov 10, 2015
Kind
B2
Abstract

An imaging system is provided for a vehicle. The imaging system includes: an imager configured to image a forward external scene of the controlled vehicle and to generate image frame data corresponding to each frame of a series of acquired image frames; and a processor configured to receive and analyze the image frame data to detect a dominant scene motion and to determine relative motion of objects as compared to the dominant scene motion, and wherein the analysis of the image frame data performed by the processor includes categorizing objects detected in the image frame data using the relative motion of those objects.

Claims (30)

1. An imaging system for a vehicle, comprising:

an imager configured to image a scene external and forward of the vehicle and to generate image frame data corresponding to each frame of a series of acquired image frames; and

a processor configured to receive and analyze the image frame data to:

detect objects in the scene and a dominant motion of the scene, and

determine relative motion of the detected objects relative to the dominant motion of the scene,

wherein the analysis of the image frame data performed by said processor includes categorizing the detected objects using the relative motion of the detected objects,

wherein said processor categorizes objects detected in the image frame data using one or more of a detected brightness, size, position of center of mass, age, and color of the objects in addition to the relative motion of those objects, and

wherein, when categorizing objects, said processor increases the probability that an object is a vehicle if the object has a high relative motion.

2. The imaging system of claim 1 , wherein said processor detects the dominant motion of the scene based upon objects detected in a small central window within the image frames.

3. The imaging system of claim 1 , wherein said processor determines the relative motion of objects relative to the dominant motion of the scene in part by determining the movement of each of the objects throughout the series of acquired image frames and then comparing such movement to the dominant motion of the scene.

4. The imaging system of claim 3 , wherein said processor generates a light list based upon the analysis of the image frame data, the light list identifying objects in an image frame along with positions of the objects, and wherein said processor maintains a light list history for the series of acquired image frames whereby movement of each of the objects throughout is determined by comparing positions of each of the objects in each light list.

5. The imaging system of claim 4 , wherein said processor determines relative movement for those objects in a light list for an image frame that were identified in at least three prior light lists.

6. An exterior light control system for controlling exterior lights of a controlled vehicle, comprising the imaging system of claim 1 , wherein said processor generates an exterior light control signal that is used to control the exterior lights in response to analysis of the image data.

7. A method for categorizing objects detected in a scene forward of a vehicle, the method comprising:

imaging a scene external and forward of the vehicle and generating image frame data corresponding to each frame of a series of acquired image frames; and

receiving and analyzing the image frame data in a processor to detect objects in the scene and a dominant motion of the scene, to determine relative motion of the detected objects relative to the dominant motion of the scene, and to categorize the detected objects using the relative motion of the detected objects,

wherein objects detected in the image frame data are categorized using one or more of a detected brightness, size, position of center of mass, age, and color of the objects in addition to the relative motion of those objects, and

wherein, when categorizing objects, the probability that an object is a vehicle is increased if the object has a high relative motion.

8. The method of claim 7 , wherein the relative motion of objects is determined relative to the dominant motion of the scene in part by determining the movement of each of the objects throughout the series of acquired image frames and then comparing such movement to the dominant motion of the scene.

9. The method of claim 8 , wherein a light list is generated that identifies objects in an image frame along with positions of the objects, and wherein a light list history is maintained for the series of acquired image frames whereby movement of each of the objects throughout is determined by comparing positions of each of the objects in each light list.

10. The method of claim 9 , wherein relative movement is determined for those objects in a light list for an image frame that were identified in at least three prior light lists.

11. A non-transitory computer readable medium having stored thereon software instructions that, when executed by a processor, cause the processor to categorize objects in a scene forward of a vehicle, by executing the steps comprising:

imaging a scene external and forward of the vehicle and generating image frame data corresponding to each frame of a series of acquired image frames; and

receiving and analyzing the image frame data in a processor to detect objects in the scene and a dominant motion of the scene, to determine relative motion of the detected objects relative to the dominant motion of the scene, and to categorize the detected objects using the relative motion of the detected objects,

wherein objects detected in the image frame data are categorized using one or more of a detected brightness, size, position of center of mass, age, and color of the objects in addition to the relative motion of those objects, and

wherein, when categorizing objects, the probability that an object is a vehicle is increased if the object has a high relative motion.

12. The non-transitory computer readable medium of claim 11 , wherein the software instructions further cause the processor to generate a control signal that is used to control exterior lights of the vehicle in response to analysis of the image data.

13. The non-transitory computer readable medium of claim 12 , wherein the relative motion of objects is determined relative to the dominant motion of the scene in part by determining the movement of each of the detected objects throughout the series of acquired image frames and then comparing such movement to the dominant motion of the scene.

14. The non-transitory computer readable medium of claim 13 , wherein a light list is generated that identifies objects in an image frame along with positions of the objects, and wherein a light list history is maintained for the series of acquired image frames whereby movement of each of the objects throughout is determined by comparing positions of each of the objects in each light list.

15. The non-transitory computer readable medium of claim 14 , wherein relative movement is determined for those objects in a light list for an image frame that were identified in at least three prior light lists.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2023
From: GENTEX CORPORATION
To: HL KLEMOVE CORPORATION
Reel/Frame 065696/0445 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2014
From: MURILLO AMAYA, SERGIO E.; FALB, DAVID M.
To: GENTEX CORPORATION
Reel/Frame 032257/0519 →
Continuity (2)
Provisional Application 61771315 · Mar 1, 2013
Related Publication 20140247351A1 · Sep 4, 2014