IP Library Granted Patent US 8,131,018
Granted Patent B2
US 8,131,018 · App. 12/068,651 · Granted Mar 6, 2012

Object detection and recognition system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,131,018
App. No.
12/068,651
Granted
Mar 6, 2012
Kind
B2
Abstract

An object recognition system is provided including at least one image capturing device configured to capture at least one image, wherein the image includes a plurality of pixels and is represented in an image data set, an object detection device configured to identify a plurality of pixels corresponding to objects from the at least one image, wherein an object includes a plurality of pixels and is represented in an object data set, wherein the object data set includes a set of features corresponding to each pixel in the object, and an image recognition device configured to recognize objects of interest present in an object by image correlation against a set of template images to recognize an object as one of the templates.

Claims (46)

1. An object detection and recognition system for a vehicle, comprising:

at least one image capture device;

a vision controller configured to receive images from the image capture device;

an object detector configured to recognize an object of interest within the received images; and

a vehicle controller for receiving the object of interest and configured to control a vehicle subsystem in response to recognition of the object of interest,

wherein the object detector comprises an object segmenter configured to isolate individual objects within the received images and an object recognizer configured to determine whether the individual objects include the object of interest by curve fitting at least one object of interest template to one of the isolated individual objects.

2. An object detection and recognition system for a vehicle, as claimed in claim 1 , wherein the vehicle subsystem is a braking system.

3. An object detection and recognition system for a vehicle, as claimed in claim 1 , wherein the vehicle subsystem is a driver display.

4. An object detection and recognition system for a vehicle, as claimed in claim 1 , wherein the object detector further comprises a database configured to store the at least one object of interest template.

5. An object detection and recognition system, as claimed in claim 4 , wherein the object recognizer is configured to receive the at least one object of interest template from the database, and is configured to curve fit the at least one object of interest template to the one of the isolated individual objects by mapping the at least one object of interest template onto the one of the isolated individual objects by determining values of mapping parameters that minimize a function of deviations between the mapped template and the one of the isolated individual objects.

6. An object detection and recognition system, as claimed in claim 5 , wherein the mapping parameters include a geometrical scale factor and an offset.

7. An object detection and recognition system, as claimed in claim 6 , wherein the mapping parameters further include an illumination scale factor for each color component forming the one of the isolated individual objects.

8. An object detection and recognition system, as claimed in claim 5 , wherein the at least one object of interest template received by the object recognizer is a plurality of object of interest templates from the database,

wherein the object recognizer is configured to:

pre-screen the object of interest templates to obtain pre-screen templates;

curve fit the pre-screened templates to the individual objects to obtain curve fitted templates;

calculate correlation between the curve fitted templates and the individual objects;

select an object of interest template with a maximum correlation; and

report the selected object of interest template to the vehicle controller if the maximum correlation exceeds a minimum value.

9. An object detection and recognition system, as claimed in claim 5 , wherein GPS position data is used to enable or disable the at least one object of interest template received from the database.

10. An object detection and recognition system, as claimed in claim 1 , wherein the object segmenter is configured to receive images from the at least one image capture device and isolate the individual objects within the received images.

11. An object detection and recognition system, as claimed in claim 10 , wherein the object segmenter is configured to use color information to isolate the individual objects within the received images.

12. An object detection and recognition system, as claimed in claim 1 , wherein the object segmenter is configured to receive images from at least two image capture devices to form a stereoscopic representation of the received images to obtain range information for the received images and configured to isolate the individual objects within the received images using said range information.

13. An object detection and recognition system, as claimed in claim 12 , wherein the object segmenter further uses color information in combination with the range information to isolate the individual objects within the received images.

14. A method for object detection and recognition in a vehicle, comprising the steps of:

receiving captured images from at least one image capture device;

isolating individual objects within the received images;

determining whether the individual objects include an object of interest by curve fitting object of interest templates to the individual objects; and

controlling a vehicle subsystem in response to the object of interest.

15. A method for object detection and recognition in a vehicle, as claimed in claim 14 , wherein the vehicle subsystem is a braking system.

16. A method for object detection and recognition in a vehicle, as claimed in claim 14 , wherein the vehicle subsystem is a driver display.

17. A method for object detection and recognition in a vehicle, as claimed in claim 14 , wherein the object of interest templates are stored in a database.

18. A method for object detection and recognition, as claimed in claim 17 , wherein the curve fitting comprises mapping the object of interest templates onto the individual objects by determining values of mapping parameters that minimize a function of the deviations between the mapped templates and the individual objects.

19. A method for object detection and recognition, as claimed in claim 18 , wherein the mapping parameters include a geometrical scale factor and an offset.

20. A method for object detection and recognition system, as claimed in claim 19 , wherein the mapping parameters for each mapped template further include an illumination scale factor for, at each color component, forming its respective isolated individual object.

21. A method for object detection and recognition in a vehicle, as claimed in claim 17 , wherein the determining step further comprises:

receiving the object of interest templates from the database;

pre-screening the object of interest templates to obtain pre-screen templates;

curve fitting the pre-screened templates to the individual objects to obtain curve fitted templates;

calculating correlation between the curve fitted templates and the individual objects;

selecting an object of interest template with a maximum correlation; and

reporting the selected object of interest template to the vehicle controller if the maximum correlation exceeds a minimum value.

22. A method for object detection and recognition in a vehicle, as claimed in claim 21 , wherein GPS position data is used to enable or disable the object of interest templates received from the database.

23. A method for object detection and recognition in a vehicle, as claimed in claim 14 , wherein the isolating step uses color information to isolate the individual objects within the received captured images.

24. A method for object detection and recognition in a vehicle, as claimed in claim 14 , wherein the isolating step receives images from at least two image capture devices to form a stereoscopic representation of the received captured images to obtain range information for the received captured images and isolates the individual objects within the received captured images using said range information.

25. A method for object detection and recognition in a vehicle, as claimed in claim 24 , wherein the isolating step uses color information in combination with the range information to isolate the individual objects within the received images.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded May 8, 2026
From: DEUTSCHE BANK TRUST COMPANY AMERICAS
To: JOYSON SAFETY SYSTEMS ACQUISITION LLC
Reel/Frame 075554/0717 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT SUPPLEMENT Recorded Jan 13, 2026
From: JOYSON SAFETY SYSTEMS ACQUISITION LLC; JOYSON SAFETY SYSTEMS JAPAN G.K.; KEY SAFETY SYSTEMS, INC.; JOYSON SAFETY SYSTEMS GERMANY GMBH
To: DEUTSCHE BANK TRUST COMPANY AMERICAS
Reel/Frame 074331/0585 →
RELEASE OF SECURITY INTEREST Recorded Oct 12, 2021
From: DEUTSCHE BANK TRUST COMPANY AMERICAS, AS SECURITY AGENT FOR THE SECURED PARTIES
To: JOYSON SAFETY SYSTEMS ACQUISITION LLC
Reel/Frame 057775/0726 →
SECURITY INTEREST Recorded Oct 12, 2021
From: JOYSON SAFETY SYSTEMS ACQUISITION LLC
To: DEUTSCHE BANK TRUST COMPANY AMERICAS, AS SECURITY AGENT FOR THE SECURED PARTIES
Reel/Frame 057828/0411 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2018
From: TK HOLDINGS INC.
To: JOYSON SAFETY SYSTEMS ACQUISITION LLC
Reel/Frame 046173/0180 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT SUPPLEMENT Recorded Apr 17, 2018
From: JOYSON SAFETY SYSTEMS ACQUISITION LLC
To: DEUTSCHE BANK TRUST COMPANY AMERICAS
Reel/Frame 045959/0305 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2008
From: WILSON, KITCHENER CLARK
To: TK HOLDINGS, INC.
Reel/Frame 020904/0499 →