IP Library › Granted Patent US 10,698,415
Granted Patent B2
US 10,698,415 · App. 16/176,615 · Granted Jun 30, 2020

Vehicle assist system

Inventors: Ramakirankumar Indrakanti (Farmington Hills, MI); Hassan Elkhatib (Farmington Hills, MI)
Assignee: TRW AUTOMOTIVE U.S. LLC
G05D1/0246B60T7/12B60W30/09B60W30/12G05D1/0212G06K9/6288G06T7/0002H04N5/247B60W2420/42B60W2550/20B60W2554/00B60W2555/20B60W2710/18B60W2720/10B60W2720/24G05D2201/0213G06K9/00798G06K9/00805G06K9/00818G06K9/00825G06T2207/10048G06T2207/20221G06T2207/30168G06T2207/30192G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,698,415
App. No.
16/176,615
Granted
Jun 30, 2020
Kind
B2
Abstract

A method for assisting operation of a vehicle traveling on a roadway includes acquiring visual images around the vehicle with at least one visual camera having a field of view and acquiring thermal images around the vehicle with at least one thermal camera having the field of view. The thermal images are superimposed over the visual images to produce composite images. An object is detected in the composite images. A vehicle assist system adjusts at least one of a direction of travel and speed of the vehicle in response to detecting the object.

Claims (28)

1. A method for assisting operation of a vehicle traveling on a roadway, comprising:

acquiring a visual image around the vehicle with at least one visual camera having a field of view;

acquiring a thermal image around the vehicle with at least one thermal camera having the field of view;

superimposing the thermal image over the visual image to produce a composite image;

detecting an object in the composite image;

adjusting at least one of a direction of travel and speed of the vehicle in response to detecting the object;

sensing weather conditions and lighting conditions in the field of view;

assigning a first visibility score to the visual image based on the sensed weather conditions;

assigning a second visibility score to the visual image based on the sensed lighting conditions;

combining the first and second visibility scores into an aggregate visibility score; and

adjusting the transparency of thermal image based on the aggregate visibility score prior to superimposing the thermal image onto the visual image.

2. The method of claim 1 , wherein the step of combining the first and second visibility scores comprises calculating a weighted average of the first and second visibility scores to determine the aggregate visibility score.

3. The method of claim 1 further comprising:

detecting lane lines of the roadway with the composite image; and

autonomously performing lane keep assistance in response to detecting the lane lines.

4. The method of claim 1 further comprising:

detecting an object on the roadway with the composite image; and

autonomously braking the vehicle in response to detecting the object.

5. The method of claim 1 further comprising:

detecting a traffic pattern indicator along the roadway with the composite image; and

autonomously braking the vehicle in response to detecting the traffic pattern indicator.

6. A vehicle assist system for a host vehicle traveling on a roadway, comprising:

a visual camera for acquiring a visual image around the host vehicle in a field of view;

a thermal camera for acquiring a thermal image around the host vehicle in the field of view;

a controller connected to the visual camera and the thermal camera and configured to superimpose the thermal image onto the visual image to form a composite image for detecting an object within the field of view and adjusting at least one of a direction of travel and speed of the vehicle in response to detecting the object; and

a rain sensor connected to the controller for detecting precipitation within the field of view, the controller being configured to adjust a transparency of the thermal image in response to the amount of precipitation detected by the rain sensor within the field of view before superimposing the thermal image onto the visual image.

7. The vehicle assist system of claim 6 further comprising a light sensor connected to the controller for detecting light intensity in the field of view, the controller being configured to adjust a transparency of the thermal image in response to the light intensity detected by the light sensor within the field of view before superimposing the thermal image onto the visual image.

8. The vehicle assist system of claim 6 , wherein the controller is configured to perform at least one of lane keep assistance and braking in response to detecting the object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2019
From: INDRAKANTI, RAMAKIRANKUMAR; ELKHATIB, HASSAN
To: TRW AUTOMOTIVE U.S. LLC
Reel/Frame 048881/0861 →
Continuity (1)
Related Publication 20200133295A1 · Apr 30, 2020
Cited By (1)
US 12,274,572