IP Library Granted Patent US 10,752,259
Granted Patent B2
US 10,752,259 · App. 16/219,650 · Granted Aug 25, 2020

Back warning apparatus, and method and control system therefor

Inventor: Kyung Geun Jeon (Yongin-si, KR)
Assignee: MANDO CORPORATION
B60W50/14B60R11/04B60W40/06G06T7/55B60W2554/00G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,752,259
App. No.
16/219,650
Granted
Aug 25, 2020
Kind
B2
Abstract

Provided is a back warning apparatus and a method and control system therefor. The back warning apparatus includes an image sensor installed at a rear of a vehicle, and a controller that obtains a rearview image via the image sensor when the vehicle moves rearward, recognizes the boundary of a free space in the rearview image and generates a surface profile associated with the height/depth of a surface behind the vehicle, determines the attribute of a rear object based on the boundary of the free space and the surface profile, and outputs a warning by determining whether a hazard exists in association with the attribute of the rear object based on the information associated with the vehicle. According to the present disclosure, information associated with a rear object having a short height is provided, thereby making effective use of a parking space and preventing damage to the bodywork of the vehicle.

Claims (54)

1. A back warning apparatus, the apparatus comprising:

an image sensor mounted to a vehicle and configured to capture image data behind the vehicle;

an image processor configured to process image data captured by the image sensor;

a sensor configured to obtain information associated with the vehicle; and

a controller comprising a non-transitory memory and a processor, and configured to output a back warning based on processing of the image data,

wherein the controller is further configured to:

obtain a rearview image based on processing of the image data when the vehicle moves rearward;

recognize a boundary of a free space in the rearview image, and generate a surface profile associated with a height or depth of a surface behind the vehicle;

determine a position and height or depth of a rear object based on the boundary of the free space and the surface profile,

determine whether a hazard exists in association with an attribute of the rear object, based on the information associated with the vehicle,

output a warning dependent on the determined position and height or depth of the rear object, and

output, if a depth of the rear object is greater than a height to a bodywork of the vehicle, a warning based on a distance between a position of a rear wheel of the vehicle and the rear object.

2. The apparatus of claim 1 , wherein the information associated with the vehicle comprises information associated with a height to a bodywork of the vehicle, a position of a rear wheel, a position of a rearmost section of the vehicle, and a position of a lowermost portion of the bodywork of the vehicle behind the rear wheel.

3. The apparatus of claim 1 , wherein the controller is further configured to output, if the height of the rear object is higher than a height to a bodywork of the vehicle, a warning based on a distance between a rearmost section of the vehicle and the rear object.

4. The apparatus of claim 1 , wherein the controller is further configured to output, if the height of the rear object is lower than a height to a bodywork of the vehicle, a warning based on a distance between a position of a rear wheel of the vehicle and the rear object.

5. The apparatus of claim 1 , wherein the controller is further configured to output different warnings at different to times based on the position and height or depth of the rear object.

6. A back warning apparatus, the apparatus comprising:

an image sensor mounted to a vehicle and configured to capture image data behind the vehicle; and

a controller configured to process image data captured by the image sensor, and to control at least one driver assistance system installed in the vehicle;

wherein the controller is configured to:

obtain a rearview image based on processing of the image data when the vehicle moves rearward;

recognize a boundary of a free space in the rearview image and generate a surface profile associated with a height or depth of a surface behind the vehicle;

determine an attribute of a rear object based on the boundary of the free space and the surface profile;

determine whether a hazard exists in association with the attribute of the rear object, based on information associated with the vehicle,

output, if a hazard is detected, a warning, the warning being different depending on the determined attribute, and

determine a position and a height or depth of the rear object based on the boundary of the free space and the surface profile, and when a depth of the rear object is greater than a height to a bodywork of the vehicle, output a warning based on a distance between a position of a rear wheel of the vehicle and the rear object.

7. The apparatus of claim 6 , wherein the information associated with the vehicle comprises information associated with a height to a bodywork of the vehicle, a position of a rear wheel, a position of a rearmost section of the vehicle, and a position of a lowermost portion of the bodywork of the vehicle behind the rear wheel.

8. The apparatus of claim 6 , wherein the controller is further configured to determine a position and a height or depth of the rear object based on the boundary of the free space and the surface profile, and when the height of the rear object is higher than a height to a bodywork of the vehicle, output a warning based on a distance between a rearmost section of the vehicle and the rear object.

9. The apparatus of claim 6 , wherein the controller is further configured to determine a position and a height or depth of the rear object based on the boundary of the free space and the surface profile, and when the height of the rear object is lower than a height to a bodywork of the vehicle, output a warning based on a distance between a position of a rear wheel of the vehicle and the rear object.

10. The back warning apparatus of claim 6 , further comprising a sensor configured to obtain information associated with the vehicle.

11. A back warning method of a vehicle, the method comprising:

obtaining a rearview image via an image sensor installed at a rear of the vehicle when the vehicle moves rearward;

recognizing a boundary of a free space in the rearview image and generating a surface profile associated with a height/depth of a surface;

determining a position and height or depth of a rear object based on the boundary of the free space and the surface profile;

determining whether a hazard exists in association with the position and height or depth of the rear object based on information associated with the vehicle; and

outputting different warnings, the warnings being different based on position and height or depth of the rear object relative to a height of a bodywork of the vehicle and a position of a rear wheel of the vehicle relative to the rear object,

wherein, if a depth of the rear object is greater than a height to a bodywork of the vehicle, the outputting of the different warnings comprises outputting a warning based on a distance between a position of a rear wheel of the vehicle and the rear object.

12. The method of claim 11 , wherein, if the height of the rear object is higher than a height to a bodywork of the vehicle, the outputting of the different warnings comprises:

outputting a warning based on a distance between a rearmost section of the vehicle and the rear object.

13. The method of claim 11 , wherein, if the height of the rear object is lower than a height to a bodywork of the vehicle, the outputting of the different warnings comprises:

outputting a warning based on a distance between a position of a rear wheel of the vehicle and the rear object.

14. The method of claim 11 , wherein the different warnings are outputted at different times.

15. A warning apparatus for a vehicle, the apparatus comprising:

an image sensor mounted to a vehicle and configured to capture image data in a field of view behind the vehicle;

an image processor configure to process the image data captured by the image sensor; and

a controller comprising a non-transitory memory and a processor, and configured to:

generate a surface profile of a surface behind the vehicle,

recognize an object on the surface behind the vehicle and recognize a boundary of a free space between the rearmost portion of the vehicle and the recognized object,

determine a height, depth or both of the object based on the recognized boundary and the surface profile, and

determine whether the height, depth or both of the object poses a hazard to the vehicle and determine the part of the vehicle to which the hazard is posed, output different warnings depending on the type of hazard being posed based on information associated with the vehicle,

wherein the different warnings includes a warning based on a distance between a position of a rear wheel of the vehicle and the rear object if a depth of the rear object is greater than a height to a bodywork of the vehicle.

16. The warning apparatus of claim 15 , wherein a different warning is output depending on whether the height of the rear object is higher than a height to a bodywork of the vehicle, the height of the rear object is lower than a height to a bodywork of the vehicle, or a depth of the rear object is greater than a height to a bodywork of the vehicle.

17. The warning apparatus of claim 16 , wherein the outputting of the different warnings is initiated at different times after detecting that the object poses a hazard.

18. The warning apparatus of claim 15 , wherein the information associated with the vehicle comprises information associated with a height to a bodywork of the vehicle, a position of a rear wheel, a position of a rearmost section of the vehicle, and a position of a lowermost portion of the bodywork of the vehicle behind the rear wheel.

Assignments (3)
MERGER Recorded Aug 1, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061041/0209 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058598/0480 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2018
From: JEON, KYUNG GEUN
To: MANDO CORPORATION
Reel/Frame 047772/0187 →