IP Library › Granted Patent US 12,515,642
Granted Patent B2
US 12,515,642 · App. 18/077,505 · Granted Jan 6, 2026

Vehicle and control method thereof

Inventors: Dong Hyun Sung (Hwaseong-si, KR); Dae Seok Jeon (Hwaseong-si, KR); Yongseok Kwon (Suwon-si, KR); Tae-Geun An (Gyeongsangbuk-do, KR); Hyoungjong Wi (Seoul, KR); Joon Ho Lee (Seoul, KR); Eungseo Kim (Gyeonggi-do, KR); Sangmin Lee (Seoul, KR)
Assignees: Hyundai Motor Company; Kia Corporation
B60W30/09B60Q9/008B60W40/02G01S13/865G01S13/867B60W2420/403B60W2420/408B60W2554/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,515,642
App. No.
18/077,505
Granted
Jan 6, 2026
Kind
B2
Abstract

A vehicle includes a front camera, a front radar, a corner radar, a corner LiDAR, and a controller configured to generate a first fusion mode by processing image data and radar data or to generate a second fusion mode by processing radar data and LiDAR data, wherein the controller changes the first fusion mode to the second fusion mode when the controller detects an abnormality of the front camera while performing avoidance control of the vehicle based on the first fusion mode, and performs the avoidance control based on the second fusion mode for a predetermined time period.

Claims (43)

1 . A vehicle comprising:

a front camera provided in the vehicle to have a field of front view of the vehicle to obtain image data for detecting an object in the field of the front view;

a front radar provided in the vehicle to have the field of the front view of the vehicle to obtain first radar data for detecting the object in the field of the front view;

a corner radar provided in the vehicle to have a field of a front side view of the vehicle to obtain second radar data for detecting the object in the field of the front side view;

a corner Light Detection and Ranging (LiDAR) provided in the vehicle to have the field of the front side view of the vehicle to obtain LiDAR data for detecting the object in the field of the front side view; and

a controller configured to:

generate a first fusion mode by processing the image data, the first radar data and the second radar data or to generate a second fusion mode by processing the first radar data, the second radar data and the LiDAR data;

utilize the front radar in the first fusion mode when a speed of the vehicle is a predetermined speed or less;

utilize the corner radar in the first fusion mode when the speed of the vehicle exceeds the predetermined speed;

change the first fusion mode to the second fusion mode when the controller detects an abnormality of the front camera while performing avoidance control of the vehicle based on the first fusion mode; and

perform the avoidance control based on the second fusion mode for a predetermined time period.

2 . The vehicle of claim 1 , wherein the controller is configured to obtain a reliability of the first fusion mode, and to conclude that the abnormality has occurred in the front camera when the reliability of the first fusion mode is less than or equal to a threshold value.

3 . The vehicle of claim 2 , wherein the controller is configured to determine the reliability of the first fusion mode based on a change in external illuminance of the front camera.

4 . The vehicle of claim 3 , wherein the controller is configured to detect the change in the external illuminance when the vehicle enters a tunnel, and to determine the reliability of the first fusion mode based on the change in the external illuminance.

5 . The vehicle of claim 3 , wherein the controller is configured to detect the change in the external illuminance based on a number of external light sources, and to determine the reliability of the first fusion mode based on the change in the external illuminance.

6 . The vehicle of claim 3 , wherein the controller is configured to detect a change in the field of the front view based on external weather, and to determine the reliability of the first fusion mode based on the field of the front view.

7 . The vehicle of claim 2 , wherein the controller is configured to obtain the reliability of the first fusion mode for the predetermined time period, and to change the second fusion mode to the first fusion mode when the reliability of the first fusion mode exceeds the threshold value within the predetermined time period.

8 . The vehicle of claim 2 , wherein the controller is configured to obtain the reliability of the first fusion mode for the predetermined time period, and to generate a system warning when the reliability of the first fusion mode is less than or equal to the threshold value within the predetermined time period.

9 . The vehicle of claim 1 , further including:

a switch provided so that the controller is selectively connectable to one of a first terminal and a second terminal of the switch,

wherein the first terminal electrically connects each of the front camera and the front radar, or the front camera and the corner radar to the controller, and

wherein the second terminal electrically connects each of the corner LiDAR and the front radar, or each of the corner LiDAR and the corner radar to the controller.

10 . The vehicle of claim 9 , wherein the controller is connected to the first terminal to generate the first fusion mode, and is connected to the second terminal to generate the second fusion mode.

11 . The vehicle of claim 1 , wherein the controller is configured to determine a risk of collision with the object, and when the controller concludes that the vehicle is in a possibility of the collision, the controller is configured to detect the abnormality of the front camera.

12 . A method of controlling a vehicle, the method comprising:

generating, by a controller of the vehicle, a first fusion mode by processing image data and radar data;

utilizing, by the controller, a front radar in the first fusion mode when a speed of the vehicle is a predetermined speed or less;

utilizing, by the controller, a corner radar in the first fusion mode when the speed of the vehicle exceeds the predetermined speed;

generating, by the controller, a second fusion mode by processing the radar data and LiDAR data;

changing, by the controller, the first fusion mode to the second fusion mode when an abnormality of a front camera is detected while avoidance control is performed based on the first fusion mode; and

performing, by the controller, the avoidance control based on the second fusion mode for a predetermined time period.

13 . The method of claim 12 , wherein the changing of the first fusion mode to the second fusion mode includes obtaining a reliability of the first fusion mode, and concluding that the abnormality has occurred in the front camera when the reliability of the first fusion mode is less than or equal to a threshold value.

14 . The method of claim 13 , wherein the concluding that the abnormality has occurred in the front camera includes determining the reliability of the first fusion mode based on a change in external illuminance of the front camera.

15 . The method of claim 14 , wherein the concluding that the abnormality has occurred in the front camera includes detecting the change in the external illuminance when the vehicle enters a tunnel, and determining the reliability of the first fusion mode based on the change in the external illuminance.

16 . The method of claim 14 , wherein the concluding that the abnormality has occurred in the front camera includes detecting the change in the external illuminance based on a number of external light sources, and determining the reliability of the first fusion mode based on the change in the external illuminance.

17 . The method of claim 14 , wherein the concluding that the abnormality has occurred in the front camera includes detecting a change in a field of a front view based on external weather, and determining the reliability of the first fusion mode based on the field of the front view.

18 . The method of claim 13 , further including:

obtaining the reliability of the first fusion mode for the predetermined time period; and

changing the second fusion mode to the first fusion mode when the reliability of the first fusion mode exceeds the threshold value within the predetermined time period.

19 . The method of claim 13 , further including:

obtaining the reliability of the first fusion mode for the predetermined time period; and

generating a system warning when the reliability of the first fusion mode is less than or equal to the threshold value within the predetermined time period.

20 . The method of claim 12 , wherein the controller is configured to determine a risk of collision with the object, and when the controller concludes that the vehicle is in a possibility of the collision, the controller is configured to detect the abnormality of the front camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2022
From: SUNG, DONG HYUN; JEON, DAE SEOK; KWON, YONGSEOK; AN, TAE-GEUN; WI, HYOUNGJONG; LEE, JOON HO; KIM, EUNGSEO; LEE, SANGMIN
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 062035/0539 →
Priority Claims (1)
KR 10-2022-0006458 · Jan 17, 2022 · national
Continuity (1)
Related Publication 20230227027A1 · Jul 20, 2023
References Cited (9)
US 20190016340A1 · Bae · 2019 [cited by examiner]
US 20200180635A1 · Hong · 2020 [cited by examiner]
US 20220185268A1 · Yun · 2022 [cited by examiner]
US 20220262129A1 · Cao · 2022 [cited by examiner]
US 20220319328A1 · Zhang · 2022 [cited by examiner]
EP 3835823A1 · 2021 [cited by examiner]
KR 1020180065585A · 2018 [cited by applicant]
KR 1020180066524A · 2018 [cited by applicant]
KR 2022095358A · 2022 [cited by examiner]