IP Library Granted Patent US 12,365,332
Granted Patent B2
US 12,365,332 · App. 17/718,698 · Granted Jul 22, 2025

Apparatus for assisting driving and method thereof

Inventor: Inhan Kim (Seongnam-si, KR)
Assignee: HL KLEMOVE CORP.
B60W30/09B60W10/18B60W10/20B60W30/0956B60W40/04B60W50/0097G01S13/931G06V20/58B60W2420/403B60W2420/408B60W2554/4041B60W2554/4043B60W2554/4045B60W2554/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,365,332
App. No.
17/718,698
Granted
Jul 22, 2025
Kind
B2
Abstract

Disclosed herein an apparatus for assisting driving of a vehicle includes a camera installed in the vehicle, the camera having a field of view around the vehicle and obtaining image data; and a controller configured to process the image data. The controller may identify at least one object located around the vehicle based on processing the image data, update a trajectory of the vehicle based on an interference between a trajectory of the at least one object and the trajectory of the vehicle, control at least one of a driving device, a braking device, and a steering device of the vehicle based on the updated trajectory of the vehicle.

Claims (48)

1. An apparatus for assisting driving of a vehicle, comprising:

a camera installed in the vehicle, the camera having a field of view around the vehicle and obtaining image data; and

a controller configured to process the image data;

wherein the controller is configured to:

generate an ego trajectory of the vehicle based on a route to a destination obtained from a navigation device of the vehicle,

determine whether the vehicle is going to change the vehicle's lane based on the ego trajectory,

identify at least one object located around the vehicle based on processing the image data,

determine whether the at least one object is going to change the at least one object's lane based on a lateral position, a lateral speed, and an align angle, the align angle being an angle between a direction of the object lane and a direction in which the at least one object moves,

predict a lateral trajectory of the at least one object based on at least one of the lateral speed, a lateral acceleration, and the align angle of the at least one object,

predict a longitudinal trajectory of the at least one object based on a longitudinal speed and a longitudinal acceleration of the at least one object, and

predict an object trajectory of the at least one object based on at least one of the lateral trajectory and the longitudinal trajectory, and

project the ego trajectory and the predicted object trajectory on one coordinate system,

identify, when it is determined that the vehicle is going to change the vehicle's lane to a target lane and the at least one object is going to change the at least one object's lane to the same target lane, whether the ego trajectory and the object trajectory interfere each other on the one coordinate system,

update the ego trajectory of the vehicle based on an interference between the predicted object trajectory of the at least one object and the ego trajectory of the vehicle, and

control at least one of a driving device, a braking device, and a steering device of the vehicle based on the updated trajectory of the vehicle.

2. The apparatus of claim 1 , wherein the controller is further configured to:

identify at least one of the lateral speed, the lateral acceleration, the align angle, the longitudinal speed, and the longitudinal acceleration of the at least one object based on the processing of the image data.

3. The apparatus of claim 1 , wherein the controller is further configured to predict the ego trajectory of the vehicle based on at least one of a speed, an acceleration, or an angular velocity of the vehicle.

4. The apparatus of claim 1 , wherein the controller is further configured to update the ego trajectory of the vehicle to avoid the object trajectory of the at least one object in response to that the ego trajectory of the vehicle interferes with the object trajectory of the at least one object.

5. The apparatus of claim 1 , further comprising a radar installed in the vehicle, the radar having a field of view around the vehicle and obtaining radar data;

wherein the controller is further configured to:

identify at least one object located around the vehicle based on processing the radar data, and

integrate the at least one object based on the processing the image data and the at least one object based on the processing the radar data.

6. The apparatus of claim 5 , wherein, when a plurality of objects are detected based on processing the image data, the controller selects, from among the plurality of detected objects, objects traveling in the vehicle's lane or in an adjacent lane to the vehicle's lane as the at least one object located around the vehicle.

7. A method of assisting driving of a vehicle, the method comprising:

obtaining image data by a camera installed in the vehicle and having a field of view around the vehicle;

generating an ego trajectory of the vehicle based on a route to a destination obtained from a navigation device of the vehicle,

determining whether the vehicle is going to change the vehicle's lane based on the ego trajectory,

identifying at least one object located around the vehicle based on processing of the image data by a processor installed in the vehicle; and

determining whether the at least one object is going to change the at least one object's lane based on a lateral position, a lateral speed, and an align angle, the align angle being an angle between a direction of the object lane and a direction in which the at least one object moves,

predicting a lateral trajectory of the at least one object based on at least one of the lateral speed, a lateral acceleration, and the align angle of the at least one object,

predicting a longitudinal trajectory of the at least one object based on a longitudinal speed and a longitudinal acceleration of the at least one object, and

predicting an object trajectory of the at least one object based on at least one of the lateral trajectory and the longitudinal trajectory, and

projecting the ego trajectory and the predicted object trajectory on one coordinate system,

identifying, when it is determined that the vehicle is going to change the vehicle's lane to a target lane and the at least one object is going to change the at least one object's lane to the same target lane, whether the ego trajectory and the object trajectory interfere each other on the one coordinate system,

updating the ego trajectory of the vehicle based on an interference between the predicted object trajectory of the at least one object and the ego trajectory of the vehicle; and

controlling at least one of a driving device, a braking device, or a steering device of the vehicle based on the updated trajectory of the vehicle.

8. The method of claim 7 , further comprising:

identifying at least one of the lateral speed, the lateral acceleration, the align angle, the longitudinal speed, and the longitudinal acceleration of the at least one object based on the processing of the image data.

9. The method of claim 7 , further comprising:

predicting the ego trajectory of the vehicle based on at least one of a speed, an acceleration, or an angular velocity of the vehicle.

10. The method of claim 7 , further comprising:

updating the ego trajectory of the vehicle to avoid the object trajectory of the at least one object in response to that the ego trajectory of the vehicle interferes with the object trajectory of the at least one object.

11. The method of 10 , further comprising:

obtaining radar data by a radar installed in the vehicle and having a field of view around the vehicle;

identifying at least one object located around the vehicle by the processor based on processing the radar data, and

integrate the at least one object based on the processing the image data and the at least one object based on the processing the radar data.

12. A computer-readable storage medium storing a program for executing the method of claim 7 .

Assignments (2)
MERGER Recorded Aug 15, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061148/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2022
From: KIM, INHAN
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 059574/0085 →
Priority Claims (1)
KR 10-2021-0051164 · Apr 20, 2021 · national
Continuity (1)
Related Publication 20220332311A1 · Oct 20, 2022
References Cited (12)
US 10671076B1 · Kobilarov · 2020 [cited by examiner]
US 10928820B1 · Tao · 2021 [cited by examiner]
US 11858502B2 · Shimizu · 2024 [cited by examiner]
US 20190071093A1 · Ma · 2019 [cited by examiner]
US 20190317511A1 · Xu · 2019 [cited by examiner]
US 20210129834A1 · Gier · 2021 [cited by examiner]
US 20210133466A1 · Gier · 2021 [cited by examiner]
KR 100946525B1 · 2010 [cited by applicant]
KR 20190035255A · 2019 [cited by applicant]
KR 20190064229A · 2019 [cited by applicant]
KR 102127741B1 · 2020 [cited by applicant]
KR OA dated Sep. 27, 2023. [cited by applicant]