IP Library › Granted Patent US 12,541,960
Granted Patent B2
US 12,541,960 · App. 17/954,835 · Granted Feb 3, 2026

Method and system for sensor fusion in vehicle

Inventors: Bo Young Yun (Gyeonggi-do, KR); Nam Hyung Lee (Seoul, KR)
Assignees: Hyundai Motor Company; Kia Corporation
G06V10/803G06V20/58G01S13/931G01S17/931
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,541,960
App. No.
17/954,835
Granted
Feb 3, 2026
Kind
B2
Abstract

A method for sensor fusion in a vehicle comprises generating a track for a target vehicle based on data acquired through a surround view monitoring camera of the vehicle, acquiring a plurality of pieces of first point data for an object around the vehicle, identifying a plurality of pieces of second point data associated with the track from among the plurality of pieces of first point data, and updating a sensor fusion track generated for the target vehicle using the plurality of pieces of second point data.

Claims (66)

1 . A method for sensor fusion in a vehicle, the method comprising:

generating a track for a target vehicle based on data acquired through a surround view monitoring camera of a vehicle;

acquiring a plurality of pieces of first point data for an object around the vehicle;

identifying a plurality of pieces of second point data associated with the track for the target vehicle from among the plurality of pieces of first point data;

updating a sensor fusion track generated for the target vehicle using the plurality of pieces of second point data; and

control autonomous driving of the target vehicle based on the updated sensor fusion track;

selecting point data at a first location and point data at a second location among the plurality of pieces of second point data based on an angle formed by a straight line connecting each of the plurality of pieces of second point data from an origin and an X-axis in a vehicle coordinate system having a designated location in the vehicle as the origin,

wherein the updating comprises:

updating location information of the sensor fusion track based on information about the first location and the second location;

generating a two-dimensional equation representing a straight line connecting the first location and the second location;

identifying a first coordinate value of a first corner among corners of the sensor fusion track;

determining a second coordinate value of a corner corresponding to the first corner among corners of the target vehicle based on the two-dimensional equation and the first coordinate value;

calculating a third coordinate value corresponding to a location of a midpoint of a rear bumper of the target vehicle, thereby updating location information of the sensor fusin track;

identifying the second coordinate value having the same Y-axis coordinate value as a Y-axis coordinate value of the first coordinate value in the straight line connecting the first location and the second location;

calculating a heading angle of the sensor fusion track to be updated based on a slope of the straight line connecting the first location and the second location; and

calculating the third coordinate value based on a half value of a width of the track for the target vehicle and the calculated heading angle.

2 . The method according to claim 1 , wherein the sensor fusion track is pre-generated for the target vehicle based on sensor data acquired through a sensing device of the vehicle.

3 . The method according to claim 1 , wherein the target vehicle is located on a side or rear side of the vehicle.

4 . The method according to claim 3 , wherein the identifying comprises:

calculating a distance value from a center point of the track for the target vehicle to any one corner of the track for the target vehicle based on a width and a length of the track for the target vehicle; and

identifying the plurality of pieces of second point data associated with the track for the target vehicle from among the plurality of pieces of first point data based on the distance value.

5 . The method according to claim 4 , wherein the identifying comprises:

determining the distance value as a radius; and

identifying the plurality of pieces of second point data located within the radius from the center point of the track for the target vehicle from among the plurality of pieces of first point data.

6 . The method according to claim 1 , wherein:

the point data at the first location comprises point data having a smallest value as the angle among the plurality of pieces of second point data, and

the point data at the second location comprises point data having a largest value as the angle among the plurality of pieces of second point data.

7 . The method according to claim 1 , wherein the first corner comprises:

a corner located on a lower right side of a center of the sensor fusion track;

a corner located on a lower left side of the center of the sensor fusion track; or

a corner at a shortest distance from a straight line connecting the first location and the second location among the corners of the sensor fusion track.

8 . The method according to claim 1 , wherein:

the heading angle is calculated by applying a slope value of the two-dimensional equation as a variable of an arc tangent function,

an X-axis value of the third coordinate value is calculated based on a value calculated by applying the heading angle as a variable of a sine function, an X-axis value of the second coordinate value, and the half value of the width of the track for the target vehicle, and

a Y-axis value of the third coordinate value is calculated based on a value calculated by applying the heading angle as a variable of a cosine function, a Y-axis value of the second coordinate value, and the half value of the width of the track for the target vehicle.

9 . A system for sensor fusion in a vehicle, the system comprising:

a communication module including a transceiver configured to receive data from a sensing device of a vehicle;

a memory configured to store data of a sensor fusion track generated for a target vehicle; and

a processor electrically connected to the interface and the memory, wherein the processor is configured to:

generate a track for the target vehicle based on data of a surround view monitoring camera of the vehicle received through the interface;

acquire a plurality of pieces of first point data for an object around the vehicle;

identify a plurality of pieces of second point data associated with the track for the target vehicle from among the plurality of pieces of first point data; and

update the sensor fusion track using the plurality of pieces of second point data;

select point data at a first location and point data at a second location among the plurality of pieces of second point data based on an angle formed by a straight line connecting each of the plurality of pieces of second point data from an origin and an X-axis in a vehicle coordinate system having a designated location in the vehicle as the origin;

update location information of the sensor fusion track based on information about the first location and the second location;

generate a two-dimensional equation representing a straight line connecting the first location and the second location;

identify a first coordinate value of a first corner among corners of the sensor fusion track;

determine a second coordinate value of a corner corresponding to the first corner among corners of the target vehicle based on the two-dimensional equation and the first coordinate value;

calculate a third coordinate value corresponding to a location of a midpoint of a rear bumper of the target vehicle, thereby updating location information of the sensor fusin track;

identify the second coordinate value having the same Y-axis coordinate value as a Y-axis coordinate value of the first coordinate value in the straight line connecting the first location and the second location;

calculate a heading angle of the sensor fusion track to be updated based on a slope of the straight line connecting the first location and the second location; and

calculate the third coordinate value based on a half value of a width of the track for the target vehicle and the calculated heading angle.

10 . The system according to claim 9 , wherein the target vehicle is located on a side or rear side of the vehicle.

11 . The system according to claim 10 , wherein the processor is configured to:

calculate a distance value from a center point of the track for the target vehicle to any one corner of the track for the target vehicle based on a width and a length of the track for the target vehicle; and

identify the plurality of pieces of second point data associated with the track for the target vehicle from among the plurality of pieces of first point data based on the distance value.

12 . The system according to claim 11 , wherein the processor is configured to:

determine the distance value as a radius; and

identify the plurality of pieces of second point data located within the radius from the center point of the track for the target vehicle from among the plurality of pieces of first point data.

13 . The system according to claim 9 , wherein:

the point data at the first location comprises point data having a smallest value as the angle among the plurality of pieces of second point data, and

the point data at the second location comprises point data having a largest value as the angle among the plurality of pieces of second point data.

14 . The system according to claim 9 , wherein:

the heading angle is calculated by applying a slope value of the two-dimensional equation as a variable of an arc tangent function,

an X-axis value of the third coordinate value is calculated based on a value calculated by applying the heading angle as a variable of a sine function, an X-axis value of the second coordinate value, and the half value of the width of the track for the target vehicle, and

a Y-axis value of the third coordinate value is calculated based on a value calculated by applying the heading angle as a variable of a cosine function, a Y-axis value of the second coordinate value, and the half value of the width of the track for the target vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2022
From: YUN, BO YOUNG; LEE, NAM HYUNG
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 061246/0219 →
Priority Claims (1)
KR 10-2022-0074112 · Jun 17, 2022 · national
Continuity (1)
Related Publication 20230410489A1 · Dec 21, 2023
References Cited (6)
US 10997435B2 · Abbott et al. · 2021 [cited by applicant]
US 20190138825A1 · Lee · 2019 [cited by examiner]
CN 105427668B · 2017 [cited by examiner]
KR 1020210152394A · 2021 [cited by applicant]
KR 102371616B1 · 2022 [cited by applicant]
Track-Level Fusion of Radar and Lidar Data (Year: 2021). [cited by examiner]