IP Library › Granted Patent US 12,592,082
Granted Patent B2
US 12,592,082 · App. 17/808,715 · Granted Mar 31, 2026

Device and method for providing information for vehicle using road surface

Inventor: Han Seong Yu (Yongin-si, KR)
Assignee: HYUNDAI MOBIS CO., LTD.
G06V20/58B60W40/06B60W2420/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,592,082
App. No.
17/808,715
Granted
Mar 31, 2026
Kind
B2
Abstract

A device and method for providing information for a vehicle. The device includes an object recognition module that photographs a front image of the vehicle and recognizes an object located outside the vehicle, a processor that recognizes a road surface as a road irradiation area, a sidewalk irradiation area, and a boundary area between the road irradiation area and the sidewalk irradiation area based on the photographed front image, and separately generates a driving information image and a walking information image based on the photographed front image, and an image output module that irradiates the driving information image adjusted to a size corresponding to the road irradiation area to the road irradiation area and irradiates the walking information image adjusted to a size corresponding to the sidewalk irradiation area to the sidewalk irradiation area.

Claims (62)

1 . A device for providing information for a vehicle, the device comprising:

an object recognition circuit configured to take a front image of the vehicle and to recognize an object located outside the vehicle;

a processor configured to recognize a road surface as a road irradiation area, a sidewalk irradiation area, and a boundary area between the road irradiation area and the sidewalk irradiation area, based on the front image, and to generate a driving information image and a walking information image based on the front image; and

an image output circuit configured to irradiate the driving information image adjusted to a size corresponding to the road irradiation area to the road irradiation area, and to irradiate the walking information image adjusted to a size corresponding to the sidewalk irradiation area to the sidewalk irradiation area,

wherein a background color of the driving information image in the road irradiation area and a background color of the walking information image in the sidewalk irradiation area are different,

wherein the device is included in the vehicle, and

wherein the object recognition circuit is further configured to recognize a recessed obstacle of the road surface, and the image output circuit is further configured to output the driving information image for dividing the recessed obstacle into a plurality of areas and mapping the divided obstacle with at least two colors, wherein the plurality of areas include a central area and an outer area.

2 . The device of claim 1 , wherein the object recognition circuit includes:

a TOF (Time of Flight) circuit configured to obtain the front image of the vehicle; and

a first actuator configured to control a rotational operation of the TOF circuit,

wherein the image output circuit includes:

a DMD (Digital Micromirror Device) circuit configured to irradiate the walking information image and the driving information image onto the road surface; and

a second actuator configured to control a rotational operation of the DMD circuit.

3 . The device of claim 2 , wherein at least one of the TOF circuit or the DMD circuit rotates toward the road surface corresponding to a driving direction when the driving direction of the vehicle is selected as a left turn or a right turn by a driver.

4 . The device of claim 3 , wherein the processor detects the driving direction of the left turn or the right turn based on information on a blinking of a turn indicator.

5 . The device of claim 2 , wherein the first actuator controls the rotational operation of the TOF circuit while following the object when the vehicle is traveling forward, and

the processor corrects the walking information image depending on a changed distance between the vehicle and the object.

6 . The device of claim 5 , wherein the first actuator controls the rotational operation of the TOF circuit such that a rotational angle of the TOF circuit increases as a distance between the vehicle and the object becomes closer.

7 . The device of claim 2 , further comprising:

a vehicle height sensor configured to detect a tilt of the vehicle and to generate a tilt sensing signal,

wherein the TOF circuit detects a recognition area ratio with respect to the road surface when the vehicle is traveling, and

the first actuator determines whether the vehicle is traveling on a slope based on the tilt sensing signal and the recognition area ratio, and rotates the TOF circuit such that the TOF circuit faces the road surface of the slope when it is determined that the vehicle is traveling on the slope.

8 . The device of claim 1 , wherein the object recognition circuit recognizes a protruding obstacle of the road surface, and

the image output circuit outputs the driving information image for mapping at least two surfaces of the protruding obstacle with complementary colors.

9 . The device of claim 1 , wherein the vehicle includes at least one lamp circuit emitting light to a front of the vehicle, and

at least one of the object recognition module or the image output circuit is built into the lamp circuit.

10 . A method for providing information for a vehicle, the method comprising:

taking a front image of the vehicle and recognizing an object located outside the vehicle;

recognizing a road surface as a road irradiation area, a sidewalk irradiation area, and a boundary area between the road irradiation area and the sidewalk irradiation area, based on the front image;

separately generating a driving information image and a walking information image based on the front image; and

irradiating, by the vehicle, the driving information image adjusted to a size corresponding to the road irradiation area to the road irradiation area, and irradiating the walking information image adjusted to a size corresponding to the sidewalk irradiation area to the sidewalk irradiation area,

wherein a background color of the driving information image in the road irradiation area and a background color of the walking information image in the sidewalk irradiation area are different, and

wherein recognizing of the object includes recognizing a recessed obstacle of the road surface, and

wherein irradiating of the driving information image to the road irradiation area includes outputting the driving information image obtained for dividing the recessed obstacle into a plurality of areas and mapping the divided obstacle with at least two colors,

wherein the plurality of areas include a central area and an outer area.

11 . The method of claim 10 , wherein: the front image of the vehicle is obtained through a TOF (Time of Flight) circuit,

a rotational operation of the TOF circuit is controlled through a first actuator connected to the TOF circuit,

the walking information image and the driving information image are irradiated onto the road surface through a DMD (Digital Micromirror Device) circuit, and

a rotational operation of the DMD circuit is controlled through a second actuator connected to the DMD circuit.

12 . The method of claim 11 , further comprising:

selecting, by a driver of the vehicle, a driving direction of the vehicle as one of a left turn or a right turn; and

rotating at least one of the TOF circuit or the DMD circuit toward the road surface of a sidewalk corresponding to a rotation direction of the vehicle.

13 . The method of claim 11 , wherein recognizing of the object includes:

rotating the TOF circuit while following the object when the vehicle is traveling forward, and

wherein the separately generating of the driving information image and a walking information image includes:

correcting the walking information image depending on a changed distance between the vehicle and the object.

14 . The method of claim 13 , wherein rotating of the TOF circuit while following the object includes:

rotating the TOF circuit such that a rotational angle of the TOF circuit increases as a distance between the traveling vehicle and the object becomes closer.

15 . The method of claim 11 , wherein recognizing of the object further includes:

generating a tilt sensing signal by detecting a tilt of the vehicle using a vehicle height sensor;

detecting a recognition area ratio with respect to the road surface using the TOF circuit when the vehicle is traveling;

determining whether the vehicle is traveling on a slope based on the tilt sensing signal and the recognition area ratio; and

rotating the TOF circuit such that the TOF circuit faces the road surface of the slope when it is determined that the vehicle is traveling on the slope.

16 . The method of claim 10 , wherein recognizing of the object includes:

recognizing a protruding obstacle of the road surface, and

wherein the irradiating of the driving information image to the road irradiation area includes

outputting the driving information image for mapping at least two surfaces of the protruding obstacle with complementary colors.

17 . The device of claim 1 , wherein the image output circuit is configured to:

irradiate the driving information image and the walking information image without overlapping with each other.

18 . The device of claim 1 , wherein the image output circuit is configured to:

map, in a first manner, a color of a recessed obstacle of the road surface; and

map, in a second manner that is different from the first manner, a color of a protruding obstacle of the road surface, to show recessed and protruding features.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2022
From: YU, HAN SEONG
To: HYUNDAI MOBIS CO., LTD.
Reel/Frame 060306/0185 →
Priority Claims (1)
KR 10-2021-0110818 · Aug 23, 2021 · national
Continuity (1)
Related Publication 20230056501A1 · Feb 23, 2023
References Cited (5)
US 20180180247A1 · Park · 2018 [cited by examiner]
US 20200231085A1 · Kunii · 2020 [cited by examiner]
KR 20180123908A · 2018 [cited by examiner]
WO WO2019149409A1 · 2019 [cited by examiner]
WO WO2021090668A1 · 2021 [cited by examiner]