IP Library › Granted Patent US 12,738,072
Granted Patent B2
US 12,738,072 · App. 18/775,774 · Granted Sep 15, 2026

Apparatus for correcting a surrounding image of a vehicle and a method thereof

Inventor: Jeong Hun Ham (Goyang-si, KR)
Assignees: HYUNDAI MOTOR COMPANY; KIA CORPORATION
G06V20/58G06F3/013G06T7/20G06V10/60H04N1/60G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,738,072
App. No.
18/775,774
Granted
Sep 15, 2026
Kind
B2
Abstract

An apparatus and a method for correcting a surrounding image of a vehicle are disclosed. The apparatus obtains a surrounding image of a vehicle and detects a moving object in the image. The apparatus changes a color of the moving object to a color that a driver is able to perceive when the color of the moving object is a color that the driver is unable to perceive. Thus, driving convenience is provided to people with color vision impairment.

Claims (40)

1 . An apparatus for correcting a surrounding image of a vehicle, the apparatus comprising:

a camera sensor configured to photograph the surrounding image of the vehicle; and

a controller configured to

detect a moving object in the surrounding image, and

change a color of the moving object to a color that a driver with color vision impairment is able to perceive when the color of the moving object is a color that the driver with color vision impairment is unable to perceive,

wherein the change of the color of the moving object is based on imperceptible colors and perceptible colors pre-stored for each driver with color vision impairment,

wherein the controller is configured to detect a moving object in a digital side mirror (DSM) image corresponding to a turn signal when the turn signal of the vehicle is obtained,

wherein the controller is configured to detect a boundary line of the moving object in the DSM image and change color of a boundary area of the moving object to color that the driver with color vision impairment is able to perceive, and

wherein the controller is configured to detect the moving object in the DSM image of a DSM toward which a gaze of the driver with color vision impairment is directed when gaze information of the driver with color vision impairment is obtained.

2 . The apparatus of claim 1 , wherein the controller is configured to detect a moving object in the surrounding image when it rains, snows, or fogs around the vehicle.

3 . The apparatus of claim 1 , wherein the controller is configured to detect a moving object in the surrounding image when illuminance around the vehicle does not exceed a threshold.

4 . The apparatus of claim 1 , wherein the controller is configured to detect the moving object in the surrounding image when a request for activation of a driver convenience mode is received from the driver with color vision impairment.

5 . The apparatus of claim 1 , wherein the controller is configured to change a color of a border area of the moving object to the color that the driver with color vision impairment is able to perceive.

6 . The apparatus of claim 1 , wherein the controller is configured to change a color of an entire area of the moving object to the color that the driver with color vision impairment is able to perceive.

7 . The apparatus of claim 1 , wherein the controller is configured to overlap a letter corresponding to the color of the moving object on the moving object in the surrounding image.

8 . The apparatus of claim 1 , wherein the controller is configured to overlap an icon corresponding to the color of the moving object on the moving object in the surrounding image.

9 . A method of correcting a surrounding image of a vehicle, the method comprising:

photographing, by a camera sensor, the surrounding image of the vehicle;

detecting, by a controller, a moving object in the surrounding image; and

changing, by the controller, a color of the moving object to a color that a driver with color vision impairment is able to perceive when the color of the moving object is a color that the driver with color vision impairment is unable to perceive,

wherein the change of the color of the moving object is based on imperceptible colors and perceptible colors pre-stored for each driver with color vision impairment, and

wherein detecting the moving object includes:

obtaining, by the controller, a turn signal;

detecting a moving object in a digital side mirror (DSM) image corresponding to the turn signal;

detecting, by the controller, a boundary line of the moving object in the DSM image, and changing, by the controller, color of a boundary area of the moving object to a color that the driver with color vision impairment is able to perceive;

obtaining, by the controller, gaze information of the driver with color vision impairment; and

determining, by the controller, a DSM toward which a gaze of the driver with color vision impairment is directed, and detecting, by the controller, the moving object in the DSM image of the DSM.

10 . The method of claim 9 , wherein detecting the moving object includes:

obtaining, by the controller, weather information around the vehicle; and

detecting, by the controller, a moving object in the surrounding image when it rains, snows, or fogs around the vehicle.

11 . The method of claim 9 , wherein detecting the moving object includes:

measuring, by an illuminance sensor, illuminance around the vehicle; and

detecting, by the controller, a moving object in the surrounding image when the illuminance does not exceed a threshold.

12 . The method of claim 9 , wherein detecting the moving object includes:

receiving, by the controller, a request for activation of a driver convenience mode from the driver with color vision impairment; and

detecting, by the controller, the moving object in the surrounding image.

13 . The method of claim 9 , wherein changing the color of the moving object includes changing, by the controller, a color of a border area of the moving object to the color that the driver with color vision impairment is able to perceive.

14 . The method of claim 9 , wherein changing the color of the moving object includes changing, by the controller, a color of an entire area of the moving object to the color that the driver with color vision impairment is able to perceive.

15 . The method of claim 9 , wherein changing the color of the moving object includes overlapping, by the controller, a letter corresponding to the color of the moving object on the moving object in the surrounding image.

16 . The method of claim 9 , wherein changing the color of the moving object includes overlapping, by the controller, an icon corresponding to the color of the moving object on the moving object in the surrounding image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2024
From: HAM, JEONG HUN
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 068014/0025 →
Priority Claims (1)
KR 10-2023-0176002 · Dec 6, 2023 · national
Continuity (1)
Related Publication 20250191376A1 · Jun 12, 2025
References Cited (45)
US 8493198B1 · Vasquez · 2013 [cited by examiner]
US 9373046B2 · Nelson · 2016 [cited by examiner]
US 10242567B2 · Li · 2019 [cited by examiner]
US 10377304B2 · Chan · 2019 [cited by examiner]
US 10403142B1 · Shuff · 2019 [cited by examiner]
US 10423844B2 · Dai · 2019 [cited by examiner]
US 10527849B2 · Dai · 2020 [cited by examiner]
US 10565872B2 · Chan · 2020 [cited by examiner]
US 10657677B2 · Chan · 2020 [cited by examiner]
US 10740938B2 · Chan · 2020 [cited by examiner]
US 11587314B2 · Kale · 2023 [cited by examiner]
US 11827098B2 · Sohn · 2023 [cited by applicant]
US 11935414B1 · Bond · 2024 [cited by examiner]
US 12090850B2 · Chang · 2024 [cited by examiner]
US 12159077B2 · Yusa · 2024 [cited by examiner]
US 12252014B2 · Shmueli Friedland · 2025 [cited by examiner]
US 20040212546A1 · Dixon · 2004 [cited by examiner]
US 20050195363A1 · Sato · 2005 [cited by examiner]
US 20060061586A1 · Brulle-Drews · 2006 [cited by examiner]
US 20080170118A1 · Albertson · 2008 [cited by examiner]
US 20090201122A1 · Stobbe · 2009 [cited by examiner]
US 20090201309A1 · Demos · 2009 [cited by examiner]
US 20110229023A1 · Jones · 2011 [cited by examiner]
US 20150279022A1 · Shuster · 2015 [cited by examiner]
US 20150379362A1 · Calmes · 2015 [cited by examiner]
US 20160070965A1 · Nelson · 2016 [cited by examiner]
US 20170060234A1 · Sung · 2017 [cited by examiner]
US 20180086346A1 · Fujisawa · 2018 [cited by examiner]
US 20190031085A1 · Ba · 2019 [cited by examiner]
US 20190095729A1 · Dai · 2019 [cited by examiner]
US 20190168668A1 · Chan · 2019 [cited by examiner]
US 20190172229A1 · Chan · 2019 [cited by examiner]
US 20190172234A1 · Chan · 2019 [cited by examiner]
US 20190230252A1 · Ito · 2019 [cited by examiner]
US 20190378449A1 · VanderWel · 2019 [cited by examiner]
US 20200057487A1 · Sicconi · 2020 [cited by examiner]
US 20210319219A1 · Kale · 2021 [cited by examiner]
US 20220324324A1 · Sohn · 2022 [cited by applicant]
US 20220366131A1 · Ekron · 2022 [cited by examiner]
US 20230169734A1 · Alexander · 2023 [cited by examiner]
US 20230296906A1 · Hsiao · 2023 [cited by examiner]
US 20240157791A1 · Shmueli Friedland · 2024 [cited by examiner]
US 20240259519A1 · Machado · 2024 [cited by examiner]
US 20250037602A1 · Yasuda · 2025 [cited by examiner]
KR 20220141020A · 2022 [cited by applicant]