IP Library › Granted Patent US 11,858,424
Granted Patent B2
US 11,858,424 · App. 17/951,623 · Granted Jan 2, 2024

Electronic device for displaying image by using camera monitoring system (CMS) side display mounted in vehicle, and operation method thereof

Inventors: Seungwoo Shin (Suwon-si, KR); Hyewon Kim (Suwon-si, KR); Sanggun Lee (Suwon-si, KR); Yoonji Cho (Suwon-si, KR); Kyunglim Choi (Suwon-si, KR); Wooseok Hwang (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
B60R1/25B60R1/27G06T7/70G06V20/588G06V20/597G08G1/04G08G1/052G08G1/167H04N5/268H04N5/2628H04N7/181H04N23/90B60R1/26B60R11/04B60R2011/0003B60R2011/004B60R2300/304B60R2300/607B60R2300/804G06T2207/30201G06T2207/30256G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,858,424
App. No.
17/951,623
Granted
Jan 2, 2024
Kind
B2
Abstract

A method, performed by an electronic device installed in a vehicle, of switching a view of an image displayed on a camera monitoring system (CMS) side display, and an electronic device are provided. The disclosure includes an electronic device for displaying, on a camera monitoring system (CMS) side display, a first image representing a surrounding environment image, detecting a lane change signal of the vehicle, and, in response to the detected lane change signal, switching the first image displayed on the CMS side display to a second image representing a top view image showing locations of the vehicle and a surrounding vehicle in a virtual image as looking down from above the vehicle, and displaying the second image, and displaying a lane change user interface (UI) indicating information about whether a lane change is possible on the second image, and an operation method thereof.

Claims (52)

1. A method, performed by an electronic device installed in a vehicle, of displaying an image by using a camera monitoring system (CMS) of the vehicle, the method comprising:

displaying, on a CMS side display, a first image that is a surrounding environment image obtained by capturing a left surrounding environment or a right surrounding environment of the vehicle by using an external camera system disposed on a side surface of the vehicle;

detecting a lane change signal of the vehicle;

in response to the detected lane change signal, switching the first image displayed on the CMS side display to a second image that is a top view image showing locations of the vehicle and a surrounding vehicle in a virtual image as looking down from above the vehicle;

reducing a size of the first image;

displaying the reduced first image and the second image by overlaying the reduced first image on the second image; and

displaying, on the second image, a lane change user interface (UI) indicating information about whether a lane change is possible.

2. The method of claim 1 , wherein the detecting of the lane change signal comprises detecting a user input for lighting a turn signal, by the user input comprising a manipulation of a turn signal lever of the vehicle.

3. The method of claim 1 , wherein the detecting of the lane change signal comprises detecting one of a turn or a lane change based on driving route information of a navigation system of the vehicle.

4. The method of claim 1 , wherein the displaying of the lane change UI indicating information about whether the lane change is possible comprises displaying a UI related to driving environment information comprising at least one of a lane, a location of a surrounding vehicle, a relative speed between the vehicle and the surrounding vehicle, a distance between the vehicle and the surrounding vehicle, or an expected entry route of each of the vehicle and the surrounding vehicle detected from the surrounding environment image.

5. The method of claim 1 , further comprising:

detecting a lane departure based on the vehicle departing from a first lane on which the vehicle is currently driving and entering a second lane which is a lane to be entered by a preset range;

in response to the detected lane departure, switching the second image displayed on the CMS side display to a third image comprising only a top view image excluding the overlaid surrounding environment image in the second image; and

displaying the third image on the CMS side display.

6. The method of claim 1 , further comprising:

obtaining an occupant image by using a camera mounted inside the vehicle;

obtaining location information about an occupant, comprising at least one of a head location, a head rotation direction, or a gaze direction of the occupant from the obtained occupant image;

measuring a distance between the occupant and the CMS side display based on the obtained location information of the occupant; and

zooming in or out a field of view (FoV) of the second image based on the measured distance.

7. A non-transitory computer-readable recording medium recording thereon at least one program for implementing the method according to claim 1 .

8. An electronic device configured to display an image using a camera monitoring system (CMS) of a vehicle, the electronic device comprising:

a first external camera disposed on a left side surface of an outside of the vehicle and a second external camera disposed on a right side surface of the outside of the vehicle, wherein the first external camera and the second external camera are configured to:

capture a surrounding environment of the vehicle, and

obtain a first image that is a surrounding environment image;

a CMS side display disposed inside the vehicle displaying the surrounding environment image;

a memory storing a program comprising one or more instructions controlling the electronic device; and

at least one processor configured to execute the one or more instructions of the program stored in the memory,

wherein the processor is further configured to:

detect a lane change signal of the vehicle,

in response to the detected lane change signal:

switch the first image displayed on the CMS side display to a second image that is a top view image showing locations of the vehicle and a surrounding vehicle in a virtual image as looking down from above the vehicle,

reduce a size of the first image,

control the CMS side display to display the first image and the second image by overlaying the reduced first image on the second image, and

display a lane change user interface (UI) indicating information about whether a lane change is possible on the second image.

9. The electronic device of claim 8 , wherein the processor is further configured to:

detect a user input for lighting a turn signal, the user input comprising a manipulation of a turn signal lever of the vehicle, and

switch the first image displayed on the CMS side display to the second image based on the user input.

10. The electronic device of claim 8 , wherein the processor is further configured to display a UI related to driving environment information comprising at least one of a lane, a location of a surrounding vehicle, a relative speed between the vehicle and the surrounding vehicle, a distance between the vehicle and the surrounding vehicle, or an expected entry route of each of the vehicle and the surrounding vehicle detected from the surrounding environment image on the CMS side display.

11. The electronic device of claim 8 ,

wherein the processor is further configured to detect a lane departure that the vehicle departs from a first lane on which the vehicle is currently driving and enters a second lane which is a lane to be entered by a preset range, and

wherein in response to the detected lane departure:

switch the second image displayed on the CMS side display to a third image comprising only a top view image excluding the overlaid surrounding environment image, and

control the CMS side display to display the third image.

12. The electronic device of claim 8 , further comprising:

an internal camera mounted inside the vehicle and configured to obtain an occupant image by capturing an occupant,

wherein the processor is further configured to:

obtain location information of the occupant comprising at least one of a head location, a head rotation direction, or a gaze direction of the occupant from the occupant image,

measure a distance between a driver and the CMS side display based on the obtained location information of the occupant, and

zoom in or out a field of view (FoV) of the second image based on the measured distance.

13. The electronic device of claim 8 , further comprising:

a center information display (CID) disposed on a dashboard of the vehicle,

wherein the processor is further configured to display the second image on the CMS side display and the CID.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2022
From: SHIN, SEUNGWOO; KIM, HYEWON; LEE, SANGGUN; CHO, YOONJI; CHOI, KYUNGLIM; HWANG, WOOSEOK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 061195/0820 →
Priority Claims (1)
KR 10-2020-0037058 · Mar 26, 2020 · national
Continuity (2)
Continuation PCTKR2021003647 · Mar 24, 2021
Related Publication 20230012629A1 · Jan 19, 2023
Cited By (3)
US 12,428,012 US 12,574,476 US 12,594,947