AR display device for vehicle and method for operating same
An Augmented Reality (AR) display device interoperating with a vehicle and a method for operating the same are disclosed. An AR display device according to the present disclosure can provide an intuitive AR route to a parking available area or charging available area in a parking lot or charging station based on Advanced Driver Assistance Systems (ADAS) sensing data of a vehicle and/or control data of a parking lot/charging station. It is recognized that the vehicle has arrived in from of a selected parking space or charger, and an AR graphic interface can be changed in real time to sequentially guide forward driving, a change point to reverse driving, and reverse driving to the vehicle in correspondence to a current driving state of the vehicle, such that the vehicle can be parked accurately in the parking space or in front of the charger.
1 . An augmented reality, AR, display device for a vehicle comprising:
a receiver configured to receive image data including a front image of the vehicle, location data including a current location of the vehicle, map data relating to the current location of the vehicle and sensing data of the vehicle;
a processor configured to activate a preset application to render an AR graphic interface overlapping the front image, the AR graphic interface including a first AR object indicating a current driving state of the vehicle and a second AR object indicating a guide for driving based on the current location of the vehicle and the map data; and
a display configured to display the front image overlapped by the AR graphic interface according to the rendering,
wherein the processor is further configured to:
in response to the vehicle entering a parking area including a vehicle battery charging area, search for an area available for parking within the parking area based on at least one of the sensing data or control data of the parking area,
separate the second AR object from the first AR object and update the AR graphic interface to guide the vehicle to the searched area through the separated second AR object, and
recognize that the vehicle has entered in a prohibited driving direction based on the current location and driving state of the vehicle, and update the separated second AR object to output a first guide for displaying a warning notification and a second guide for guiding an allowed driving direction,
wherein the separated second AR includes a plurality of fragments, and
wherein a fragment of the plurality of fragments that is closest to the first AR object provides a guide to be associated with the current driving state indicated by the first AR object.
2 . The AR display device of claim 1 , wherein the processor is configured to render a third AR object to a location of the searched area on the front image of the vehicle, the third AR object displaying the searched area to be selected by a user input, and
update the AR graphic interface, in response to selection of the searched area through the third AR object, such that the separated second AR object displays a guidance toward the selected parking area of the front image.
3 . The AR display device of claim 2 , wherein the processor is configured to determine an available parking type based on the vehicle being within predetermined distance of the selected parking area-, and update the AR graphic interface according to the determination such that the separated second AR object displays a parking guide line for the vehicle to be driven.
4 . The AR display device of claim 3 , wherein the processor is configured to:
in response to the determination of the available parking type, calculate a change point to reverse driving based on the current location of the vehicle and a location of the selected parking area, and
display a first guide line toward the change point through the separated second AR object, and update the AR graphic interface to display a second guide line for the vehicle to travel backward into the selected parking area through the separated second AR object, in response to the current location of the vehicle corresponding to the first AR object being close to the change point.
5 . The AR display device of claim 1 , wherein the processor is configured to
update the AR graphic interface to be displayed in a manner that the separated second AR object is joined to the first AR object, in response to an end of the search.
6 . The AR display device of claim 1 , wherein the processor is configured to update the AR graphic interface to display a location of the parking available area, re-searched based on the sensing data and the control data, in a peripheral area in the allowed driving direction.
7 . The AR display device of claim 1 , wherein the processor is configured to:
in response to the vehicle entering the parking area, determine whether the vehicle battery needs to be charged based on the sensing data of the vehicle,
determine that the vehicle battery needs charging,
search for an area for charging within the charging area based on at least one of the sensing data and the control data, and
update the AR graphic interface to display a location of the searched charging area.
8 . The AR display device of claim 7 , wherein the processor is configured to update the AR graphic interface to display charging-related information regarding the searched charging area on the front image, wherein the charging-related information includes at least one of a charging method and a charging rate.
9 . The AR display device of claim 7 , wherein the processor is configured to update the AR graphic interface to display information related to a remaining charging time for each charging area adjacent to the current location of the vehicle, in response to failure of the search.
10 . The AR display device of claim 1 , wherein the processor is configured to update the AR graphic interface such that the first AR object is rotated to a driving direction of the vehicle, and the separated second AR object displays guide trajectories from the first AR object toward a location of the searched area.
11 . The AR display device of claim 10 , wherein the guide trajectories for the searched area indicate a guidance route generated based on at least one of Advanced Driver Assistance Systems (ADAS) sensing data of the vehicle and the control data of the parking area.