Display device
A display device including: an image acquisition unit configured to acquire captured images using cameras that capture an image of surroundings of a vehicle; a composite image generation unit configured to synthesize the captured images and generate a composite vehicle image representing the vehicle as viewed from a virtual viewpoint; and a display control unit configured to display the composite vehicle image on an in-vehicle display unit. The composite image generation unit generates the composite vehicle image based on a direction relative to the vehicle from the virtual viewpoint to represent a door of the vehicle as being more widely opened when the virtual viewpoint is located in a predetermined first direction than when the virtual viewpoint is located in a predetermined second direction, the second direction being a direction from which an opening area of the door is more visible from the virtual viewpoint than from the first direction.
1 . A display device comprising:
an electronic control unit (ECU); and
a plurality of cameras, wherein each of the plurality of cameras captures an image of surroundings of a vehicle, wherein the ECU is configured to:
acquire captured images using the plurality of cameras;
synthesize the captured images and generate a composite vehicle image representing the vehicle as viewed from a virtual viewpoint; and
display the composite vehicle image on an in-vehicle display unit;
wherein the ECU is configured to generate the composite vehicle image based on a direction relative to the vehicle from the virtual viewpoint to represent a door of the vehicle as being more widely opened when the virtual viewpoint is located in a predetermined first direction than when the virtual viewpoint is located in a predetermined second direction, the second direction being a direction from which an opening area of the door is more visible from the virtual viewpoint than from the first direction, such that the composite vehicle image represents the door as being opened with a larger opening degree than an actual opening degree of the door.
2 . The display device according to claim 1 , wherein
the door of the vehicle includes a hinged door that opens by rotating around a hinge fixed to a body of the vehicle,
the first direction is a direction not facing an opening area of the hinged door,
the second direction is a direction facing the opening area of the hinged door, and
the ECU is configured to generate the composite vehicle image to represent the hinged door as being opened with a larger rotation amount when the virtual viewpoint is located in the first direction than the rotation amount when the virtual viewpoint is located in the second direction, such that the composite vehicle image represents the hinged door as being opened with a larger rotation than an actual rotation amount of the hinged door.
3 . The display device according to claim 1 , wherein
the door of the vehicle includes a sliding door that opens by moving in a vehicle width direction with a predetermined shift amount and moving in a longitudinal direction relative to a body of the vehicle,
the first direction is a direction not facing an opening area of the sliding door,
the second direction is a direction facing the opening area of the sliding door, and
the ECU is configured to generate the composite vehicle image to represent the sliding door as being moved in the vehicle width direction with a larger shift amount when the virtual viewpoint is located in the first direction than the shift amount when the virtual viewpoint is located in the second direction, such that the composite vehicle image represents the sliding door being opened with a larger shift amount than an actual shift amount of the sliding door.
4 . The display device according to claim 2 , wherein
the door of the vehicle includes a sliding door that opens by moving in a vehicle width direction with a predetermined shift amount and moving in a longitudinal direction relative to a body of the vehicle,
the first direction is a direction not facing an opening area of the sliding door,
the second direction is a direction facing the opening area of the sliding door, and
the ECU is configured to generate the composite vehicle image to represent the sliding door as being moved in the vehicle width direction with a larger shift amount when the virtual viewpoint is located in the first direction than the shift amount when the virtual viewpoint is located in the second direction, such that the composite vehicle image represents the sliding door as being opened with a larger shift amount than an actual shift amount of the sliding door.
5 . The display device according to claim 1 , wherein the ECU is configured to:
calculate an additional amount of door opening degree based on the direction relative to the vehicle from the virtual viewpoint, and
generate the composite vehicle image to represent the door as being opened with a door opening degree obtained by adding the additional amount of door opening degree to the actual opening degree of the door, the additional amount of door opening degree being larger when the virtual viewpoint is located in the first direction than when the virtual viewpoint is located in the second direction.
6 . The display device according to claim 1 , wherein an additional amount of door opening degree is smaller for viewpoints where the opening area of the door of the vehicle is more visible, and larger for viewpoints where the opening area of the door of the vehicle is less visible.
7 . The display device according to claim 5 , wherein the additional amount of door opening degree monotonically increases according to the direction relative to the vehicle from the viewpoint where the opening area of the door of the vehicle is most visible to the viewpoint where it is least visible.
8 . The display device according to claim 1 , further comprising a door opening degree sensor configured to detect the actual opening degree of the door, wherein the ECU is configured to acquire the actual door opening degree based on a detection result of the door opening degree sensor.
9 . The display device according to claim 8 , wherein the door opening degree sensor is a linear sensor.
10 . The display device according to claim 1 , further comprising a human machine interface (HMI) including the in-vehicle display unit, wherein the ECU is configured to acquire the virtual viewpoint in response to an operation by an occupant to select the virtual viewpoint performed on the HMI.
11 . The display device according to claim 1 , wherein the first direction is a direction directly in front of the vehicle, and the second direction is a direction diagonally behind a side of the vehicle.
12 . The display device according to claim 1 , wherein when the virtual viewpoint is located in the second direction, the ECU is configured to generate the composite vehicle image to represent the door opened with a door opening degree equal to the actual opening degree of the door without adding an additional amount of door opening degree.
13 . The display device according to claim 1 , wherein the ECU is configured to generate the composite vehicle image when the vehicle is stopped with the door open.
14 . The display device according to claim 1 , wherein the door of the vehicle is a trunk door, a luggage room door, a hood of a bonnet, or a gull-wing door.
15 . The display device according to claim 10 , wherein the HMI includes a display, a speaker, and a microphone in a vehicle interior, and the display functions as a touch panel, and the operation by the occupant to select the virtual viewpoint is a touch operation on an image corresponding to the virtual viewpoint displayed on the touch panel.