Electronic mirror system, image display method, and moving vehicle
View Patent ↗An electronic mirror system presents circumstances surrounding a moving vehicle by displaying an image presenting the circumstances surrounding the moving vehicle. The electronic mirror system includes an image display and an optical system. The image display displays, every time image data is acquired from an image capturing unit, the image, based on the image data acquired from the image capturing unit, on a display screen. The image capturing unit continuously shoots video presenting the circumstances surrounding the moving vehicle. The optical system condenses, into an eye box, a light beam representing the image displayed on the display screen to make a user, who has a viewpoint inside the eye box, view a virtual image based on the image displayed on the display screen. The display screen is arranged to be tilted with respect to an optical path that leads from the display screen to the optical system (30).
1. An electronic mirror system that presents circumstances surrounding a moving vehicle by displaying an image presenting the circumstances surrounding the moving vehicle, the electronic mirror system comprising:
an image display that displays, every time image data is acquired from a camera, the image, based on the image data acquired from the camera, on a display screen, the camera continuously shooting video presenting the circumstances surrounding the moving vehicle; and
an optical system that includes a mirror and condenses, into an eye box, a light beam representing the image displayed on the display screen to allow a user, who has a viewpoint inside the eye box, to view a virtual image based on the image displayed on the display screen, wherein
the display screen is arranged to be tilted with respect to an optical path that leads from the display screen to the optical system,
the image display emits light, that forms the image, downward toward the mirror, and
the mirror reflects the light, emitted from the image display, directly from the image display and downward toward the user.
2. The electronic mirror system of claim 1 , wherein
the image display includes a plurality of display devices, each of the plurality of display devices displaying an associated part of an entire image displayed on the image display, and
respective display screens of the plurality of display devices are tilted with respect to each other.
3. The electronic mirror system of claim 1 , wherein
a light beam emerging, from the display screen of the image display, obliquely to a normal to the display screen is incident on the optical system.
4. The electronic mirror system of claim 1 , further comprising:
a processor; and
a memory including at least one set of instructions that, when executed by the processor, causes the processor to perform operations, the operations including:
producing, based on image data of a stereoscopic rendering target captured in the image displayed on the display screen and distance data about a distance in a real space between the stereoscopic rendering target and the eye box, stereoscopic image data to allow the user to view a stereoscopic virtual image of the stereoscopic rendering target, wherein
the image display displays, on the display screen, a stereoscopic rendering image of a stereoscopic rendering part based on the stereoscopic image data.
5. The electronic mirror system of claim 4 , wherein
the processor regards, when an absolute value of difference between a first distance and a second distance is equal to or greater than a predetermined threshold value, an object as the stereoscopic rendering target,
the first distance is a distance between a display position of the object and the eye box in a situation where a virtual image of the object captured in the image displayed on the display screen is not projected as the stereoscopic rendering target, and
the second distance is a distance in the real space between the object and the eye box.
6. The electronic mirror system of claim 4 , wherein
the processor divides, based on a value of the distance in the real space between the stereoscopic rendering target and the eye box, the image displayed on the image display into a plurality of partial images, and
the processor determines, with respect to each of the plurality of partial images, whether or not the stereoscopic image data is to be produced.
7. The electronic mirror system of claim 4 , wherein
the camera includes a plurality of cameras having mutually different shooting directions, and
the processor acquires, based on image data provided by each of the plurality of cameras, distance data about a distance to an object present within an image capturing range of each of the plurality of cameras.
8. The electronic mirror system of claim 4 , wherein
the processor acquires the distance data from a distance sensor, and
the distance sensor measures a distance to an object present within an image capturing range of the camera.
9. The electronic mirror system of claim 4 , wherein
the image display includes a plurality of display devices, each of the plurality of display devices displaying an associated part of an entire image displayed on the image display, and
respective display screens of the plurality of display devices are tilted with respect to each other.
10. The electronic mirror system of claim 4 , wherein
the processor further produces plane rendering data to have a plane rendering part displayed on the display screen, the plane rendering part forming part of the image displayed on the display screen and being different than the stereoscopic rendering target, and
the image includes: a plane rendering image of the plane rendering part based on the plane rendering data; and the stereoscopic rendering image.
11. The electronic mirror system of claim 10 , wherein
the processor divides, based on a value of the distance in the real space between the stereoscopic rendering target and the eye box, the image displayed on the image display into a plurality of partial images, and
the processor determines, with respect to each of the plurality of partial images, whether or not the stereoscopic image data is to be produced.
12. The electronic mirror system of claim 10 , wherein
the camera includes a plurality of cameras having mutually different shooting directions, and
the processor acquires, based on image data provided by each of the plurality of cameras, distance data about a distance to an object present within an image capturing range of each of the plurality of cameras.
13. The electronic mirror system of claim 10 , wherein
the processor acquires the distance data from a distance sensor, and
the distance sensor measures a distance to an object present within an image capturing range of the camera.
14. The electronic mirror system of claim 10 , wherein
the image display includes a plurality of display devices, each of the plurality of display devices displaying an associated part of an entire image displayed on the image display, and
respective display screens of the plurality of display devices are tilted with respect to each other.
15. The electronic mirror system of claim 5 , wherein
the processor divides, based on a value of the distance in the real space between the stereoscopic rendering target and the eye box, the image displayed on the image display into a plurality of partial images, and
the processor determines, with respect to each of the plurality of partial images, whether or not the stereoscopic image data is to be produced.
16. The electronic mirror system of claim 5 , wherein
the camera includes a plurality of cameras having mutually different shooting directions, and
the processor acquires, based on image data provided by each of the plurality of cameras, distance data about a distance to an object present within an image capturing range of each of the plurality of cameras.
17. The electronic mirror system of claim 5 , wherein
the processor acquires the distance data from a distance sensor, and
the distance sensor measures a distance to an object present within an image capturing range of the camera.
18. The electronic mirror system of claim 6 , wherein
the processor acquires the distance data from a distance sensor, and
the distance sensor measures a distance to an object present within an image capturing range of the camera.
19. An image display method of an electronic mirror system, the electronic mirror system presenting circumstances surrounding a moving vehicle by displaying an image presenting the circumstances surrounding the moving vehicle, the image display method comprising:
displaying, every time image data is acquired from a camera, the image, based on the image data acquired from the camera, on a display screen, the camera continuously shooting video presenting the circumstances surrounding the moving vehicle; and
condensing, by an optical system including a mirror, into an eye box, a light beam representing the image displayed on the display screen to allow a user, who has a viewpoint inside the eye box, to view a virtual image based on the image displayed on the display screen, wherein
the display screen is arranged to be tilted with respect to an optical path that leads from the display screen to the optical system,
the image display emits light, that forms the image, downward toward the mirror, and
the mirror reflects the light, emitted from the image display, directly from the image display and downward toward the user.
20. A moving vehicle, comprising:
a moving vehicle body that moves; and
an electronic mirror system installed in the moving vehicle body, the electronic mirror system presenting circumstances surrounding the moving vehicle, the electronic mirror system comprising:
an image display that displays, every time image data is acquired from a camera, an image, based on the image data acquired from the camera, on a display screen, the camera continuously shooting video presenting the circumstances surrounding the moving vehicle; and
an optical system that includes a mirror and condenses, into an eye box, a light beam representing the image displayed on the display screen to allow a user, who has a viewpoint inside the eye box, to view a virtual image based on the image displayed on the display screen, wherein
the display screen is arranged to be tilted with respect to an optical path that leads from the display screen to the optical system,
the image display emits light, that forms the image, downward toward the mirror, and
the mirror reflects the light, emitted from the image display, directly from the image display and downward toward the user.