User perspective alignment for vehicle see-through applications
Examples of the disclosure relate to example systems and methods for operating a see-through display for a vehicle. An example system includes a video camera positioned to capture video related to a vehicle structure that blocks a view of the driver. The system also includes a see-through display disposed inside the vehicle between the vehicle structure and the driver. The system also includes a processor configured to determine an eye position of the driver and process the captured video based on the eye position to determine a portion of the captured video to be displayed. The processor is to render the portion of the captured video to create a see-through effect relative to the vehicle structure. To determine the eye position, the processor receives user input for adjusting the portion of the captured video to create a match between the rendered portion and an unobstructed view of the external environment.
1. A see-through system for a vehicle, comprising:
a video camera positioned to capture video related to a vehicle structure that blocks a view of a driver of the vehicle;
a see-through display screen disposed on an inside of the vehicle between the vehicle structure and the driver; and
a processor configured to:
determine an eye position of the driver;
process the captured video based, at least in part, on the eye position of the driver to determine a portion of the captured video to be displayed on the see-through display screen; and
render the portion of the captured video to create a see-through effect relative to the vehicle structure;
wherein to determine the eye position of the driver comprises receiving user input from the driver for adjusting the portion of the captured video to create a match between the rendered portion and an unobstructed view of the external environment.
2. The see-through system of claim 1 , wherein the user input comprises instructions to move the portion of the captured video up or down, left or right, and zoom in or out.
3. The see-through system of claim 1 , wherein to determine the eye position of the driver comprises to determine initial eye position coordinates before receiving the user input.
4. The see-through system of claim 3 , wherein the initial eye position coordinates are predefined eye position coordinates that are specified relative to the video camera.
5. The see-through system of claim 3 , wherein the initial eye position coordinates are predefined eye position coordinates that are specified relative to a seat position, and wherein the initial eye position coordinates are determined based on the seat position.
6. The see-through system of claim 3 , wherein the initial eye position coordinates are determined from a user defined preset.
7. The see-through system of claim 3 , wherein the initial eye position coordinates are determined from a learned preset acquired by analyzing behavior of the user over time.
8. The see-through system of claim 1 , wherein the vehicle structure that blocks the view of the driver is an A-pillar.
9. The see-through system of claim 1 , wherein the vehicle structure that blocks the view of the driver is a first A-pillar, the see-through system further comprising:
a second video camera positioned to capture video related to a second A-pillar; and
a second see-through display screen disposed inside the vehicle between the second A-pillar and the driver.
10. A method of operating a see-through system for a vehicle comprising:
determining an eye position of a driver;
processing captured video based, at least in part, on the eye position of the driver to determine a portion of the captured video to be displayed on a see-through display screen disposed on an inside of the vehicle and positioned between the driver and a vehicle structure that blocks the driver's view of the external environment; and
rendering the portion of the captured video to create a see-through effect relative to the vehicle structure;
wherein determining the eye position of the driver comprises receiving user input from the driver for adjusting the portion of the captured video to create a match between the rendered portion and an unobstructed view of the external environment.
11. The method of claim 10 , wherein determining the eye position of the driver comprises determining initial eye position coordinates before receiving the user input.
12. The method of claim 11 , wherein the initial eye position coordinates are predefined eye position coordinates that are specified relative to a video camera used for capturing the captured video.
13. The method of claim 11 , wherein the initial eye position coordinates are predefined eye position coordinates that are specified relative to a seat position, and wherein the initial eye position coordinates are determined based on the seat position.
14. The method of claim 11 , wherein the initial eye position coordinates are determined from a user defined preset.
15. The method of claim 11 , wherein the initial eye position coordinates are determined from a learned preset acquired by analyzing behavior of the user over time.
16. The method of claim 10 , wherein the vehicle structure that block the driver's view of the outside environment is an A-pillar.
17. A non-transitory computer-readable medium comprising instructions to direct the actions of a processor to operate a see-through system of a vehicle, the instructions to direct the processor to:
determine an eye position of a driver;
process captured video based, at least in part, on the eye position of the driver to determine a portion of the captured video to be displayed on a see-through display screen disposed on an inside of the vehicle and positioned between the driver and a vehicle structure that blocks the driver's view of the external environment; and
render the portion of the captured video to create a see-through effect relative to the vehicle structure;
wherein to determine the eye position of the driver comprises to receive user input from the driver for adjusting the portion of the captured video to create a match between the rendered portion and an unobstructed view of the external environment.
18. The non-transitory computer-readable medium of claim 17 , wherein to determine the eye position of the driver comprises obtaining initial eye position coordinates that are predefined eye position coordinates that are specified relative to a video camera used to capture the captured video.
19. The non-transitory computer-readable medium of claim 17 , wherein to determine the eye position of the driver comprises obtaining initial eye position coordinates according to a sensed seat position and predefined eye position coordinates that are specified relative to the seat position.
20. The non-transitory computer-readable medium of claim 17 , wherein to determine the eye position of the driver comprises obtaining initial eye position coordinates from a user defined preset or a learned preset acquired by analyzing behavior of the user over time.