Systems and methods for determining a viewing direction of a user
Vehicles and systems and methods for determining a viewing direction of a user are disclosed. In one embodiment, a system for detecting a viewing direction of a user includes a marker arranged at a fixed location, and an optical assembly. The optical assembly includes a first optical sensor arranged to view the marker, and a second optical sensor arranged to view the user. The first optical sensor detects the marker for determining a spatial location of the optical assembly with respect to the marker, and the second optical sensor detects an eye of the user for determining an eye angle of the user.
1. A system for detecting a viewing direction of a user, comprising:
an infrared (IR) reflective film configured to be attached to a surface;
a device that projects a marker in IR light at a fixed location on the IR reflective film;
an optical assembly, comprising:
a first optical sensor arranged to view the marker; and
a second optical sensor arranged to view the user;
a processor; and
a non-transitory computer-readable medium storing computer-readable instructions, that, when executed by the processor, cause the processor to:
receive first data from the first optical sensor, wherein the first data includes a representation of the marker;
receive second data from the second optical sensor, wherein the second data includes a representation of an eye of the user;
determine a spatial location of the optical assembly with respect to the marker from the first data;
determine the eye angle of the eye of the user from the second data; and determine the viewing direction of the user from the spatial location of the optical assembly and the eye angle of the eye of the user.
2. The system of claim 1 , wherein the IR reflective film is configured to be arranged directly on a windshield of a vehicle.
3. The system of claim 2 , wherein:
the device is configured to be arranged on a dashboard of a vehicle;
the first optical sensor is configured to view a reflection of the marker in the windshield of the vehicle.
4. The system of claim 1 , wherein the first optical sensor is an IR sensor for detecting the marker.
5. The system of claim 1 , wherein the optical assembly is configured to be worn on a head of the user.
6. The system of claim 1 , wherein the second optical sensor is an IR sensor for tracking the eye angle of the user.
7. The system of claim 1 , wherein the optical assembly comprises a projector configured to produce augmented reality content viewable by the user based on the spatial location of the optical assembly.
8. A system for detecting a viewing direction of a user within a vehicle, the system comprising:
an infrared (IR) reflective film configured to be attached to a windshield of the vehicle;
a device that projects a marker in IR light at a fixed location on the IR reflective film, wherein the marker is invisible to the user;
an optical assembly configured to be arranged over the eyes of the user, the optical assembly comprising a first optical sensor arranged to view the marker and a second optical sensor arranged to view the user;
a processor; and
a non-transitory computer-readable medium storing computer-readable instructions, that, when executed by the processor, cause the processor to:
receive first data from the first optical sensor, wherein the first data includes a representation of the marker;
receive second data from the second optical sensor, wherein the second data includes a representation of an eye of the user;
determine a spatial location of the optical assembly with respect to the marker from the first data;
determine an eye angle of the eye of the user from the second data; and
determine a viewing direction of the user from the spatial location of the optical assembly and the eye angle of the eye of the user.
9. The system of claim 8 , wherein the optical assembly comprises a projector configured to produce augmented reality content viewable by the user based on the spatial location of the optical assembly.
10. The system of claim 9 , wherein the augmented reality content includes directional indicators.
11. The system of claim 8 , wherein the second optical sensor is for detecting the eye angle of the user.
12. The system of claim 8 , wherein the marker is a QR code.
13. A vehicle comprising:
a windshield;
an infrared (IR) reflective film attached to the windshield;
a device that projects a marker in IR light at a fixed location on the IR reflective film such that the marker is viewable on the windshield;
an optical assembly configured to be arranged on a head of a user, the optical assembly comprising:
a first optical sensor arranged to view the marker; and
a second optical sensor arranged to view an eye of the user;
a processor; and
a non-transitory computer-readable medium storing computer-readable instructions, that, when executed by the processor, cause the processor to:
receive first data from the first optical sensor, wherein the first data includes a representation of the marker;
receive second data from the second optical sensor, wherein the second data includes a representation of the eye of the user;
determine a spatial location of the optical assembly with respect to the marker from the first data;
determine an eye angle of the eye of the user from the second data; and
determine a viewing direction of the user from the spatial location of the optical assembly and the eye angle of the eye of the user.
14. The vehicle of claim 13 , wherein the optical assembly comprises a projector configured to produce augmented reality content viewable by the user based on the spatial location of the optical assembly.
15. The vehicle of claim 13 , wherein the first optical sensor is an IR sensor for detecting the marker.
16. The vehicle of claim 15 , wherein the second optical sensor is an IR sensor for tracking the eye angle of the user.