Informing vehicle occupants about points-of-interest
A system for providing information to an occupant of a vehicle includes a global navigation satellite system (GNSS), a vehicle communication system, a display system configured to provide information to the occupant of the vehicle, and a vehicle controller in electrical communication with the GNSS, the vehicle communication system, and the display system. The vehicle controller is programmed to determine a location of the vehicle using the GNSS. The vehicle controller is further programmed to transmit the location of the vehicle to a remote server system using the vehicle communication system. The vehicle controller is further programmed to display a graphic using the display system. The graphic is received from the remote server system. The vehicle controller is further programmed to transmit an engagement metric of the graphic to the remote server system using the vehicle communication system.
1 . A system for providing information to an occupant of a vehicle, the system comprising:
a global navigation satellite system (GNSS);
a vehicle communication system;
a display system configured to provide information to the occupant of the vehicle, wherein the display system includes an augmented reality head-up display (AR-HUD) system, wherein the AR-HUD system includes an occupant position tracking device and an AR-HUD projector, and wherein the AR-HUD system includes a first image plane showing a view of an outside world and a second image plane for displaying graphics; and
a vehicle controller in electrical communication with the GNSS, the vehicle communication system, and the display system, wherein the vehicle controller is programmed to:
determine a location of the vehicle using the GNSS;
transmit the location of the vehicle to a remote server system using the vehicle communication system;
receive a graphic from the remote server system;
determine a position of the occupant using the occupant position tracking device;
calculate a size, shape, and location of the graphic based on the position of the occupant;
display the graphic on a windscreen of the vehicle in the second image plane using the augmented reality head up display system based on the size, shape, and location; and
transmit an impression metric of the graphic to the remote server system using the vehicle communication system, wherein the impression metric quantifies whether the graphic made an impression on the occupant; and
wherein the remote server system includes a server communication system and a server database in electrical communication with a server controller, wherein the server database includes a plurality of database records, wherein each of the plurality of database records includes a graphic display location, a point-of-interest (POI) location, and a POI graphic, and wherein the server controller is programmed to:
receive the location of the vehicle using the server communication system;
select a first of the plurality of database records, wherein the location of the vehicle is within the graphic display location of the first of the plurality of database records;
select the graphic, wherein the graphic is the POI graphic from the first of the plurality of database records;
transmit the graphic to the vehicle communication system using the server communication system;
receive the impression metric using the server communication system and store the impression metric in the server database;
compare the location of the vehicle to the POI location of the first of the plurality of database records in response to determining that the impression metric is true;
determine an elapsed time since the graphic was displayed; and
determine a closure metric to be true only if the location of the vehicle is within the POI location of the first of the plurality of database records, the impression metric is true, and the elapsed time is less than or equal to a predetermined time, wherein the closure metric quantifies whether the graphic influenced a behavior of the occupant.
2 . The system of claim 1 , further including an occupant position tracking device in electrical communication with the vehicle controller, wherein to transmit the impression metric, the vehicle controller is further programmed to:
determine a gaze direction of the occupant using the occupant position tracking device, wherein the gaze direction includes one of: a graphic gaze direction and a non-graphic gaze direction, wherein the graphic gaze direction means that the occupant is looking at the graphic displayed on the AR-HUD;
determine the impression metric based at least in part on the gaze direction of the occupant; and
transmit the impression metric of the graphic to the remote server system using the vehicle communication system.
3 . The system of claim 1 , wherein the display system further includes a transparent windscreen display (TWD) system in electrical communication with the vehicle controller, wherein the transparent windscreen display system includes transparent phosphors embedded in the windscreen of the vehicle and a TWD projector, and wherein to display the graphic, the vehicle controller is further programmed to:
determine a position of the occupant using the occupant position tracking device;
calculate a size, shape, and location of the graphic based on the position of the occupant; and
display the graphic on the windscreen of the vehicle using the TWD system based on the size, shape, and location.
4 . The system of claim 2 , wherein to determine the impression metric based at least in part on the gaze direction of the occupant, the vehicle controller is further programmed to:
determine a gaze time of the occupant in response to determining that the gaze direction is the graphic gaze direction, wherein the gaze time is a length of time for which the occupant is looking at the graphic displayed on the AR-HUD;
compare the gaze time of the occupant to a predetermined gaze time threshold;
determine the impression metric to be true in response to determining that the gaze time of the occupant is greater than or equal to the predetermined gaze time threshold; and
determine the impression metric to be false in response to determining that the gaze time of the occupant is less than the predetermined gaze time threshold.
5 . A method for providing information to an occupant of a vehicle, the method comprising:
determining a location of the vehicle using a global navigation satellite system (GNSS);
selecting a first of a plurality of database records based on the location of the vehicle, wherein each of the plurality of database records includes a graphic display location, a point-of-interest (POI) location, and a POI graphic, wherein the graphic display location is a geofenced area, wherein the POI graphic is a graphic to be displayed when the vehicle is within the graphic display location, and wherein the location of the vehicle is within the graphic display location of the first of the plurality of database records;
determining a graphic, wherein the graphic is the POI graphic from the first of the plurality of database records;
displaying the graphic using a display system;
determining an impression metric based at least in part on a gaze direction of the occupant relative to the graphic, wherein determining the impression metric further comprises:
determining the gaze direction of the occupant using an occupant position tracking device, wherein the gaze direction includes one of: a graphic gaze direction and a non-graphic gaze direction;
determining a gaze time of the occupant in response to determining that the gaze direction is the graphic gaze direction;
comparing the gaze time of the occupant to a predetermined gaze time threshold;
determining the impression metric to be true in response to determining that the gaze time of the occupant is greater than or equal to the predetermined gaze time threshold; and
determining the impression metric to be false in response to determining that the gaze time of the occupant is less than the predetermined gaze time threshold; and
determining a closure metric based at least in part on the impression metric, the location of the vehicle, and the POI location of the first of the plurality of database records, wherein the closure metric is a binary true or false value, and wherein determining the closure metric further comprises:
determining an elapsed time since the graphic was displayed;
comparing the location of the vehicle to the POI location of the first of the plurality of database records; and
determining the closure metric to be true in response to determining that the impression metric is true, the location of the vehicle is within the POI location of the first of the plurality of database records, and the elapsed time is less than or equal to a predetermined time.
6 . The method of claim 5 , wherein the display system includes an augmented reality head-up display (AR-HUD) system, wherein the AR-HUD system includes an occupant position tracking device and an AR-HUD projector, and wherein displaying the graphic further comprises:
determining a position of the occupant using the occupant position tracking device;
calculating a size, shape, and location of the graphic based on the position of the occupant; and
displaying the graphic on a windscreen of the vehicle using the augmented reality head up display system based on the size, shape, and location.
7 . The method of claim 6 , wherein the display system further includes a transparent windscreen display (TWD) system, wherein the transparent windscreen display system includes transparent phosphors embedded in the windscreen of the vehicle and a TWD projector, and wherein displaying the graphic further comprises:
displaying the graphic on the windscreen of the vehicle using the TWD system based on the size, shape, and location.
8 . A system for providing information to an occupant of a vehicle, the system comprising:
a global navigation satellite system (GNSS);
a vehicle communication system;
a display system configured to provide information to the occupant of the vehicle, wherein the display system includes an augmented reality head-up display (AR-HUD) system, wherein the AR-HUD system includes an occupant position tracking device and an AR-HUD projector, and wherein the AR-HUD system includes a first image plane showing a view of an outside world and a second image plane for displaying graphics, wherein the second image plane spans multiple lanes and begins at a first predetermined distance from the vehicle and ends at a second predetermined distance greater than the first predetermined distance; and
a vehicle controller in electrical communication with the GNSS, the vehicle communication system, and the display system, wherein the vehicle controller is programmed to:
determine a location of the vehicle using the GNSS;
transmit the location of the vehicle to a remote server system using the vehicle communication system;
receive a graphic from the remote server system;
determine a position of the occupant using the occupant position tracking device;
calculate a size, shape, and location of the graphic based on the position of the occupant;
display the graphic on a windscreen of the vehicle in the second image plane using the augmented reality head up display system based on the size, shape, and location; and
transmit an impression metric of the graphic to the remote server system using the vehicle communication system, wherein the impression metric quantifies whether the graphic made an impression on the occupant; and
wherein the remote server system includes a server communication system and a server database in electrical communication with a server controller, wherein the server database includes a plurality of database records, wherein each of the plurality of database records includes a graphic display location, a point-of-interest (POI) location, and a POI graphic, wherein the graphic display location is a geofenced area, wherein the POI graphic is a graphic to be displayed when the vehicle is within the graphic display location, and wherein the server controller is programmed to:
receive the location of the vehicle using the server communication system;
select a first of the plurality of database records, wherein the location of the vehicle is within the graphic display location of the first of the plurality of database records;
select the graphic, wherein the graphic is the POI graphic from the first of the plurality of database records;
transmit the graphic to the vehicle communication system using the server communication system;
receive the impression metric using the server communication system and store the impression metric in the server database;
compare the location of the vehicle to the POI location of the first of the plurality of database records in response to determining that the impression metric is true;
determine an elapsed time since the graphic was displayed; and
determine a closure metric to be true only if the location of the vehicle is within the POI location of the first of the plurality of database records, the impression metric is true, and the elapsed time is less than or equal to a predetermined time, wherein the closure metric quantifies whether the graphic influenced a behavior of the occupant.
9 . The system of claim 8 , wherein to transmit the impression metric, the vehicle controller is further programmed to:
determine a gaze direction of the occupant using the occupant position tracking device, wherein the gaze direction includes one of: a graphic gaze direction and a non-graphic gaze direction, wherein the graphic gaze direction means that the gaze direction of the occupant intersects the location of the graphic in the second image plane, and wherein the non-graphic gaze direction means that the gaze direction of the occupant intersects with the first image plane;
determine a gaze time of the occupant in response to determining that the gaze direction is the graphic gaze direction;
compare the gaze time of the occupant to a predetermined gaze time threshold;
determine the impression metric to be true in response to determining that the gaze time of the occupant is greater than or equal to the predetermined gaze time threshold;
determine the impression metric to be false in response to determining that the gaze time of the occupant is less than the predetermined gaze time threshold; and
transmit the impression metric to the remote server system using the vehicle communication system.