Systems and methods of augmented reality visualization based on sensor data

1. A device for augmented reality visualization, the device comprising:

an interface configured to:

receive vehicle sensor data from one or more vehicle sensors coupled to a vehicle; and

receive headset sensor data from one or more headset sensors coupled to an augmented reality headset; and

one or more processors configured to:

determine, based on the vehicle sensor data, a movement of the vehicle;

determine, based on the headset sensor data, a movement of the augmented reality headset;

estimate, based on a comparison of the movement of the vehicle and the movement of the augmented reality headset, a user portion of the movement of the augmented reality headset caused by a movement of a head of a user of the augmented reality headset and not caused by the movement of the vehicle;

determine, based on the user portion of the movement of the augmented reality headset, an orientation and a location of the augmented reality headset relative to the vehicle;

estimate a gaze target of the user based on the headset sensor data and the orientation and the location of the augmented reality headset relative to the vehicle;

generate visualization data based on the gaze target, wherein, responsive to determining that the gaze target is inside the vehicle, the visualization data includes a first visual depiction of a first point of interest that is outside the vehicle, and wherein, responsive to determining that the gaze target is outside the vehicle, the visualization data includes a second visual depiction of a second point of interest that is inside the vehicle; and

send the visualization data to a display of the augmented reality headset.

2. The device of claim 1 , wherein the one or more headset sensors include an accelerometer, a gyroscope, a magnetometer, an inertial measurement unit, an image sensor, a beacon, a global positioning system (GPS) receiver, or a combination thereof.

3. The device of claim 1 , wherein the vehicle sensor data is associated with a first time range, wherein the headset sensor data is associated with a second time range, and wherein the one or more processors are further configured to, in response to determining that the first time range matches the second time range, perform the comparison of the movement of the vehicle indicated by the vehicle sensor data and the movement of the augmented reality headset indicated by the headset sensor data.

4. The device of claim 1 , wherein the one or more processors are further configured to:

determine, based on the headset sensor data, whether the user is in the vehicle; and

responsive to determining that the user is in the vehicle, estimate the user portion of the movement of the augmented reality headset based on the comparison of the movement of the vehicle and the movement of the augmented reality headset.

5. The device of claim 1 , wherein, responsive to determining that the gaze target is inside the vehicle, the visualization data further includes a first visual indicator of a location of the second point of interest that is inside the vehicle.

6. The device of claim 5 , wherein the first visual indicator and the second visual depiction include at least one visual element in common, and wherein the visual element includes a color, an image, a video, an animation, a symbol, text, or a combination thereof.

7. The device of claim 1 , wherein, responsive to determining that the gaze target is outside the vehicle, the visualization data further includes a second visual indicator of a location of the first point of interest that is outside the vehicle.

8. The device of claim 7 , wherein the second visual indicator and the first visual depiction include at least one visual element in common, and wherein the visual element includes a color, an image, a video, an animation, a symbol, text, or a combination thereof.

9. The device of claim 1 , wherein the one or more processors are configured to:

estimate a gaze target area based on the orientation and the location of the augmented reality headset relative to the vehicle; and

estimate the gaze target by performing image recognition on the headset sensor data and one or more images associated with the gaze target area.

10. A method of augmented reality visualization, the method comprising:

receiving, at a device, vehicle sensor data from one or more vehicle sensors coupled to a vehicle;

receiving, at the device, headset sensor data from one or more headset sensors coupled to an augmented reality headset;

determining, based on the vehicle sensor data and the headset sensor data, an orientation and a location of the augmented reality headset relative to the vehicle;

estimating, based at least in part on the orientation and the location of the augmented reality headset relative to the vehicle, a gaze target of a user of the augmented reality headset;

generating, at the device, visualization data based on the gaze target, wherein, responsive to determining that the gaze target is inside the vehicle, the visualization data includes a first visual depiction of a first point of interest that is outside the vehicle, and wherein, responsive to determining that the gaze target is outside the vehicle, the visualization data includes a second visual depiction of a second point of interest that is inside the vehicle; and

sending the visualization data from the device to a display of the augmented reality headset.

11. The method of claim 10 , further comprising:

determining, based on the vehicle sensor data, a movement of the vehicle;

determining, based on the headset sensor data, a movement of the augmented reality headset; and

estimating, based on a comparison of the movement of the vehicle and the movement of the augmented reality headset, a user portion of the movement of the augmented reality headset caused by a movement of a head of a user of the augmented reality headset and not caused by the movement of the vehicle,

wherein the orientation and the location of the augmented reality headset relative to the vehicle is determined based on the user portion of the movement of the augmented reality headset.

12. The method of claim 10 , further comprising determining, based on the headset sensor data, whether the user is in the vehicle, wherein, responsive to determining that the user is in the vehicle, the gaze target is estimated based on the orientation and the location of the augmented reality headset relative to the vehicle.

13. The method of claim 10 , wherein, responsive to determining that the gaze target is inside the vehicle, the visualization data further includes a first visual indicator of a location of the second point of interest that is inside the vehicle.

14. The method of claim 13 , wherein the first visual indicator and the second visual depiction include at least one visual element in common, and wherein the visual element includes a color, an image, a video, an animation, a symbol, text, or a combination thereof.

15. The method of claim 10 , wherein, responsive to determining that the gaze target is outside the vehicle, the visualization data further includes a second visual indicator of a location of the first point of interest that is outside the vehicle.

16. The method of claim 15 , wherein the second visual indicator and the first visual depiction include at least one visual element in common, and wherein the visual element includes a color, an image, a video, an animation, a symbol, text, or a combination thereof.

17. A non-transitory computer-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving vehicle sensor data from one or more vehicle sensors coupled to a vehicle;

receiving headset sensor data from one or more headset sensors coupled to an augmented reality headset;

estimating, based on the vehicle sensor data and the headset sensor data, a gaze target of a user of the augmented reality headset;

generating visualization data based on the gaze target, wherein, responsive to determining that the gaze target is inside the vehicle, the visualization data includes a first visual depiction of a first point of interest that is outside the vehicle, and wherein, responsive to determining that the gaze target is outside the vehicle, the visualization data includes a second visual depiction of a second point of interest that is inside the vehicle; and

sending the visualization data to a display of the augmented reality headset.

18. The non-transitory computer-readable storage device of claim 17 , wherein the operations further comprise determining, based on the vehicle sensor data and the headset sensor data, an orientation and a location of the augmented reality headset relative to the vehicle, wherein the gaze target is based on the orientation and the location of the augmented reality headset relative to the vehicle.

19. The non-transitory computer-readable storage device of claim 17 , wherein the operations further comprise:

determining, based on the vehicle sensor data, a movement of the vehicle;

determining, based on the headset sensor data, a movement of the augmented reality headset; and

estimating, based on a comparison of the movement of the vehicle and the movement of the augmented reality headset, a user portion of the movement of the augmented reality headset caused by a movement of a head of a user of the augmented reality headset and not caused by the movement of the vehicle,

wherein the gaze target of the user is based on the user portion of the movement of the augmented reality headset.

20. The non-transitory computer-readable storage device of claim 17 , wherein the operations further comprise:

estimating a gaze target area based on the headset sensor data and the vehicle sensor data; and

estimating the gaze target by performing image recognition on the headset sensor data and one or more images associated with the gaze target area.