Autonomous vehicle extended reality environments
Autonomous vehicle methods and systems are described herein for communicating with an autonomous or semi-autonomous vehicle to remotely control operation of the vehicle, to detect and remove unauthorized passengers, to deliver loads, to receive registration information for the vehicle, to provide accessibility information to the vehicle, and/or to receive sensor or other environmental data to integrate with an electronic game or other extended reality experience.
1 . A computer-implemented method for creating an extended reality environment for at least one passenger in a vehicle having one or more autonomous or semi-autonomous features, comprising:
obtaining, by one or more processors within a vehicle having one or more autonomous or semi-autonomous features and operating in an autonomous mode, a list of one or more training programs for learning how to operate the vehicle; and
executing, by the one or more processors, the one or more training programs by:
displaying, by the one or more processors, an extended reality environment to at least one passenger on a windshield or a window of the vehicle, wherein the extended reality environment comprises a virtual reality environment or an augmented reality environment;
receiving, at the one or more processors, sensor data regarding an environment surrounding the vehicle from one or more sensors associated with the vehicle;
receiving, at the one or more processors, input signals from one or more user controls associated with the vehicle;
modifying, by the one or more processors, the extended reality environment based at least upon: (i) the input signals or (ii) the sensor data regarding the environment surrounding the vehicle; and
displaying, by the one or more processors, the modified extended reality environment on the windshield or the window of the vehicle while autonomously causing the vehicle to travel to a destination by controlling the one or more autonomous or semi-autonomous features.
2 . The computer-implemented method of claim 1 , further comprising:
determining, based upon the sensor data regarding the environment surrounding the vehicle, to disable the vehicle's one or more autonomous or semi-autonomous features;
displaying, by the one or more processors, a message indicating that the vehicle is changing to a manual driving mode and requesting the at least one passenger to take control of the vehicle;
exiting, by the one or more processors, the display of the extended reality environment; and
disabling, by one or more processors in the vehicle having one or more autonomous or semi-autonomous features, the one or more autonomous or semi-autonomous features.
3 . The computer-implemented method of claim 1 , further comprising:
creating, by the one or more processors, a system identification of one or more objects;
displaying, by the one or more processors and in the extended reality environment, a prompt for a user identification of the one or more objects;
receiving, by the one or more processors, signals corresponding to user inputs;
determining, by the one or more processors, that the user identification matches the system identification;
calculating, by the one or more processors, a user score based upon the matches between the user identification and the system identification; and
displaying, by the one or more processors, the user score to the user.
4 . The computer-implemented method of claim 1 , further comprising:
receiving, by the one or more processors, signals corresponding to user inputs;
determining, by the one or more processors, that the user inputs are correct;
wherein the user inputs are correct when they match a predetermined set of actions as displayed in a game environment;
performing, by the one or more processors, an action corresponding with the predetermined set of actions in response to the determination that the user inputs are correct.
5 . A computer system configured to create an extended reality environment for at least one passenger in a vehicle having one or more autonomous or semi-autonomous features, the computer system comprising one or more local or remote processors, transceivers, and/or sensors configured to:
obtain a list of one or more training programs for learning how to operate the vehicle; and
execute the one or more training programs by:
displaying an extended reality environment to at least one passenger on a windshield or a window of the vehicle having one or more autonomous or semi-autonomous features and operating in an autonomous mode, wherein the extended reality environment comprises a virtual reality environment or an augmented reality environment;
receiving sensor data regarding an environment surrounding the vehicle from one or more sensors associated with the vehicle;
receiving input signals from one or more user controls associated with the vehicle;
modifying the extended reality environment based at least upon: (i) the input signals or (ii) the sensor data regarding the environment surrounding the vehicle; and
displaying the modified extended reality environment on the windshield or the window of the vehicle while autonomously causing the vehicle to travel to a destination by controlling the one or more autonomous or semi-autonomous features.
6 . The computer system of claim 5 , wherein the one or more local or remote processors, transceivers, and/or sensors are further configured to:
determine based upon the sensor data regarding the environment surrounding the vehicle, to disable the vehicle's one or more autonomous or semi-autonomous features;
display a message indicating that the vehicle is changing to a manual driving mode and requesting the at least one passenger to take control of the vehicle;
exit the display of the extended reality environment; and
disable the one or more autonomous or semi-autonomous features.
7 . The computer system of claim 5 , wherein the one or more local or remote processors, transceivers, and/or sensors are further configured to:
create a system identification of one or more objects;
display a prompt for a user identification of the one or more objects;
receive signals corresponding to user inputs;
determine that the user identification matches the system identification;
calculate a user score based upon the matches between the user identification and the system identification; and
display the user score to the user.
8 . The computer system of claim 5 , wherein the one or more local or remote processors, transceivers, and/or sensors are further configured to:
receive signals corresponding to user inputs;
determine that the user inputs are correct;
wherein the user inputs are correct when they match a predetermined set of actions as displayed in a game environment; and
perform an action corresponding with the predetermined set of actions in response to the determination that the user inputs are correct.
9 . A non-transitory computer-readable medium storing thereon a set of instructions that, when executed by one or more processors within a vehicle having one or more autonomous or semi-autonomous features and operating in an autonomous mode, causes the one or more processors to:
obtain a list of one or more training programs for learning how to operate the vehicle; and
execute the one or more training programs by:
displaying an extended reality environment to at least one passenger on a windshield or a window of the vehicle having one or more autonomous or semi-autonomous features and operating in an autonomous mode, wherein the extended reality environment comprises a virtual reality environment or an augmented reality environment;
receiving sensor data regarding an environment surrounding the vehicle from one or more sensors associated with the vehicle;
receiving input signals from one or more user controls associated with the vehicle;
modifying the extended reality environment based at least upon: (i) the input signals or (ii) the sensor data regarding the environment surrounding the vehicle; and
displaying the modified extended reality environment on the windshield or the window of the vehicle while autonomously causing the vehicle to travel to a destination by controlling the one or more autonomous or semi-autonomous features.
10 . The non-transitory computer-readable medium of claim 9 , wherein the instructions further cause the one or more processors to:
determine based upon the sensor data regarding the environment surrounding the vehicle, to disable the vehicle's one or more autonomous or semi-autonomous features;
display a message indicating that the vehicle is changing to a manual driving mode and requesting the at least one passenger to take control of the vehicle;
exit the display of the extended reality environment; and
disable the one or more autonomous or semi-autonomous features.
11 . The non-transitory computer-readable medium of claim 9 , wherein the instructions further cause the one or more processors to:
create a system identification of one or more objects;
display a prompt for a user identification of the one or more objects;
receive signals corresponding to user inputs;
determine that the user identification matches the system identification;
calculate a user score based upon the matches between the user identification and the system identification; and
display the user score to the user.