Method for creating an automotive mixed-reality gaming system
An automotive mixed-reality gaming system for a vehicle includes vehicle sensors that collect vehicle data associated with movements and a position of the vehicle along a roadway, detection sensors that collect environmental data associated with an external environment of the vehicle, and a processing unit including a processor and a memory. The processing unit receives data from the vehicle sensors and the detection sensors, converts the environmental data to a game-centric coordinate system stored in the memory, and generates an interactive gameplay application including a mixed-reality environment and a virtual avatar based on the game-centric coordinate system. Further, the processing unit transmits the application to mobile devices, receives user input from the mobile devices, and controls the activity of the avatar and settings of the gameplay based on the vehicle data and user input. The avatar traverses the mixed-reality environment at a rate proportional to the vehicle.
1 . An automotive mixed-reality gaming system for a vehicle, comprising:
a plurality of vehicle sensors configured to collect vehicle data associated with movements and a position of the vehicle along a roadway;
a plurality of detection sensors configured to collect environmental data associated with an external environment of the vehicle; and
a processing unit comprising a processor and a memory, the processing unit configured to:
receive the vehicle data from the plurality of vehicle sensors;
receive the environmental data from the plurality of detection sensors;
convert the environmental data to a game-centric coordinate system;
generate a gameplay of an interactive gameplay application stored in the memory, the gameplay comprising a mixed-reality environment based on the game-centric coordinate system;
depict a virtual avatar within the game-centric coordinate system, the avatar being configured to traverse the mixed-reality environment in a direction at a rate proportional to the vehicle;
transmit the gameplay to a plurality of mobile devices, wherein the gameplay is a multiplayer gameplay such that a plurality of virtual avatars controlled by the plurality of mobile devices are depicted in the mixed-reality environment;
receive user input from the plurality of mobile devices; and
control activity of the avatar and adjust one or more settings of the gameplay based on the vehicle data and the user input.
2 . The automotive mixed-reality gaming system of claim 1 , wherein an Electronic Control Unit (ECU) of the vehicle comprises the processing unit.
3 . The automotive mixed-reality gaming system of claim 1 , wherein a server configured to receive the vehicle data and the environmental data via a wireless data connection comprises the processing unit.
4 . The automotive mixed-reality gaming system of claim 1 , wherein the game-centric coordinate system comprises a plurality of projection planes and is configured to depict environmental objects identified by the processing unit from the environmental data in a three-dimensional space.
5 . The automotive mixed-reality gaming system of claim 1 , wherein the processing unit is further configured to modify the mixed-reality environment of the gameplay based on the position of the vehicle within the external environment.
6 . The automotive mixed-reality gaming system of claim 1 , wherein the vehicle data comprises at least one of the following:
a speed of the vehicle;
a direction of the vehicle;
an acceleration of the vehicle; and
an alert of a warning system of the vehicle.
7 . The automotive mixed-reality gaming system of claim 1 , wherein the gameplay comprises interaction with virtual objects superimposed into the mixed-reality environment by the processing unit.
8 . The automotive mixed-reality gaming system of claim 1 , wherein the processing unit is further configured to adjust the one or more settings of the gameplay based on weather conditions of the external environment of the vehicle, the weather conditions being received and determined by the processing unit from the environmental data, an external server, and the user input.
9 . The automotive mixed-reality gaming system of claim 1 , further comprising an infotainment module, the infotainment module comprising:
a display system configured to receive and display the gameplay; and
an interface configured to select the one or more settings of the gameplay.
10 . The automotive mixed-reality gaming system of claim 1 , wherein the plurality of detection sensors comprises a plurality of visual sensors configured to capture a plurality of video feeds, and a perspective of the avatar dynamically shifts between the plurality of video feeds based on the activity of the avatar.
11 . The automotive mixed-reality gaming system of claim 1 , wherein the avatar is depicted in a bowl-view in the mixed-reality environment such that a perspective of the avatar within the mixed-reality environment is adjustable between a top-view, front-view, rear-view, side-view, and angled-view of the avatar based on the user input.
12 . A method for operating an automotive mixed-reality gaming system for a vehicle, comprising:
collecting vehicle data associated with movements and a position of the vehicle along a roadway;
collecting environmental data associated with an external environment of the vehicle;
transmitting the vehicle data and the environmental data to a processing unit;
converting the environmental data to a game-centric coordinate system;
generating a gameplay of an interactive gameplay application stored in a memory, the gameplay comprising a mixed-reality environment based on the game-centric coordinate system;
depicting a virtual avatar within the game-centric coordinate system, the avatar being configured to traverse the mixed-reality environment in a direction at a rate proportional to the vehicle;
transmitting the gameplay to a plurality of mobile devices, wherein the gameplay is a multiplayer gameplay such that a plurality of virtual avatars controlled by the plurality of mobile devices are depicted in the mixed-reality environment;
receiving user input from the plurality of mobile devices; and
controlling activity of the avatar and adjusting one or more settings of the gameplay based on the vehicle data and the user input.
13 . The method according to claim 12 , wherein converting the environmental data to the game-centric coordinate system comprises:
obtaining an image frame from the environmental data;
identifying at least one environmental object in the image frame;
determining an augmentation content based on the at least one environmental object; and
rendering an augmented image frame based on the image frame and the augmentation content.
14 . The method according to claim 12 , wherein converting the environmental data to the game-centric coordinate system comprises depicting at least one environmental object identified from the environmental data in a three-dimensional space.
15 . The method according to claim 12 , further comprising modifying the mixed-reality environment of the gameplay based on the position of the vehicle.
16 . The method according to claim 12 , further comprising adjusting the one or more settings of the gameplay based on weather conditions of the external environment of the vehicle, the weather conditions being received and determined by the processing unit from the environmental data, an external server, and the user input.
17 . The method according to claim 12 , further comprising transmitting the gameplay to a display system of an infotainment module.
18 . The method according to claim 12 , wherein transmitting the gameplay to a plurality of mobile devices comprises transmitting the gameplay wirelessly.
19 . The method according to claim 12 , further comprising dynamically shifting a perspective of the avatar between a plurality of video feeds of the environmental data based on the activity of the avatar.