Combined virtual and physical environment
In part, the disclosure related to systems and methods of merging a simulation experience with physical objects and sensory stimuli generated outside of the simulation in a controlled physical environment to enhance the simulated experience.
1. An immersive simulation system for providing a combined virtual and physical environment for a plurality of users, the system comprising:
a pod in which a first user and a second user are each experiencing a respective virtual environment, the pod comprising:
a plurality of panels defining one or more interaction zones for the first user and the second user,
a portal sized to permit the first user and the second user to enter the pod,
a tracking system including a plurality of transmitters within the pod, and one or more sensory system stimulating devices, wherein activation of the one or more sensory stimulating devices is synchronized with one or more events in a simulation running on one or more computing devices;
a first computing device positioned on the first user, wherein the first computing device receives information from a plurality of receivers placed on the first user, wherein at least one receiver of the plurality of receivers receives signals from at least one transmitter of the plurality of transmitters, and wherein the first computing device positioned on the first user updates a virtual environment for the first user based on information derived from the received signals;
a headset positioned on the first user, wherein the headset is in communication with the first computing device, the headset providing visual output to the first user based on the updated virtual environment for the first user;
a second computing device positioned on the second user and that receives information from a second plurality of receivers placed on the second user, the computing device on the second user configured to update a virtual environment for the second user based on the received information; and
a server in communication, over a network, with the first computing device and the second computing device, wherein the server:
receives virtual environment update data from the first computing device corresponding to the updated virtual environment for the first user, updates the virtual environment for the second user based on the virtual environment update data,
transmits data regarding the updated virtual environment for the second user to the second computing device positioned on the second user,
determines, at a first point in time, that the first computing device is outside of an area surrounding a physical character in the pod,
responsive to determining that the first computing device is outside of the area, transmits, to the first computing device, first data representing a virtual representation of the physical character in the virtual environment for the first user, wherein generation of the first data is controlled by the server,
determines, at a second point in time, that the first computing device has moved from outside of the area surrounding the physical character to inside of the area surrounding the physical character, and
responsive to determining that the first computing device has moved from outside of the area surrounding the physical character to inside of the area surrounding the physical character, (i) transmits, to a third computing device positioned on the physical character virtual environment data for the first user such that the third computing device enables the physical character to interact with the first user based on the virtual environment for the first user, and (ii) causes the first computing device to present, in the virtual environment for the first user, a transformed depiction of the physical character.
2. The immersive simulation system of claim 1 , wherein the server further updates the virtual environment for the first user based on a physical environment event.
3. The immersive simulation system of claim 2 , wherein the server triggers an environment device based on the physical environment event.
4. The immersive simulation system of claim 2 , wherein the server triggers a user haptic feedback element based on the physical environment event.
5. The immersive simulation system of claim 1 , wherein the server updates the virtual environment for the first user based on a local virtual event.
6. The immersive simulation system of claim 5 , wherein the server triggers a user haptic feedback element based on the local virtual event.
7. The immersive simulation system of claim 1 , wherein the server updates the virtual environment for the first user based on a remote virtual event.
8. The immersive simulation system of claim 1 , wherein the second computing device receives transmitting data regarding the updated virtual environment for the first user from the server, the second computing device updating the virtual environment for the second user based on the received data and providing output data to a second headset for the second user, the output data providing visual output to the second user based on updated virtual environment for the second user.