System and method for augmented and virtual reality
One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.
1. A method comprising:
receiving, at a computer network comprising one or more computing devices, a first input from an interface of a mobile phone, the mobile phone in communication with a user device and further in communication with the computer network via a wireless mobile network connection;
receiving, at the computer network, a second input via an environment-sensing system of the user device, from a local environment of the user device; and
generating second virtual world data based on first virtual world data and further based on the first input and the second input;
wherein:
the mobile phone is configured to present, based on the second virtual world data, virtual content to a user of the user device,
said presenting the virtual content to the user comprises presenting a visual rendering of the virtual content in a 3D format, and
presenting the visual rendering of the virtual content in the 3D format comprises presenting the visual rendering on a display in communication with the mobile phone based on a position and orientation of the first user device.
2. The method of claim 1 , wherein the interface comprises a touch screen of the mobile phone and wherein the touch screen comprises the display.
3. The method of claim 1 , wherein the wireless mobile network connection comprises a cellular network connection.
4. The method of claim 3 , wherein the mobile phone executes a software application that implements a gateway, and the mobile phone is in communication with the computer network via the gateway.
5. The method of claim 1 , wherein the mobile phone is in communication with the user device via a wired connection.
6. The method of claim 1 , wherein:
the mobile phone comprises a camera, and
the mobile phone is further configured to present, via the display, concurrently with said presenting the virtual content to the user, an image of a physical environment captured by the camera.
7. The method of claim 6 , wherein:
the virtual content comprises a plurality of virtual objects and said presenting the virtual content to the user further comprises overlaying the plurality of virtual objects on the image of the physical environment on the display.
8. The method of claim 1 , wherein a frame coupled to the mobile phone comprises the environment-sensing system.
9. The method of claim 8 , wherein the frame is removably coupled to the mobile phone.
10. The method of claim 9 , wherein the frame is head-wearable by the user.
11. A system comprising:
a computer network configured to communicate with a mobile phone via a wireless mobile network connection, the computer network comprising:
one or more computing devices; and
one or more processors configured to perform a method comprising:
receiving a first input from an interface of the mobile phone, the mobile phone in communication with a user device and further in communication with the computer network via the wireless mobile network connection;
receiving a second input via an environment-sensing system of the user device, from a local environment of the user device; and
generating second virtual world data based on first virtual world data and further based on the first input and the second input;
wherein:
the mobile phone is configured to present, based on the second virtual world data, virtual content to a user of the user device,
said presenting the virtual content to the user comprises presenting a visual rendering of the virtual content in a 3D format, and
presenting the visual rendering of the virtual content in the 3D format comprises presenting the visual rendering on a display in communication with the mobile phone based on a position and orientation of the first user device.
12. The system of claim 11 , wherein the interface comprises a touch screen of the mobile phone and wherein the touch screen comprises the display.
13. The system of claim 11 , wherein:
the wireless mobile network connection comprises a cellular network connection,
the mobile phone is configured to execute a software application that implements a gateway, and
the computer network is configured to communicate with the mobile phone via the gateway.
14. The system of claim 11 , wherein:
the mobile phone comprises a camera,
the mobile phone is further configured to present, via the display, concurrently with said presenting the virtual content to the user, an image of a physical environment captured by the camera,
the virtual content comprises a plurality of virtual objects, and
said presenting the virtual content to the user further comprises overlaying the plurality of virtual objects on the image of the physical environment on the display.
15. The system of claim 11 , wherein:
a frame removably coupled to the mobile phone comprises the environment-sensing system, and
the frame is head-wearable by the user.
16. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving, at a computer network comprising one or more computing devices, a first input from an interface of a mobile phone, the mobile phone in communication with a user device and further in communication with the computer network via a wireless mobile network connection;
receiving, at the computer network, a second input via an environment-sensing system of the user device, from a local environment of the user device; and
generating second virtual world data based on first virtual world data and further based on the first input and the second input;
wherein:
the mobile phone is configured to present, based on the second virtual world data, virtual content to a user of the user device,
said presenting the virtual content to the user comprises presenting a visual rendering of the virtual content in a 3D format, and
presenting the visual rendering of the virtual content in the 3D format comprises presenting the visual rendering on a display in communication with the mobile phone based on a position and orientation of the first user device.
17. The non-transitory computer-readable medium of claim 16 , wherein the interface comprises a touch screen of the mobile phone and wherein the touch screen comprises the display.
18. The non-transitory computer-readable medium of claim 16 , wherein:
the wireless mobile network connection comprises a cellular network connection,
the mobile phone is configured to execute a software application that implements a gateway, and
the computer network is configured to communicate with the mobile phone via the gateway.
19. The non-transitory computer-readable medium of claim 16 , wherein:
the mobile phone comprises a camera,
the mobile phone is further configured to present, via the display, concurrently with said presenting the virtual content to the user, an image of a physical environment captured by the camera,
the virtual content comprises a plurality of virtual objects, and
said presenting the virtual content to the user further comprises overlaying the plurality of virtual objects on the image of the physical environment on the display.
20. The non-transitory computer-readable medium of claim 16 , wherein:
a frame removably coupled to the mobile phone comprises the environment-sensing system, and
the frame is head-wearable by the user.