Systems and methods for virtual and augmented reality
Disclosed herein are systems and methods for distributed computing and/or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.
1. A method comprising:
receiving, at a server remote to a wearable head device, an image captured via a camera of the wearable head device;
receiving, at the server, an estimated orientation of a handheld device in communication with the wearable head device, the estimated orientation determined by the wearable head device;
in response to receiving the image and the estimated orientation, training a neural network based on the image to produce a trained neural network; and
transmitting the trained neural network to the wearable head device.
2. The method of claim 1 , wherein receiving the image at the server comprises receiving the image via an intermediary relay.
3. The method of claim 2 , wherein the intermediary relay comprises a drone network.
4. The method of claim 2 , wherein:
the intermediary relay comprises a communications array, and
the communications array is mountable on a person.
5. The method of claim 2 , wherein the intermediary relay comprises a second wearable head device.
6. The method of claim 2 , wherein the intermediary relay comprises a cellular tower.
7. A system comprising:
a server that is remote to a wearable head device, the wearable head device comprising a camera; and
one or more processors configured to execute a method comprising:
receiving, at the server, an image captured via the camera of the wearable head device;
receiving, at the server, an estimated orientation of a handheld device in communication with the wearable head device, the estimated orientation determined by the wearable head device;
in response to receiving the image and the estimated orientation, training a neural network based on the image to produce a trained neural network; and
transmitting the trained neural network to the wearable head device.
8. The system of claim 7 , wherein receiving the image at the server comprises receiving the image via an intermediary relay.
9. The system of claim 8 , wherein the intermediary relay comprises a drone network.
10. The system of claim 8 , wherein:
the intermediary relay comprises a communications array, and
the communications array is mountable on a person.
11. The system of claim 8 , wherein the intermediary relay comprises a second wearable head device.
12. The system of claim 8 , wherein the intermediary relay comprises a cellular tower.
13. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to execute a method comprising:
receiving, at a server remote to a wearable head device, an image captured via a camera of the wearable head device;
receiving, at the server, an estimated orientation of a handheld device in communication with the wearable head device, the estimated orientation determined by the wearable head device;
in response to receiving the image and the estimated orientation, training a neural network based on the image to produce a trained neural network; and
transmitting the trained neural network to the wearable head device.
14. The non-transitory computer-readable medium of claim 13 , wherein receiving the image at the server comprises receiving the image via an intermediary relay.
15. The non-transitory computer-readable medium of claim 14 , wherein the intermediary relay comprises a drone network.
16. The non-transitory computer-readable medium of claim 14 , wherein:
the intermediary relay comprises a communications array, and
the communications array is mountable on a person.
17. The non-transitory computer-readable medium of claim 14 , wherein the intermediary relay comprises a second wearable head device.
18. The non-transitory computer-readable medium of claim 14 , wherein the intermediary relay comprises a cellular tower.