Systems and methods for augmented reality
Disclosed is a method of localizing a user operating a plurality of sensing components, preferably in an augmented or mixed reality environment, the method comprising transmitting pose data from a fixed control and processing module and receiving the pose data at a first sensing component, the pose data is then transformed into a first component relative pose in a coordinate frame based on the control and processing module. A display unit in communication with the first sensing component is updated with the transformed first component relative pose to render virtual content with improved environmental awareness.
1. A method of localizing a user operating a plurality of sensing components, the method comprising:
transmitting a first pose data by a control and processing module;
receiving the first pose data at a first component;
transforming the first pose data into a first component relative pose in a coordinate frame based on the control and processing module;
updating a display unit in communication with the first component with the first component relative pose,
receiving the first pose data at a second component;
transforming the first pose data into a second component relative pose in a coordinate frame based on the control and processing module;
sharing the second component relative pose with the first component; and
updating the first component relative pose based on the second component relative pose.
2. The method of claim 1 , wherein the first component comprises a head mounted wearable component.
3. The method of claim 2 , wherein the second component comprises a hand held component.
4. The method of claim 1 , wherein the first component comprises a hand held wearable component.
5. The method of claim 4 , wherein the second component comprises a head mounted component.
6. The method of claim 1 , wherein transmitting the first pose data comprises transmitting electromagnetic field signals.
7. The method of claim 6 , wherein the electromagnetic field signals are in the visible spectrum.
8. The method of claim 6 , wherein the electromagnetic field signals are in the infrared spectrum.
9. The method of claim 1 , wherein receiving the first pose data comprises visual capture of an infrared marker.
10. The method of claim 1 , wherein receiving the first pose data comprises visual capture of a fiducial marker.
11. A method of localizing a user operating a plurality of sensing components, the method comprising:
receiving environmental characteristics indicating positional information at a head mounted component;
determining a head mounted component pose in an environment coordinate frame of the head mounted component based on the received environmental characteristics;
receiving, at the head mounted component, relative positional aspects with respect to the head mounted component of at least one hand held component;
determining a relative hand held component pose of the at least one hand held component in a head mounted component coordinate frame;
receiving, at the least one hand held component, the relative positional aspects with respect to the head mounted component;
transforming the relative positional aspects into a relative hand held component pose in the head mounted component coordinate frame;
sharing the head mounted component pose in the environment coordinate frame with the at least one hand held component and sharing the relative hand held component pose in the head mounted component coordinate frame with the head mounted component;
updating the head mounted component pose in the environment coordinate frame based on the relative hand held component pose; and
updating the relative hand held component pose in the head mounted component coordinate frame based on the head mounted component pose in the environment coordinate frame.
12. The method of claim 11 , further comprising, transmitting the relative positional aspects to the head mounted component from a control and processing module in the environment coordinate frame prior to updating the relative hand held component pose.
13. The method of claim 11 , wherein updating the head mounted component pose in the environment coordinate frame is performed prior to updating the relative hand held component pose in the head mounted component coordinate frame.
14. The method of claim 11 , further comprising transforming the relative hand held component pose in the head mounted component coordinate frame into a hand held component pose in the environment coordinate frame.
15. The method of claim 11 , further comprising transmitting the relative positional aspects to the at least one hand held component from a control and processing module in the environment coordinate frame.
16. The method of claim 15 , further comprising determining a hand held component pose in the environment coordinate frame.
17. The method of claim 16 , further comprising updating the relative hand held component pose shared with the head mounted component with the hand held component pose in the environment coordinate frame.
18. The method of claim 11 , wherein receiving environmental characteristics comprises image based feature extraction and localization.