Systems and methods for tracking a controller

1. A method by a wearable device, comprising:

receiving geometric information in a transmission from a controller, the geometric information including a point cloud of the controller associated with a particular portion of a scene;

determining three-dimensional (3D) points in the point cloud of the controller that correspond to 3D points in a point cloud of the wearable device;

determining, based on the 3D points in the point cloud of the controller that correspond to the 3D points in the point cloud of the wearable device, a transformation from a coordinate system of the controller to a coordinate system of the wearable device;

converting, using the transformation, a 6DoF pose of the controller to the coordinate system of the wearable device; and

rendering content in an application based on the converted 6DoF pose.

2. The method of claim 1 , further comprising determining the 6DoF pose of the controller.

3. The method of claim 1 , further comprising:

receiving, from the controller, at least one of image data or inertial measurement unit (IMU) data; and

determining, based on at least of the image data or the IMU data, the 6DoF pose of the controller.

4. The method of claim 3 , wherein determining the 6DoF pose of the controller comprises:

determining a three-dimensional orientation of the controller within the point cloud of the controller based on at least one of timestamped IMU data or timestamped image data received from the controller.

5. The method of claim 1 , further comprising:

receiving, from the controller, a second 6DoF pose of the controller determined by a 6DoF tracking algorithm implemented on the controller; and

rendering content in the application based on the second 6DoF pose.

6. The method of claim 1 , further comprising:

receiving, from the controller, updated geometric information and updated IMU data from which a 6DoF tracking algorithm implemented on the wearable device determines a second 6DoF pose of the controller; and

rendering content in the application based on the second 6DoF pose.

7. The method of claim 1 , further comprising:

receiving a periodic point cloud update from the controller; and

synchronizing the coordinate system of the wearable device with the coordinate system of the controller based on the point cloud update.

8. The method of claim 1 , further comprising implementing a 6DoF tracking algorithm on the wearable device to determine a 6DoF pose of the wearable device.

9. The method of claim 8 , wherein rendering content in the application is further based on the 6DoF pose of the wearable device.

10. The method of claim 1 , further comprising determining the point cloud of the wearable device based on image data received from the wearable device.

11. A wearable device, comprising:

a memory; and

a processor in communication with the memory, the processor configured to:

receive geometric information in a transmission from a controller, the geometric information including a point cloud of the controller associated with a particular portion of a scene;

determine three-dimensional (3D) points in the point cloud of the controller that correspond to 3D points in a point cloud of the wearable device;

determine, based on the 3D points in the point cloud of the controller that correspond to the 3D points in the point cloud of the wearable device, a transformation from a coordinate system of the controller to a coordinate system of the wearable device;

convert, using the transformation, a 6DoF pose of the controller to the coordinate system of the wearable device; and

render content in an application based on the converted 6DoF pose.

12. The wearable device of claim 11 , wherein the processor is configured to determine the 6DoF pose of the controller.

13. The wearable device of claim 11 , wherein the processor is configured to:

receive, from the controller, at least one of image data or inertial measurement unit (IMU) data; and

determine, based on at least of the image data or the IMU data, the 6DoF pose of the controller.

14. The wearable device of claim 13 , wherein, to determine the 6DoF pose of the controller, the processor is configured to:

determine a three-dimensional orientation of the controller within the point cloud of the controller based on at least one of timestamped IMU data or timestamped image data received from the controller.

15. The wearable device of claim 11 , wherein the processor is configured to:

receive, from the controller, a second 6DoF pose of the controller determined by a 6DoF tracking algorithm implemented on the controller; and

render content in the application based on the second 6DoF pose.

16. The wearable device of claim 11 , wherein the processor is configured to:

receive, from the controller, updated geometric information and updated IMU data from which a 6DoF tracking algorithm implemented on the wearable device determines a second 6DoF pose of the controller; and

render content in the application based on the second 6DoF pose.

17. The wearable device of claim 11 , wherein the processor is configured to:

receive a periodic point cloud update from the controller; and

synchronize the coordinate system of the wearable device with the coordinate system of the controller based on the point cloud update.

18. The wearable device of claim 11 , wherein the processor is configured to implement a 6DoF tracking algorithm on the wearable device to determine a 6DoF pose of the wearable device.

19. The wearable device of claim 18 , wherein the processor is configured to render content in the application further based on the 6DoF pose of the wearable device.

20. The wearable device of claim 11 , wherein the processor is configured to determine the point cloud of the wearable device based on image data received from the wearable device.