Systems and methods for generating dynamic obstacle collision warnings based on detecting poses of users
A system includes processing circuitry configured to receive sensor data regarding a user operating a head mounted display (HMD). The processing circuitry is configured to identify a plurality of reference points of a pose of the user based at least on the sensor data. The processing circuitry is configured to apply one or more models to the plurality of reference points to determine a type of the pose of the user. The processing circuitry is configured to select a mode of operation of the HMD responsive to the type of the pose.
1. A method, comprising:
receiving, by one or more processors, sensor data regarding a user operating a head mounted display (HMD);
applying, by the one or more processors, one or more models to the sensor data to determine a type of pose of the user; and
establishing, by the one or more processors responsive to the type of the pose, a threshold for a mode of operation of the HMD that triggers a warning regarding a potential collision with one or more obstacles.
2. The method of claim 1 , wherein the type of the pose of the user comprises a sitting pose, standing pose, or lying down pose.
3. The method of claim 2 , wherein controlling the triggering of the warning comprises assigning, by the one or more processors, a first sensitivity of triggering the warning responsive to the type of the pose being the sitting pose or the lying down pose or a second sensitivity of triggering the warning responsive to the type of the pose being the standing pose, the first sensitivity different than the second sensitivity.
4. The method of claim 1 , wherein selecting the mode of operating comprises modifying, by the one or more processors, the triggering of the warning responsive to detecting a transition between poses.
5. The method of claim 1 , wherein applying the one or more models to the sensor data comprises:
identifying, from the sensor data, a plurality of reference points of the user; and
applying the one or more models to the plurality of reference points.
6. The method of claim 5 , further comprising using the plurality of reference points to establish, by the one or more processors, a skeletal inference model.
7. The method of claim 1 , further comprising generating, by the one or more processors, display data for presenting the warning.
8. A system, comprising:
one or more processors configured to:
receive sensor data regarding a user operating a head mounted display (HMD);
apply one or more models to the sensor data to determine a type of the pose of the user; and
establish, responsive to the type of the pose, a threshold for a mode of operation of the HMD that triggers a warning regarding a potential collision with one or more obstacles.
9. The system of claim 8 , wherein the type of the pose of the user comprises a sitting pose, standing pose, or lying down pose.
10. The system of claim 9 , wherein the one or more processors are configured to control the triggering of the warning by assigning a first sensitivity of triggering the warning responsive to the type of the pose being the sitting pose or the lying down pose or a second sensitivity of triggering the warning responsive to the type of the pose being the standing pose, the first sensitivity different than the second sensitivity.
11. The system of claim 8 , wherein the one or more processors are configured to select the method of operation by modifying the triggering of the warning responsive to detecting a transition between poses.
12. The system of claim 8 , wherein the one or more processors are configured to apply the one or more models to the sensor data by:
identifying, from the sensor data, a plurality of reference points of the user; and
applying the one or more models to the plurality of reference points.
13. The system of claim 12 , wherein the one or more processors are configured to use the plurality of reference points to establish a skeletal inference model.
14. The system of claim 8 , wherein the one or more processors are configured to generate display data for presenting the warning.
15. A system, comprising:
one or more processors configured to:
receive sensor data regarding a user operating a head wearable device;
apply one or more models to the sensor data to determine a type of the pose of the user; and
modify, responsive to the type of the pose, a threshold for triggering a warning by the head wearable device regarding a potential collision with one or more obstacles.
16. The system of claim 15 , wherein the type of the pose of the user comprises a sitting pose, standing pose, or lying down pose.
17. The system of claim 15 , wherein the one or more processors are configured to modify the threshold warning responsive to detecting a transition between poses.
18. The system of claim 15 , wherein the one or more processors are configured to apply the one or more models to the sensor data by:
identifying, from the sensor data, a plurality of reference points of the user; and
applying the one or more models to the plurality of reference points.
19. The system of claim 18 , wherein the one or more processors are configured to use the plurality of reference points to establish a skeletal inference model.
20. The system of claim 18 , wherein the one or more processors are configured to generate display data for the head wearable device to present the warning.