Quantitative quality assurance for mixed reality
The invention relates to quantitative quality assurance in a mixed reality environment. In some embodiments, the invention includes using mixed reality sensors embedded in a mixed reality device to detect body positional movements of a user and using an indirect measuring device to determine a target location for the current state of the target equipment and a current subtask of a predefined workflow. The invention further includes using a direct measuring device associated with the target location to detect a user interaction by the user at the target location, determining a confidence value based on the user movements, the current subtask, and the user interaction, and displaying confirmation of the user interaction on a mixed reality display of the user.
1. A method for performing quality assurance in a mixed reality environment, the method comprising:
using mixed reality sensors embedded in a mixed reality device to detect body positional movements of the user;
using an indirect measuring device to determine:
a target location for the current state of the target equipment; and
a current subtask of a predefined workflow;
using a direct measuring device associated with the target location to detect a user interaction by the user at the target location;
determining a confidence value based on the user movements, the current subtask, and the user interaction; and
displaying confirmation of the user interaction on a mixed reality display of the user.
2. The method of claim 1 , wherein the indirect measuring device is a headset camera and sensor set.
3. The method of claim 2 , further comprising:
during the current subtask of the predefined workflow, using the headset camera and sensor set to determine a visual dwell time of the user on the target location, wherein the confidence value is also determined based on the visual dwell time.
4. The method of claim 3 , further comprising displaying the confidence value on the mixed reality display of the user.
5. The method of claim 2 , further comprising:
during the current subtask of the predefined workflow, using the headset camera and sensor set to determine a focal point of the user, wherein the confidence value is also determined based on the focal point.
6. The method of claim 5 , wherein determining the confidence value further comprises determining how closely the focal point matches a historical focal point.
7. The method of claim 1 , wherein the direct measuring device is a connection detector, and wherein the user interaction is physically connecting a cable to the connection detector.
8. The method of claim 1 , wherein the direct measuring device is a wireless device, and wherein the user interaction is wirelessly initiating a connection to the wireless device.
9. A non-transitory computer-readable medium comprising executable instructions for causing a computer processor to:
use mixed reality sensors in a mixed reality device to detect body positional movements of a user;
use an indirect measuring device to determine:
a target location for the current state of the target equipment; and
a current subtask of a predefined workflow;
use a direct measuring device associated with the target location to detect a user interaction by the user at the target location;
determine a confidence value based on the user movements, the current subtask, and the user interaction; and
display confirmation of the user interaction on a mixed reality display of the user.
10. The non-transitory computer-readable medium of claim 9 , wherein the indirect measuring device is a headset camera and sensor set.
11. The non-transitory computer-readable medium of claim 10 , wherein the executable instructions further cause the computer processor to:
during the current subtask of the predefined workflow, use the headset camera and sensor set to determine a visual dwell time of the user on the target location, wherein the confidence value is also determined based on the visual dwell time.
12. The non-transitory computer-readable medium of claim 11 , wherein the executable instructions further cause the computer processor to display the confidence value on the mixed reality display of the user.
13. The non-transitory computer-readable medium of claim 10 , wherein the executable instructions further cause the computer processor to:
during the current subtask of the, predefined workflow, use the headset camera and sensor set to determine a focal point of the user, wherein the confidence value is also determined based on the focal point.
14. The non-transitory computer-readable medium of claim 13 , wherein determining the confidence value further comprises determining how closely the focal point matches a historical focal point.
15. The non-transitory computer-readable medium of claim 9 , wherein the direct measuring device is a connection detector, and wherein the user interaction is physically connecting a cable to the connection detector.
16. The non-transitory computer-readable medium of claim 9 , wherein the direct measuring device is a wireless device, and wherein the user interaction is wirelessly initiating a connection to the wireless device.