Power consumption in motion-capture systems with audio and optical signals
View Patent ↗The technology disclosed provides systems and methods for reducing the overall power consumption of an optical motion-capture system without compromising the quality of motion capture and tracking. In implementations, this is accomplished by operating the motion-detecting cameras and associated image-processing hardware in a low-power mode (e.g., at a low frame rate or in a standby or sleep mode) unless and until touch gestures of an object such as a tap, sequence of taps, or swiping motions are performed with a surface proximate to the cameras. A contact microphone or other appropriate sensor is used for detecting audio signals or other vibrations generated by contact of the object with the surface.
1. A method of operating an optical motion-capture system with reduced power consumption, the method including:
monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone is in contact with a surface of an object upon which one or more cameras of the optical motion-capture system are placed;
detecting an audio signal generated by contact of a control object with the object surface; and
switching at least one camera of the optical motion-capture system, in response to the detected audio signal, from a standby mode to an operational mode; wherein the standby mode and the operational mode apply to recognition of in-air control object gestures by the optical motion-capture system.
2. The method of claim 1 , wherein the contact is a touch, tap, sequence of taps, or swiping motion of the object.
3. The method of claim 1 , wherein the microphone is a piezo or electromagnetic actuator.
4. The method of claim 1 , wherein the optical motion-capture system includes an ultra-low-power circuit responsive to low-voltage audio signals.
5. The method of claim 1 , further including switching the camera from the operational mode to the standby mode in response to further detection of an audio signal generated by subsequent contact of the control object with the surface.
6. The method of claim 1 , further including filtering the audio signals to exclude frequencies outside a defined range.
7. The method of claim 1 , wherein the contact microphone detects audio signals through the solid object, further including:
in response to detection of an audio signal generated by contact of the control object with another object in contact with the solid object, switching the camera of the optical motion-capture system from the standby mode to the operational mode.
8. The method of claim 1 , further including the contact microphone detecting audio signals through the solid object via an intermediate object.
9. The method of claim 1 , further including:
monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and
in response to detection of an audio signal propagated through the solid object by a control object, switching the optical motion-capture system from a standby mode to an operational mode.
10. The method of claim 1 , further including:
monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and
in response to detection of an audio signal propagated through the solid object by a control object, switching a light source of the optical motion-capture system from a standby mode to an operational mode.
11. The method of claim 1 , further including:
analyzing camera images for presence of hands in standby mode.
12. The method of claim 11 , further including:
analyzing camera images to determine gestures from tracked motions of hands in operational mode.
13. An optical motion-capture system, including:
a camera for capturing images of an object within a field of view thereof;
a contact microphone coupled to the camera and in contact with a surface of an object upon which one or more cameras of the optical motion-capture system are placed;
a sensor for monitoring the contact microphone; and
a control module for switching the camera from a standby mode to an operational mode in response to detection of an audio signal generated by contact of a control object with the object surface; wherein the standby mode and the operational mode apply to recognition of in-air control object gestures by the optical motion-capture system.
14. The system of claim 13 , wherein the contact is a touch, tap, sequence of taps, or swiping motions of the object.
15. The system of claim 13 , wherein the microphone is a piezo or electromagnetic actuator.
16. The system of claim 13 , wherein the optical motion-capture system includes an ultra-low-power circuit responsive to low-voltage audio signals.
17. The system of claim 13 , further configured to switch the camera from the operational mode to the standby mode in response to further detection of an audio signal generated by subsequent contact of the control object with the surface signifying departure of the control object from a field of view of the camera.
18. The system of claim 13 , further configured to filter the audio signals to exclude frequencies outside a defined range.
19. The system of claim 13 , further configured to include a contact microphone that detects audio signals through the solid object via an intermediate solid object.
20. The system of claim 13 , further configured to:
monitor a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and
in response to detection of an audio signal propagated through the solid object by a control object, switch the optical motion-capture system from a standby mode to an operational mode.
21. The system of claim 13 , further configured to:
monitor a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object; and
in response to detection of an audio signal propagated through the solid object by a control object, switch a light source of the optical motion-capture system from a standby mode to an operational mode.
22. The system of claim 13 , further configured to:
analyze camera images for presence of hands in standby mode.
23. The system of claim 22 , further configured to:
analyze camera images to determine gestures from tracked motions of hands in operational mode.
24. A non-transitory computer readable medium storing a plurality of instructions for programming one or more processors to operate an optical motion-capture system with reduced power consumption, the instructions, when executed on the processors, implementing actions including:
monitoring a contact microphone coupled to an optical motion-capture system, wherein the contact microphone detects audio signals propagated through a solid object surface upon which one or more cameras of the optical motion-capture system are placed; and
in response to detection of an audio signal propagated through the solid object by a control object, switching a camera of the optical motion-capture system from a standby mode to an operational mode; wherein the standby mode and the operational mode apply to recognition of in-air control object gestures by the optical motion-capture system.