Resource-responsive motion capture
The technology disclosed relates to operating a motion-capture system responsive to available computational resources. In particular, it relates to assessing a level of image acquisition and image-analysis resources available using benchmarking of system components. In response, one or more image acquisition parameters and/or image-analysis parameters are adjusted. Acquisition and/or analysis of image data are then made compliant with the adjusted image acquisition parameters and/or image-analysis parameters. In some implementations, image acquisition parameters include frame resolution and frame capture rate and image-analysis parameters include analysis algorithm and analysis density.
1. A method of operating a motion-capture system responsive to available system resources, the method including:
receiving, by a camera, one or more adjusted parameters of a set of adjusted parameters for use by the camera, wherein adjusted parameters of the set of adjusted parameters are adjusted in response to an assessed level of resources available for performing at least one of acquiring an image and analyzing an image, the assessed level of resources available being assessed by evaluating processing capabilities of components of the motion-capture system;
capturing, by the camera, a sequence of digital image frames to acquire image data for an object of interest, and
providing, by the camera, the sequence of digital image frames to a further process for analyzing the image data to detect the object of interest;
wherein the capturing is performed in compliance with the one or more adjusted parameters.
2. The method of claim 1 , wherein:
analyzing the image data to detect the object of interest is performed compliant with at least one adjusted parameter of the one or more adjusted parameters, wherein the at least one adjusted parameter is an analysis algorithm or an analysis density.
3. The method of claim 1 , wherein components of the motion-capture system include on-board components of a computer or external components in wired or wireless communication with the computer.
4. The method of claim 1 , wherein the assessed level of resources available includes an assessment by evaluating a USB bus capacity of a channel that couples a component to a system board of the motion-capture system.
5. The method of claim 1 , wherein the processing capabilities of components include at least a processor speed and a number of processor cores.
6. The method of claim 1 , wherein the processing capabilities of components include at least one of a memory throughput and a bus speed.
7. The method of claim 1 , wherein the processing capabilities of components include at least one of a graphics pipeline architecture, graphics memory availability, and an amount of cache memory.
8. The method of claim 1 , further including identifying, via a performance database, adjusted values of parameters for evaluated values of capacity parameters.
9. The method of claim 1 , further including repeatedly performing during a motion capture operation of the motion-capture system, obtaining further adjustments to one or more parameters based upon further assessment of resources available.
10. The method of claim 1 , wherein the adjusted parameters further include at least one of a frame size, a frame capture rate and a frame resolution, and wherein the adjusted parameters include parameters adjusted by reducing the frame size by resampling to a lower resolution.
11. The method of claim 1 , wherein the analyzing of the image data further includes determining a characteristic of the object of interest.
12. The method of claim 11 , wherein determining a characteristic of the object of interest includes identifying a position or a shape of the object of interest based on the analyzing of the image data.
13. The method of claim 11 , wherein determining a characteristic of the object of interest includes identifying an orientation or trajectory.
14. The method of claim 1 , wherein the adjusted parameters includes parameters adjusted by at least analyzing a reduced amount of image data per digital image frame.
15. A non-transitory computer-readable storage medium storing instructions for operating a motion-capture system responsive to available system resources, which instructions when executed by one or more processors, implement actions comprising:
send, to a camera, one or more adjusted parameters of a set of adjusted parameters for use by the camera, wherein adjusted parameters of the set of adjusted parameters are adjusted in response to an assessed level of resources available for performing at least one of acquiring an image and analyzing an image, the assessed level of resources available being assessed by evaluating processing capabilities of components of the motion-capture system;
acquire, from the camera, a sequence of digital image frames captured by a camera of the motion-capture system, image data for an object of interest, and
analyze the image data to detect the object of interest;
wherein the acquiring is performed in compliance with one or more adjusted parameters.
16. A system for operating a motion-capture system responsive to available resources, the system including:
one or more cameras; and
one or more processors coupled with the one or more cameras and a memory storing instructions that when executed by the one or more processors perform a method of:
sending, to a camera, one or more adjusted parameters of a set of adjusted parameters for use by the camera, wherein adjusted parameters of the set of adjusted parameters are adjusted in response to an assessed level of resources available for performing at least one of acquiring an image and analyzing an image by evaluating processing capabilities of components in the motion-capture system;
acquiring, from the camera, a sequence of digital image frames captured by at least one camera, image data for an object of interest, and
analyzing the image data to detect the object of interest;
wherein the acquiring is performed in compliance with one or more adjusted parameters adjusted in response to the assessed level of resources as assessed.
17. The system of claim 16 , further including repeatedly performing during a motion capture operation of the motion-capture system, obtaining further adjustments to one or more parameters based upon further assessment of resources available.
18. The system of claim 16 , wherein the analyzing of the image data further includes determining a characteristic of the object of interest.
19. The system of claim 16 , wherein determining a characteristic of the object of interest includes identifying a position or a shape of the object of interest based on the analyzing of the image data.
20. The system of claim 16 , wherein determining a characteristic of the object of interest includes identifying an orientation or trajectory.