Gesture based control using three-dimensional information extracted over an extended depth of field

1. A system comprising:

a first wavefront coded camera that comprises a first aspheric optical element and that is constructed to generate a first wavefront coded image of a scene that includes a body; and

a second wavefront coded camera that comprises a second aspheric optical element and that is constructed to generate a second wavefront coded image of the scene;

and

a processor coupled to the first wavefront coded camera and the second wavefront coded camera, the processor being constructed to automatically detect a gesture of the body by using the first wavefront coded image and the second wavefront coded image, wherein the gesture comprises an instantaneous state of the body, wherein the detecting comprises aggregating gesture data of the gesture at an instant in time by detecting image data of at least one tag coupled to a part of the body from focus-resolved data generated from the first wavefront coded image and the second wavefront code image, the gesture data comprising focus-resolved data of the body within a depth of field of an imaging system that includes the first wavefront coded camera and the second wavefront coded camera, the processor constructed to translate the gesture to a gesture signal and use the gesture signal to control a component coupled to the processor.

2. A method comprising:

imaging a body with an imaging system, the imaging comprising a first wavefront coded camera that comprises a first aspheric optical element generating a first wavefront coded image of a scene that includes a body, and a second wavefront coded camera that comprises a second aspheric optical element generating a second wavefront coded image of the scene;

automatically detecting a gesture of a body by using the first wavefront coded image and the second wavefront coded image, wherein the gesture comprises an instantaneous state of the body, wherein the detecting comprises aggregating gesture data of the gesture at an instant in time by detecting image data of at least one tag coupled to a part of the body from focus-resolved data generated from the first wavefront coded image and the second wavefront code image, the gesture data comprising focus-resolved data of the body within a depth of field of the imaging system;

translating the gesture to a gesture signal; and

controlling a component coupled to a computer in response to the gesture signal.

3. The system of claim 1 , wherein automatically detecting a gesture of the body comprises: detecting an absolute three-space location of the at least one tag.

4. The system of claim 1 , wherein detecting image data of at least one tag coupled to a part of the body comprises: detecting image data of a set of tags coupled to the part of the body.

5. The system of claim 4 , wherein automatically detecting a gesture of the body comprises: detecting an absolute three-space location of each tag of the set of tags.

6. The system of claim 5 , wherein each tag includes a unique pattern.

7. The method of claim 2 , wherein automatically detecting a gesture of the body comprises: detecting an absolute three-space location of the at least one tag.

8. The method of claim 2 , wherein detecting image data of at least one tag coupled to a part of the body comprises: detecting image data of a set of tags coupled to the part of the body.

9. The method of claim 8 , wherein automatically detecting a gesture of the body comprises: detecting an absolute three-space location of each tag of the set of tags.

10. The method of claim 9 , wherein each tag includes a unique pattern.

11. The system of claim 3 , wherein the absolute three-space location of the at least one tag is an absolute position in space.

12. The method of claim 7 , wherein the absolute three-space location of the at least one tag is an absolute position in space.