Enhanced object reconstruction
View Patent ↗Processing images includes projecting an infra-red pattern onto a three-dimensional object and producing a first image, a second image, and a third image of the three-dimensional object while the pattern is projected on the three-dimensional object. The first image and the second image include the three-dimensional object and the pattern. The first image and the second image are produced by capturing at a first camera and a second camera, respectively, light filtered through an infra-red filter. The third image includes the three-dimensional object but not the pattern. Processing the images also includes establishing a first-pair correspondence between a portion of pixels in the first image and a portion of pixels in the second image. Processing the images further includes constructing, based on the first-pair correspondence and the third image, a two-dimensional image that depicts a three-dimensional construction of the three-dimensional object.
1. A computer program product, tangibly embodied in a machine-readable medium, the computer program product comprising instructions that, when read by a machine, operate to cause data processing apparatus to:
mark explicit and implicit ending parts on a stripe projected onto an object;
perform a disparity propagation routine in a horizontal direction, a vertical direction, and the horizontal direction, respectively, further comprising halting the disparity propagation routine in the horizontal or vertical direction based on encountering the explicit or implicit ending parts;
construct a continuous three dimensional surface based on the performed disparity propagation; and
perform a mismatch detection using the constructed three dimensional surface if a distance between matched pixels is greater than a predefined threshold.
2. The computer program product of claim 1 ,
wherein the explicit ending parts correspond to an end of the stripe or a break in the stripe, and
wherein the implicit ending parts include a pixel on the stripe adjacent to one of the explicit ending parts of a second stripe, resulting when the stripe and the second stripe join each other due to a depth discontinuity.
3. The computer program product of claim 1 , wherein the stripe is projected onto the object using infrared light.
4. The computer program product of claim 1 , further comprising instructions that, when read by a machine, operate to cause data processing apparatus to:
establish a correspondence between an edge stripe pixel in a first image and a corresponding edge stripe pixel in a second image,
wherein the disparity propagation routine is performed based on establishing the correspondence.
5. The computer program product of claim 1 , wherein:
the object is a user's body; and
an explicit ending part is marked between a jaw and a shoulder of the user's body.
6. The computer program product of claim 1 , wherein performing the disparity routine in the horizontal direction further comprises propagating a disparity along a raster line.
7. The computer program product of claim 1 , wherein performing the disparity routine in the horizontal direction further comprises propagating a disparity across the stripe in both left and right directions.
8. The computer program product of claim 1 , wherein the disparity routine is performed in the horizontal direction, the vertical direction, and the horizontal direction, respectively.
9. A computer-implemented method comprising:
marking explicit and implicit ending parts on a stripe projected onto an object;
performing a disparity propagation routine in a horizontal direction, a vertical direction, and the horizontal direction, respectively, further comprising halting the disparity propagation routine in the horizontal or vertical direction based on encountering the explicit or implicit ending parts;
constructing a continuous three dimensional surface based on the performed disparity propagation; and
performing a mismatch detection using the constructed three dimensional surface if a distance between matched pixels is greater than a predefined threshold.
10. A device comprising a processor configured to:
mark explicit and implicit ending parts on a stripe projected onto an object;
perform a disparity propagation routine in a horizontal direction, a vertical direction, and the horizontal direction, respectively, further comprising halting the disparity propagation routine in the horizontal or vertical direction based on encountering the explicit or implicit ending parts;
construct a continuous three dimensional surface based on the performed disparity propagation; and
perform a mismatch detection using the constructed three dimensional surface if a distance between matched pixels is greater than a predefined threshold.