Distance estimation using multi-camera device
A method and apparatus for measuring a distance from a device to an object is described. One or more first images including the object are acquired by a first camera of the device and one or more first reference images are acquired by a second camera of the device, while the device is in a first position. One or more second images including the object and one or more second reference images are acquired by cameras of the device, while the device is in a second position, different from the first position. Based on the first and second reference images, information on the displacement of at least one camera of the device between the first and second position are determined. The distance from the device to the object is calculated based on the first and second images and the determined information on the displacement of the at least one camera.
1. A method of measuring a distance to an object, the method comprising:
acquiring, by a first camera of a device while the device is in a first position, one or more first images that include the object;
acquiring, by a second camera of the device while the device is in the first position, one or more first reference images;
after acquiring the one or more first images, displaying, to a user:
at least one of the one or more first reference images;
an indication of an extent of matching between the one or more first reference images and a current image acquired by the second camera, the indication comprising a numerical score that indicates the extent of matching; and
a stop instruction in response to the numerical score exceeding a predetermined threshold;
selecting, by a processor, a first image pair that comprises a first image and a first reference image, the first image being selected from the one or more first images acquired by the first camera of the device while the device is in the first position, and the first reference image being selected from the one or more first reference images acquired by the second camera of the device while the device is in the first position;
selecting, by the processor, a second image pair that comprises a second image and a second reference image, the second image including the object, the second image being acquired by the first camera of the device while the device is in a second position, and the second reference image being acquired by the second camera of the device while the device is in the second position; and
calculating, by the processor, a distance from the device to the object based on the first image pair and the second image pair.
2. The method of claim 1 , wherein the first image comprises a single image generated from a plurality of images acquired by the device while the device is in the first position.
3. The method of claim 2 , wherein the generating of the single image from the plurality of images comprises selecting one of the plurality of images.
4. The method of claim 2 , wherein the generating of the single image from the plurality of images comprises generating a combination of at least some of the plurality of images.
5. The method of claim 2 , wherein the generating of the single image from the plurality of images comprises analyzing quality of the plurality of images and discarding one or more images from the plurality of images that have a quality below a given threshold.
6. The method of claim 1 , wherein the distance from the device to the object is calculated based on a fixed measurement.
7. The method of claim 6 , wherein the fixed measurement comprises a size of a body organ, and wherein the body organ is included in the first reference image and the second reference image.
8. The method of claim 7 , wherein the body organ comprises a cornea.
9. The method of claim 6 , wherein the fixed measurement comprises a distance between the first camera and the second camera.
10. The method of claim 1 , wherein the first image and the first reference image are acquired concurrently within less than one second.
11. A device comprising:
a first camera;
a second camera; and
a processor configured to perform operations comprising:
acquiring, by the first camera of the device while the device is in a first position, one or more first images that include an object;
acquiring, by the second camera of the device while the device is in the first position, one or more first reference images;
after acquiring the one or more first images, displaying, to a user:
at least one of the one or more first reference images;
an indication of an extent of matching between the one or more first reference images and a current image acquired by the second camera, the indication comprising a numerical score that indicates the extent of matching; and
a stop instruction in response to the numerical score exceeding a predetermined threshold;
selecting a first image pair that comprises a first image and a first reference image, the first image being selected from the one or more first images acquired by the first camera of the device while the device is in the first position, and the first reference image being selected from the one or more first reference images acquired by the second camera of the device while the device is in the first position;
selecting a second image pair that comprises a second image and a second reference image, the second image including the object, the second image being acquired by the first camera while the device is in a second position, and the second reference image being acquired by the second camera while the device is in the second position; and
calculating a distance from the device to the object based on the first image pair and the second image pair.
12. The device of claim 11 , wherein the first image comprises a single image generated from a plurality of images acquired by the device while the device is in the first position.
13. The device of claim 12 , wherein the generating of the single image from the plurality of images comprises selecting one of the plurality of images.
14. The device of claim 12 , wherein the generating of the single image from the plurality of images comprises generating a combination of at least some of the plurality of images.
15. The device of claim 12 , wherein the generating of the single image from the plurality of images comprises analyzing quality of the plurality of images and discarding one or more images from the plurality of images that have a quality below a given threshold.
16. The device of claim 11 , wherein the distance is calculated based on a fixed measurement.
17. The device of claim 16 , wherein the fixed measurement comprises a size of a body organ, and wherein the body organ is included in the first reference image and the second reference image.
18. The device of claim 17 , wherein the body organ comprises a cornea.
19. The device of claim 16 , wherein the fixed measurement comprises a distance between the first camera and the second camera.
20. A computer program product for measuring a distance to an object, the computer program product comprising:
a computer readable non-transitory storage medium having computer readable program code embodied therewith, which when executed by a processor, causes a device to perform operations comprising:
acquiring, by a first camera of the device while the device is in a first position, one or more first images that include the object;
acquiring, by a second camera of the device while the device is in the first position, one or more first reference images;
after acquiring the one or more first images, displaying, to a user:
at least one of the one or more first reference images;
an indication of an extent of matching between the one or more first reference images and a current image acquired by the second camera, the indication comprising a numerical score that indicates the extent of matching; and
a stop instruction in response to the numerical score exceeding a predetermined threshold;
selecting a first image pair that comprises a first image and a first reference image, the first image being selected from the one or more first images acquired by the first camera of the device while the device is in the first position, and the first reference image being selected from the one or more first reference images acquired by the second camera of the device while the device is in the first position;
selecting a second image pair that comprises a second image and a second reference image, the second image including the object, the second image being acquired by the first camera of the device while the device is in a second position, and the second reference image being acquired by the second camera of the device while the device is in the second position; and
calculating a distance from the device to the object based on the first image pair and the second image pair.