Open view, multi-modal, calibrated digital loupe with depth sensing
A digital loupe system is provided which can include a number of features. In one embodiment, the digital loupe system can include a stereo camera pair and a distance sensor. The system can further include a processor configured to perform a transformation to image signals from the stereo camera pair based on a distance measurement from the distance sensor and from camera calibration information. In some examples, the system can use the depth information and the calibration information to correct for parallax between the cameras to provide a multi-channel image. Ergonomic head mounting systems are also provided. In some implementations, the head mounting systems can be configurable to support the weight of a digital loupe system, including placing one or two oculars in a line of sight with an eye of a user, while improving overall ergonomics, including peripheral vision, comfort, stability, and adjustability. Methods of use are also provided.
1. A method of obtaining a stereoscopic image of an object, the method comprising:
obtaining first and second images of an object with first and second cameras;
obtaining a measurement of distance to the object with a distance sensor; and
applying a transformation to the first and second images using the measurement of distance and using calibration information pertaining to one or more of a position, an orientation, a focal length and a pixel size of the first and second cameras, wherein the transformation causes the first and second images to appear as if the first and second cameras had virtual optical axes that converge at a distance corresponding to the measurement of distance.
2. The method of claim 1 , further comprising displaying the transformed first and second images on first and second displays, respectively.
3. The method of claim 1 wherein the applying step comprises adjusting a field of view of the first and second images using the measurement of distance.
4. The method of claim 1 further comprising using the measurement of distance to shift a viewpoint of the first and second images.
5. The method of claim 1 further comprising changing a magnification of the first and second images and adjusting a field of view of the distance sensor with the change of magnification.
6. The method of claim 1 further comprising changing the distance between the object and the first and second cameras and adjusting the transformation with the change in distance.
7. The method of claim 1 further comprising illuminating the object.
8. The method of claim 7 further wherein the illuminating step comprises determining an illumination parameter based upon the measurement of distance and illuminating the object based on the illumination parameter.
9. The method of claim 7 wherein the illuminating step comprises pulsing an illumination source in a manner synchronized with exposure intervals of the first and second cameras.
10. The method of claim 1 wherein the first and second cameras are mounted on a user's head.
11. The method of claim 1 wherein the distance sensor is mounted on a user's head.
12. A method of viewing an object, comprising:
engaging a head engagement member with a user's head, the head engagement member supporting two cameras above the user's head;
placing each of a first display and a second display in a line of sight with an eye of the user;
obtaining first and second images of the object with first and second cameras;
obtaining a measurement of distance to the object with a distance sensor supported by the head engagement member;
applying a transformation to the first and second images using the measurement of distance and using calibration information pertaining to one or more of a position, an orientation, a focal length and a pixel size of the first and second cameras, wherein the transformation causes the first and second images to appear on the first and second displays as if the first and second cameras had virtual optical axes that converge at a distance corresponding to the measurement of distance; and
displaying the transformed first and second images on first and second displays, respectively.
13. The method of claim 12 further comprising supporting the first and second displays with the head engagement member.
14. The method of claim 12 wherein the applying step comprises adjusting a field of view of the first and second images using the measurement of distance.
15. The method of claim 12 further comprising using the measurement of distance to shift a viewpoint of the first and second images.
16. The method of claim 12 further comprising changing a magnification of the first and second images and adjusting a field of view of the distance sensor with the change of magnification.
17. The method of claim 12 further comprising changing the distance between the object and the first and second cameras and adjusting the transformation with the change in distance.
18. The method of claim 12 further comprising illuminating the object with an illumination source supported by the head engagement member.
19. The method of claim 18 further wherein the illuminating step comprises determining an illumination parameter based upon the measurement of distance and illuminating the object based on the illumination parameter.
20. The method of claim 18 wherein the illuminating step comprises pulsing an illumination source in a manner synchronized with exposure intervals of the first and second cameras.
21. The method of claim 10 wherein the distance sensor is mounted on the user's head.