Observation system and observation support method
An observation system includes: an observation device that includes an eyepiece lens and an objective and forms a real image of a sample on an optical path between the eyepiece lens and the objective; and an observation auxiliary device that is worn by a user and outputs auxiliary information to the user, the observation auxiliary device superimposing the auxiliary information on a virtual image of the sample to be observed by the user through the eyepiece lens on the basis of a relative position of the observation auxiliary device with respect to the observation device.
1. An observation system comprising:
an observation device that includes an eyepiece lens and an objective and that forms a real image of a sample on an optical path between the eyepiece lens and the objective; and
an observation auxiliary device that is configured to be worn by a user and to output auxiliary information to the user, the observation auxiliary device superimposing the auxiliary information on a virtual image of the sample observed by the user via the eyepiece lens based on a relative position between the observation auxiliary device and the observation device,
wherein each of the real image and the virtual image is an optical live view image.
2. The observation system according to claim 1 , wherein the observation auxiliary device changes an output position of the auxiliary information based on a distance and a direction from an optical axis of the eyepiece lens to the observation auxiliary device.
3. The observation system according to claim 2 , wherein:
one of the observation device and the observation auxiliary device includes a transmitter that transmits a signal for detecting the relative position, and
the other of the observation device and the observation auxiliary device includes a receiver that receives the signal for detecting the relative position.
4. The observation system according to claim 2 , wherein:
the observation auxiliary device includes:
a retina projection device that projects, on a retina of the user, an image for detecting the relative position; and
an imaging device that captures an image of the retina, and
the observation auxiliary device detects the relative position based on the image of the retina captured by the imaging device during a period in which the retina projection device projects the image for detecting the relative position on the retina.
5. The observation system according to claim 1 , wherein the observation auxiliary device stops output of the auxiliary information based on a distance from the observation device to the observation auxiliary device.
6. The observation system according to claim 1 , wherein:
one of the observation device and the observation auxiliary device includes a transmitter that transmits a signal for detecting the relative position, and
the other of the observation device and the observation auxiliary device includes a receiver that receives the signal for detecting the relative position.
7. The observation system according to claim 6 , wherein the signal includes at least one of an electromagnetic wave outside a visible range or an ultrasonic wave.
8. The observation system according to claim 6 , wherein the observation device and the observation auxiliary device detect the relative position by three-point positioning.
9. The observation system according to claim 1 , wherein:
the observation auxiliary device includes:
a retina projection device that projects, on a retina of the user, an image for detecting the relative position; and
an imaging device that captures an image of the retina, and
the observation auxiliary device detects the relative position based on the image of the retina captured by the imaging device during a period in which the retina projection device projects the image for detecting the relative position on the retina.
10. The observation system according to claim 9 , wherein the observation auxiliary device detects the relative position based on the image for detecting the relative position projected on the retina and an image of the sample projected on the retina, each of which is included in the image of the retina.
11. The observation system according to claim 9 , wherein the retina projection device projects the image for detecting the relative position on the retina with light outside a visible range.
12. The observation system according to claim 11 , wherein the light outside the visible range is infrared light.
13. The observation system according to claim 1 , wherein the observation auxiliary device includes at least one of smart glasses, a see-through type head mounted display, or a smart contact lens.
14. The observation system according to claim 1 , wherein the observation auxiliary device includes a device using at least one of a retinal projection method, a retinal scanning method, a hologram method, or a micro LED method.
15. The observation system according to claim 1 , wherein:
the observation auxiliary device further includes a sensor that detects an orientation of the observation auxiliary device, and
the observation auxiliary device outputs an image of the sample captured by the observation device as the auxiliary information when the relative position and the orientation detected by the sensor satisfy a predetermined condition.
16. The observation system according to claim 1 , wherein the observation auxiliary device outputs an image indicating a position of the observation device as the auxiliary information when the relative position satisfies a predetermined condition.
17. The observation system according to claim 1 , wherein the observation device has an eye relief of at least 40 mm.
18. The observation system according to claim 1 , wherein:
the relative position between the observation auxiliary device and the observation device is variable, and
the user is an observer.
19. The observation system according to claim 1 , wherein the observation device is a microscope device.
20. An observation support method comprising:
by an observation device including an eyepiece lens and an objective, forming a real image of a sample on an optical path between the eyepiece lens and the objective; and
by an observation auxiliary device worn by a user, outputting auxiliary information to the user and superimposing the auxiliary information on a virtual image of the sample observed by the user through the eyepiece lens based on a relative position between the observation auxiliary device and the observation device,
wherein each of the real image and the virtual image is an optical live view image.
21. An observation auxiliary device configured to be worn by an observer and to output auxiliary information to the observer, wherein the observation auxiliary device superimposes the auxiliary information on a virtual image based on a relative position between the observation auxiliary device and an observation device that forms a real image on an optical path between an eyepiece lens and an objective of the observation device, the virtual image being an optical live view image of a sample observed by the observer via the eyepiece lens, and the real image being an optical live view image of the sample.