Dental and medical loupe system for lighting control, streaming, and augmented reality assisted procedures
In various examples, a dental and medical loupe system for lighting control, streaming, and augmented reality (AR) assisted procedures is provided. Facial recognition algorithms and/or inertial measurement unit (IMU) sensors may be used to determine when a light disposed on eye-glasses of a wearer should be activated. As a result, instead of requiring a medical practitioner to manually turn on and off the light source, facial recognition may be used to determine when the dentist is looking toward a face of a patient, and to turn on the light when a face is present and off when a face is not present. In addition, some examples leverage augmented reality (AR) functionality to overlay patient and procedure information on one or more lenses of eye-glasses worn by a practitioner to allow for an un-occluded view of the actual location where the procedure is being performed.
1. A method comprising:
generating, using a camera disposed on a head-mounted device, image data representative of one or more images in a field of view of the camera;
wirelessly transmitting the image data to a client device;
wirelessly receiving, from the client device and based at least in part on a determination that a person is depicted in the image data, a signal;
based at least in part on the signal:
activating a light source disposed on the head-mounted device;
zeroing out one or more inertial measurement unit (IMU) sensors disposed on the head-mounted device;
estimating an amount of movement of the head-mounted device relative to a zeroed position based at least in part on sensor data generated using the one or more IMU sensors; and
when the amount of movement is above a threshold, deactivating the light source.
2. The method of claim 1 , wherein the head-mounted device includes eye-glasses coupled to a battery.
3. The method of claim 2 , wherein the eye-glasses are coupled to the battery using ribbon wire.
4. The method of claim 1 , wherein the determination that the person is depicted in the image data is by at least one of the client device or a server, and the determination is based on analyzing the image data using a facial recognition algorithm.
5. The method of claim 1 , wherein the camera is electrically coupled to a housing discrete from the head-mounted device, the housing including a battery, a wireless communication interface, and at least one component associated with processing the image data.
6. The method of claim 1 , wherein the one or more IMU sensors include at least one of a gyroscope or an accelerometer.
7. The method of claim 1 , wherein, when a subsequent amount of movement indicates that the IMU sensors are within another threshold of the zeroed position, reactivating the light source.
8. The method of claim 7 , wherein:
the image data is generated and transmitted continuously;
the generating and transmitting of the image data is suspended based at least in part on the one or more IMU sensors being zeroed; and
when the amount of movement is above the threshold, the generating and transmitting of the image data is resumed.
9. The method of claim 8 , further comprising:
receiving a second signal from the client device and based at least in part on another determination that the person is depicted is subsequent image data generated after resuming the generating and the transmitting of the image data; and
reactivating the light source.
10. The method of claim 1 , wherein the head-mounted device is part of a loupe system, and the head-mounted device further includes at least one loupe disposed thereon.
11. The method of claim 1 , wherein the image data is stored on a server for retrieval by one or more remote client devices.
12. The method of claim 11 , wherein the stored image data is retrieved via an application on the one or more remote client devices, the application being for educational purposes in viewing medical procedures from a perspective of a user of the head-mounted device.
13. A method comprising:
receiving, from a client device, image data generated by a camera disposed on eye-glasses of a loupe system communicatively coupled to the client device, the image data generated by the camera during at least a portion of a medical procedure;
determining one or more remote client devices authorized for viewing the medical procedure, the one or more client devices authorized based at least in part on an authentication procedure within respective instantiations of an application executing on the one more remote client devices;
encoding the image data to generate encoded image data; and
streaming the encoded image data to the one or more remote client devices to cause display of the encoded image data on respective displays of the one or more remote client devices.
14. The method of claim 13 , wherein:
the eye-glasses include one or more loupes disposed thereon;
the one or more loupes having a magnification factor; and
a camera zoom is determined to correspond to the magnification factor.
15. The method of claim 13 , wherein the client device is wirelessly communicatively coupled to the loupe system locally, and the server and the one or more remote client devices are remotely located with respect to both the client device the loupe system.
16. The method of claim 13 , wherein the image data is further analyzed to determine whether a face of a person is present, and when the face of the person is detected, generating and transmitting a signal to the loupe system to cause a light disposed on the eye-glasses to activate a light source disposed thereon.
17. A loupe system comprising:
eye-glasses including:
one or more cameras disposed thereon to generate image data;
a light source disposed thereon; and
one or more inertial measurement unit (IMU) sensors;
a power device electrically coupled to the eye-glasses, the power device including:
a battery to power at least the one or more cameras and the light source; and
a wireless communication component to transmit the image data;
an application executing on a client device communicatively coupled to the power device, the application to:
determine, based at least in part on the image data, that a face of a person is represented by the image data; and
generate and transmit, via another wireless communication component of the client device, a signal to the power device, the signal causing the light source to be activated; and
wherein the one or more inertial measurement unit (IMU) sensors are zeroed to a zeroed position based at least in part on the signal being received by the power device.
18. The loupe system of claim 17 , wherein the one or more IMU sensors include at least one of a gyroscope or an accelerometer.
19. The loupe system of claim 17 , wherein:
sensor data generated by the one or more IMU sensors is tracked using one or more processors of the power device;
an amount of movement of the eye-glasses relative to the zeroed position is determined using the one or more processors and based at least in part on the sensor data; and
when the amount of movement is above a threshold, the light source is deactivated.
20. The loupe system of claim 17 , wherein the eye-glasses further include at least one loupe disposed thereon.