Content presentation in head worn computing
Aspects of the present invention relate to providing assistance to medical professionals during the performance of medical procedures through the use of technologies facilitated through a head-worn computer.
1. A method of aligning augmented reality (AR) content with first and second body portions, the AR content presented on a display of a wearable head device, the method comprising:
attaching a first light emitting marker to the first body portion and a second light emitting marker to the second body portion;
at a first time, capturing a first image of the first and second body portions, the first image including the first emitter marker and the second light emitting markers, anatomical information associated with the first and second body portions, and identification information associated with the first and second body portions;
at a second time after the first time, generating incoming lights using a third light emitting marker attached to the first body portion and a fourth light emitting marker attached to the second body portion;
detecting the incoming lights from the third and fourth light emitting markers;
receiving, from a sensor of the wearable head device, an eye image of an eye of a user of the wearable head device;
based on the eye image, determining a position of the eye relative to a field of view of the display;
based on the position of the eye, determining a line of sight;
based on the line of sight, determining a content position in the field of view of the display, wherein the line of sight intersects the content position;
displaying, on the display:
the first image at the content position in a field of view of the display, and
a second image including the incoming lights and information indicating positions of the third and fourth light emitting markers, wherein the first image is resized to match sizes of the first and second body portions in the first image to sizes of the first and second body portions in the second image;
reducing, with an input to a user interface of the wearable head device, a first distance between the first and third light emitters on the display and a second distance between the second and third light emitters on the display;
receiving the input to the user interface; and
in response to receiving the input to the user interface, aligning, based on the reduced first and second distances, the first image with the second image, wherein each light emitting marker comprises a battery and a light emitting element.
2. The method of claim 1 , wherein the first image comprises a pre-procedure diagnostic image comprising at least one of an X-Ray image and a CAT Scan image.
3. The method of claim 1 , wherein detecting the incoming lights comprises capturing, with a camera, an image of the body portion, and the camera is oriented in a direction normal to the display.
4. The method of claim 1 , wherein the incoming lights comprise infrared light.
5. The method of claim 1 , wherein the incoming lights comprise visible light.
6. The method of claim 5 , wherein the display comprises a notch filter adapted to attenuate the visible incoming light reaching the user.
7. The method of claim 1 , wherein the input to the user interface includes a voice input.
8. The method of claim 1 , wherein the input to the user interface includes a head movement.
9. The method of claim 1 , further comprising, after aligning the first image with the second image, fixing a location of the first image on the display.
10. The method of claim 1 , further comprising:
receiving a second input; and
in response to receiving the second input, displaying the first image without interruptions.
11. The method of claim 10 , wherein the second input comprises the eye image.
12. The method of claim 10 , wherein the second input comprises an inertial input.
13. The method of claim 10 , wherein the second input comprises a gesture input.
14. The method of claim 10 , wherein the second input comprises a voice input.
15. A system comprising:
a wearable head device comprising a display and a sensor;
one or more processors configured to execute a method comprising:
receiving a first image, captured at a first time, of a first body portion and a second body portion, the first image including a first emitter marker attached to the first body portion and a second light emitting markers attached to the second body portion, anatomical information associated with the first and second body portions, and identification information associated with the first and second body portions;
at a second time after the first time, detecting the incoming lights from third and fourth light emitting markers, wherein the incoming lights are generated using the third light emitting marker attached to the first body portion and the fourth light emitting marker attached to the second body portion;
receiving, from the sensor, an eye image of an eye of a user of the wearable head device;
based on the eye image, determining a position of the eye relative to a field of view of the display;
based on the position of the eye, determining a line of sight;
based on the line of sight, determining a content position in the field of view of the display, wherein the line of sight intersects the content position;
displaying, on the display:
the first image at the content position in a field of view of the display, and
a second image including the incoming lights and information indicating positions of the third and fourth light emitting markers, wherein the first image is resized to match sizes of the first and second body portions in the first image to sizes of the first and second body portions in the second image;
reducing, with an input to a user interface of the wearable head device, a first distance between the first and third light emitters on the display and a second distance between the second and third light emitters on the display;
receiving the input to the user interface; and
in response to receiving the input to the user interface, aligning, based on the reduced first and second distances, the first image with the second image, wherein each light emitting marker comprises a battery and a light emitting element.
16. The system of claim 15 , wherein the first image comprises a pre-procedure diagnostic image comprising at least one of an X-Ray image and a CAT Scan image.
17. The system of claim 15 , wherein the input to the user interface includes a voice input.
18. A non-transitory computer-readable medium storing instructions, which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving a first image, captured at a first time, of a first body portion and a second body portion, the first image including a first emitter marker attached to the first body portion and a second light emitting markers attached to the second body portion, anatomical information associated with the first and second body portions, and identification information associated with the first and second body portions;
at a second time after the first time, detecting the incoming lights from third and fourth light emitting markers, wherein the incoming lights are generated using the third light emitting marker attached to the first body portion and the fourth light emitting marker attached to the second body portion;
receiving, from a sensor of a wearable head device, an eye image of an eye of a user of the wearable head device;
based on the eye image, determining a position of the eye relative to a field of view of the display;
based on the position of the eye, determining a line of sight;
based on the line of sight, determining a content position in the field of view of the display, wherein the line of sight intersects the content position;
displaying, on a display of the wearable head device:
the first image at the content position in a field of view of the display, and
a second image including the incoming lights and information indicating positions of the third and fourth light emitting markers, wherein the first image is resized to match sizes of the first and second body portions in the first image to sizes of the first and second body portions in the second image;
reducing, with an input to a user interface of the wearable head device, a first distance between the first and third light emitters on the display and a second distance between the second and third light emitters on the display;
receiving the input to the user interface; and
in response to receiving the input to the user interface, aligning, based on the reduced first and second distances, the first image with the second image, wherein each light emitting marker comprises a battery and a light emitting element.
19. The non-transitory computer-readable medium of claim 18 , wherein the first image comprises a pre-procedure diagnostic image comprising at least one of an X-Ray image and a CAT Scan image.
20. The non-transitory computer-readable medium of claim 18 , wherein the input to the user interface includes a voice input.