Method and apparatus for a wearable computer
An imaging apparatus includes a display device and a camera configured to generate image data reproducible as a series of images of a scene. Each of the series of images has a maximum field of view. A processor is configured to receive the image data, display at least a portion of the series of images, analyze the image data to determine if an object is recognized in each of the series of images, and generate a history of the series of images. The history is indicative of whether each of the series of images includes the object. Based at least in part on the history, the processor is configured to cause the display of the at least a portion of the series of images to be modified to: zoom in on the object, pan within the maximum field of view, zoom out on the scene, or any combination thereof.
1 . A head-mounted device comprising:
a frame configured to be worn on a head of a user;
a first lens coupled to the frame and a second lens coupled to the frame, the first lens being configured to be positioned adjacent to a first eye of the user and the second lens being configured to be positioned adjacent to a second eye of the user responsive to the frame being worn by the user;
a first camera coupled to the frame and having a first field of view, the first camera being configured to generate first image data that is reproducible as a first video feed of the first field of view;
a second camera coupled to the frame and having a second field of view, the second camera being configured to generate second image data that is reproducible as a second video feed of the second field of view, the first camera and the second camera being coupled to the frame such that the second field of view at least partially overlaps with the first field of view;
a memory device coupled to the frame and having stored thereon machine-readable instructions; and
a control system having one or more processors, the control system being coupled to the frame and being coupled to the memory device such that the one or more processors are configured to execute the machine-readable instructions to:
receive the first image data from the first camera;
receive the second image data from the second camera;
analyze the first image data and the second image data to determine if a hand of the user is visible within the first field of view, the second field of view, or both;
in response to determining that the hand of the user is visible, determine if a hand gesture is occurring;
determine that the hand gesture includes pointing at an object; and
in response to determining that the hand gesture includes pointing at the object, take an action in relation to the object.
2 . The head-mounted device of claim 1 , wherein the control system is further configured to initiate recording of at least a subset of the first field of view and the second field of view based on the hand gesture.
3 . The head-mounted device of claim 1 , further comprising a sensor coupled to the frame.
4 . The head-mounted device of claim 3 , wherein the sensor is a proximity sensor coupled to the frame, and wherein the control system is further configured to monitor the proximity sensor to turn the head-mounted device on and off based at least in part on the proximity of the frame to the head of the user.
5 . The head-mounted device of claim 3 , wherein the sensor is positioned in a region of the head-mounted device associated with the nose of the user when the head-mounted device is worn by the user.
6 . The head-mounted device of claim 5 , wherein the sensor is a heartbeat measurement sensor configured to measure a heartbeat of the user.
7 . The head-mounted device of claim 5 , wherein the sensor is a temperature sensor configured to measure a body temperature of the user.
8 . The head-mounted device of claim 1 , further comprising:
a speaker coupled to the frame; and
a microphone coupled to the frame.
9 . The head-mounted device of claim 8 , wherein the control system is further configured to:
provide information regarding the object, wherein the object is a word, and the one or more processors are configured to:
recognize the word via optical character recognition; and
read the word out loud via the speaker for the user to hear.
10 . The head-mounted device of claim 8 , wherein the control system is further configured to monitor the microphone to take a further action based at least in part on receipt of a voice command from the user.
11 . The head-mounted device of claim 10 , wherein, based at least in part on the voice command, the control system is further configured to: (i) initiate recording of at least a subset of the first field of view and the second field of view, (ii) record a photograph of at least a subset of the first field of view and the second field of view, and (iii) turn the head-mounted device off.
12 . The head-mounted device of claim 1 , further comprising:
an eye-tracking camera supported on or in the frame, the eye-tracking camera configured to generate eye tracking image data that is reproducible as an image of an eye of the user, the control system being further configured to:
before recognizing the hand gesture of the user, receive the eye tracking image data from the eye-tracking camera;
determine a gaze point in the first field of view, the second field of view, or both, based on the eye tracking image data; and
recognize the hand of the user at the gaze point.
13 . The head-mounted device of claim 8 , further comprising an accelerometer and a rotation sensor.
14 . The head-mounted device of claim 13 , wherein the control system is further configured to initiate transmission of at least a subset of the first field of view and the second field of view based on the hand gesture, and wherein the at least a subset of the first field of view and the second field of view is based at least in part on a directional and rotational orientation of the head-mounted device as determined at least in part by the accelerometer and the rotation sensor.
15 . The head-mounted device of claim 14 , further comprising a display device configured to receive and display the transmission.
16 . The head-mounted device of claim 15 , wherein the display device is part of a second device that is separate from the head-mounted device such that a remote user can view the transmission on the display device.
17 . The head-mounted device of claim 16 , wherein the control system is further configured to generate audio data associated with audio received by the microphone and to transmit at least a portion of the audio data to the second device so the remote user can hear the audio received by the microphone of the head-mounted device.
18 . The head-mounted device of claim 1 , wherein the second camera is coupled to the frame a fixed distance from the first camera.
19 . The head-mounted device of claim 1 , wherein the one or more processors are configured to further execute the machine-readable instructions to:
generate an output video feed of a scene from at least a portion of the first image data and/or at least a portion of the second image data.
20 . The head-mounted device of claim 19 , wherein the one or more processors are configured to further execute the machine-readable instructions to:
modify at least a portion of the output video feed by modifying at least a portion of the first image data or at least a portion of the second image data.
21 . The head-mounted device of claim 20 , wherein the at least a portion of the output video feed is modified by the control system by replacing the at least a portion of the output video feed with a replacement video feed that is reproducible from replacement image data that is generated by the control system.
22 . The head-mounted device of claim 21 , wherein the at least a portion of the output video feed is selected to be modified by the control system via a command of the user.
23 . The head-mounted device of claim 22 , wherein the command of the user includes tracing a gaze point trajectory around the at least a portion of the output video feed with at least one of the first eye of the user and the second eye of the user.
24 . The head-mounted device of claim 22 , wherein the at least a portion of the output video feed is a rectangular region, and the command of the user includes staring at opposite diagonal corners of the rectangular region with at least one of the first eye of the user and the second eye of the user.
25 . The head-mounted device of claim 19 , further comprising a graphical user interface coupled to the control system and coupled to the frame.
26 . The head-mounted device of claim 1 , further comprising a status light coupled to the frame and configured to provide a status indication.
27 . The head-mounted device of claim 26 , wherein the status light is positioned on a surface of the head-mounted device that generally faces away from the user when the head-mounted device is worn by the user, the status light being configured to indicate when the head-mounted device is on.
28 . The head-mounted device of claim 26 , wherein the status light is visible to at least one of the first eye of the user and the second eye of the user.
29 . The head-mounted device of claim 28 , wherein the status light flashes to indicate a low power level for a battery that provides power to the head-mounted device.
30 . The head-mounted device of claim 26 , wherein the status light appears green to indicate that a command from the user was received and understood by the control system, and wherein the status light appears red to indicate that the command from the user was not understood by the control system.