Eyeglasses wearable device, method of controlling the eyeglasses wearable device and data management server
According to one embodiment, an eyeglasses wearable device includes a sensing signal acquisition module configured to acquire sensing signals from potential sensors, a display configured to display display data, a display data output module configured to transmit first display data to the display, a characteristic determination module configured to determine at least timing of blinking of the user based on variations in the sensing signals when the first display data is displayed on the display, and an oversight determination module configured to determine whether the user has overlooked an important display position in the first display data by comparing the timing of blinking with an elapsed time position of the first display data.
1. An eyeglasses wearable device comprising:
an eyeglass frame including a right nose pad and a left nose pad;
a first detection electrode positioned on an upper portion of the right nose pad;
a second detection electrode positioned on a lower portion of the right nose pad;
a third detection electrode positioned on an upper portion of the left nose pad;
a fourth detection electrode positioned on a lower portion of the left nose pad;
a display configured to display first data; and
a hardware processor electrically coupled to the first detection electrode, the second detection electrode, the third detection electrode, and the fourth detection electrode, the hardware processor to execute a program configured to:
detect a blink of the user based on an ocular potential difference between outputs from the first detection electrode and the second detection electrode or an ocular potential difference between outputs from the third detection electrode and the fourth detection electrode;
detect a first blink pattern, a second blink pattern, or a third blink pattern based on a number of blinks detected within a specific period of time, and
wherein the hardware processor is further configured to
detect the first blink pattern if the number of blinks detected within the specific period of time is less than a first prescribed number,
detect the second blink pattern if the number of blinks detected within the specific period of time is less than the first prescribed number and if a number of times that the first blink pattern is detected within a prescribed time period is more than a second prescribed number,
detect the third blink pattern if the number of blinks detected within the specific period of time is greater than or equal to the first prescribed number,
determine a timing when the hardware processor detects the second blink pattern or the third blink pattern,
compare the timing when the hardware processor detects the second blink pattern or the third blink pattern with a period of time when the display displays the first data, and
detect that the user overlooks the first data if the timing when the hardware processor detects the second blink pattern or the third blink pattern is within the period of time when the display displays the first data.
2. The eyeglasses wearable device of claim 1 , wherein
when the hardware processor detects the second blink pattern or the third blink pattern, the display is configured to stop displaying the first data and start displaying second data.
3. The eyeglasses wearable device of claim 1 , wherein
the first data comprises a manual image or a manual text to be shown to the user.
4. The eyeglasses wearable device of claim 2 , wherein
the second data comprises a repetitive data of the first data or a new instruction data.
5. The eyeglasses wearable device of claim 1 , wherein
the first data comprises an image or text for providing the user with virtual work training.
6. The eyeglasses wearable device of claim 2 , wherein
the second data comprises an image or text for displaying a warning or an authorization.
7. The eyeglasses wearable device of claim 2 , wherein
when the hardware processor detects the second blink pattern or the third blink pattern, the hardware processor changes content of the second data in accordance with a detected blink pattern.
8. The eyeglasses wearable device of claim 1 , wherein
when the hardware processor detects the second blink pattern or the third blink pattern, the display is configured to stop displaying the first data and start displaying a third data by displaying second data in addition to the first data.
9. The eyeglasses wearable device of claim 1 , wherein the hardware processor is further configured to:
detect a sight-line of the user based on the output outputs from the first detection electrode and the second detection electrode and the outputs from the third detection electrode and the fourth detection electrode; and
determine whether the user overlooks the first data based on a position read by the user based on the detected sight-line.
10. The eyeglasses wearable device of claim 1 , further comprising
a transceiver configured to share the first data with another user via a network.
11. A method of using an eyeglasses wearable device including a first detection electrode positioned on an upper portion of the right nose pad, a second detection electrode positioned on a lower portion of the right nose pad, a third detection electrode positioned on an upper portion of the left nose pad, a fourth detection electrode positioned on a lower portion of the left nose pad, a display configured to display first data, and a hardware processor electrically coupled to the first detection electrode, the second detection electrode, the third detection electrode, and the fourth detection electrode, the method comprising:
detecting, by the hardware processor, a blink of the user based on an ocular potential difference between outputs from the first detection electrode and the second detection electrode or an ocular potential difference between outputs from the third detection electrode and the fourth detection electrode;
detecting, by the hardware processor, a first blink pattern, a second blink pattern, or a third blink pattern based on a number of blinks detected within a specific period of time, wherein the first blink pattern is detected if the number of blinks detected within the specific period of time is less than a first prescribed number, the second blink pattern is detected if the number of blinks detected within the specific period of time is less than the first prescribed number and if a number of times that the first blink pattern is detected within a prescribed time period is more than a second prescribed number, and the third blink pattern is detected if the number of blinks detected within the specific period of time is greater than or equal to the first prescribed number;
determining a timing when the second blink pattern or the third blink pattern is detected;
comparing the timing when the second blink pattern or the third blink pattern with a period of time when the display displays the first data; and
detecting that the user overlooks the first data if the timing when the second blink pattern or the third blink pattern is detected is within the period of time when the display displays the first data.
12. The method of claim 11 , wherein responsive to detecting the second blink pattern or the third blink pattern, the method further comprising:
stopping the displaying of the first data on the display and displaying a second data on the display, the second data being different from the first data.
13. The method of claim 12 , wherein the first data comprises a manual image or a manual text to be shown to the user.
14. The method of claim 12 , wherein the second data comprises a repetitive data of the first data or a new instruction data.
15. The method of claim 12 , wherein the first data comprises an image or text for providing the user with virtual work training.
16. The method of claim 15 , wherein the second data comprises an image or text for displaying a warning or an authorization.
17. The method of claim 12 , wherein in further response to detecting the second blink pattern or the third blink pattern, the method further comprising:
changing content of the second data in accordance with a detected blink pattern.
18. The method of claim 11 , wherein responsive to detecting the second blink pattern or the third blink pattern, the method further comprising:
displaying both the first data and a second data on the display, the second data being a warning that is different from the first data.
19. The method of claim 11 further comprising:
detecting a sight-line of the user based on-the outputs from the first detection electrode and the second detection electrode and the outputs from the third detection electrode and the fourth detection electrode; and
determining whether the user overlooks the first data based on a position read by the user based on the detected sight-line.
20. The method of claim 11 further comprising sharing the first data displayed on the display with another user via a network.