IP Library Granted Patent US 10,168,792
Granted Patent B2
US 10,168,792 · App. 15/782,505 · Granted Jan 1, 2019

Method and wearable device for providing a virtual input interface

Inventor: In-kuk Yun (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/017G02B27/0172G06F1/1626G06F3/011G06F3/0304G06F3/0426G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,168,792
App. No.
15/782,505
Granted
Jan 1, 2019
Kind
B2
Abstract

Provided is a wearable device including: an image sensor configured to sense a gesture image of a user setting a user input region; and a display configured to provide a virtual input interface corresponding to the set user input region.

Claims (53)

1. A glass type wearable device comprising:

an image sensor;

a display; and

a controller configured to:

control the image sensor to capture one or more images to sense a gesture of a user drawing a line on a physical object by using an input tool;

determine a user input region based on the line drawn by using the input tool;

identify a type of the physical object via an image process; and

control the display to provide a virtual input interface based on the user input region and the type of the physical object.

2. The glass type wearable device of claim 1 , wherein the gesture sensed from the one or more images corresponds to a figure formed by the line, and

the virtual input interface is displayed to correspond to the figure.

3. The glass type wearable device of claim 1 , wherein the virtual input interface is displayed to correspond to a size of the user input region.

4. The glass type wearable device of claim 1 , wherein the virtual input interface is determined based on a type of an application being executed by the glass type wearable device.

5. The glass type wearable device of claim 1 , wherein the display comprises a transparent display configured to provide the virtual input interface on a region of the transparent display corresponding to the user input region as observed through the transparent display.

6. The glass type wearable device of claim 1 , wherein the image sensor is configured to capture a first image of the user input region, and

the display is configured to display a second image of the virtual input interface over the user input region of the first image.

7. The glass type wearable device of claim 1 , wherein the controller is further configured to:

compare a distance from the glass type wearable device to the user input region with a threshold value, and

control the display, based on the distance being less than the threshold value, to provide a first type virtual input interface on the display in the determined user input region, and

control the display, based on the distance being greater than or equal to the threshold value, to provide a second type virtual input interface on the display in the determined user input region.

8. The glass type wearable device of claim 1 , wherein the controller is further configured to determine a type of the input tool, and control the display to provide the virtual input interface based on the user input region, the type of the physical object and the type of the input tool.

9. A glass type wearable device comprising:

an image sensor;

a display;

a controller configured to:

control the image sensor to capture one or more images to sense a gesture of a user drawing a line on a physical object by using an input tool;

determine a user input region based on the line drawn by using the input tool;

identify a type of the physical object via an image process; and

control the display to provide a virtual input interface corresponding to the user input region and the type of the physical object; and

a depth sensor configured to sense a first depth value corresponding to a distance from the glass type wearable device to the user input region, and a second depth value corresponding to a distance from the glass type wearable device to the input tool,

wherein the controller is further configured to determine whether an input is generated through the virtual input interface based on the first depth value and the second depth value.

10. The glass type wearable device of claim 9 , wherein a displayed size of the virtual input interface is determined based on the first depth value.

11. The glass type wearable device of claim 9 , wherein the controller is configured to determine that an input is generated through the virtual input interface when a difference between the first and second depth values is less than a threshold value.

12. The glass type wearable device of claim 9 , wherein the controller is configured to determine that an input is generated through the virtual input interface when the second depth value is greater than the first depth value.

13. A method of providing, by a glass type wearable device, a virtual input interface, the method comprising:

capturing one or more images to sense a gesture of a user drawing a line on a physical object by using an input tool;

determining a user input region based on the line drawn by using the input tool;

identifying a type of the physical object via an image process; and

providing the virtual input interface based on the user input region and the type of the physical object.

14. The method of claim 13 , wherein the determining of the user input region comprises:

identifying a figure formed by the line; and

determining a region corresponding to the figure as the user input region.

15. The method of claim 13 , wherein the virtual input interface is determined based on a size of the user input region.

16. The method of claim 13 , wherein the virtual input interface is determined based on a type of an application being executed by the glass type wearable device.

17. The method of claim 13 , wherein the providing of the virtual input interface comprises:

capturing a first image of the user input region by using an image sensor;

generating a second image of the virtual input interface; and

displaying the second image over the user input region of the first image.

18. The method of claim 13 , further comprising:

obtaining a first depth value corresponding to a distance from the glass type wearable device to the user input region, and a second depth value corresponding to a distance from the glass type wearable device to the input tool; and

determining whether an input is generated through the virtual input interface based on the first depth value and the second depth value.

19. The method of claim 18 , wherein a displayed size of the virtual input interface is determined based on a size of the first depth value.

20. The method of claim 18 , wherein the determining of whether the input is generated comprises determining that a difference between the first and second depth values is less than a threshold value.

21. The method of claim 18 , wherein the determining of whether the input is generated comprises determining that the second depth value is greater than the first depth value.

Priority Claims (3)
KR 10-2014-0033705 · Mar 21, 2014 · national
KR 10-2014-0098653 · Jul 31, 2014 · national
KR 10-2014-0179354 · Dec 12, 2014 · national
Continuity (2)
Continuation 14665678 · Mar 23, 2015
Related Publication 20180032146A1 · Feb 1, 2018