IP Library › Patent Application 19370692
Patent Application
App. No. 19/370,692

GESTURE-BASED VIRTUAL INTERFACES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
19/370,692
Abstract

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device projects a virtual interface (VI) on a surface using a laser projector. Further, the device determines, based on sensor data from at least one of a camera or a depth sensor, a position of a first finger of the user relative to the surface. Further, the device, presents, using the VI, a first graphical element representing the position of the first finger of the user relative to the surface.

Claims (61)

1 . A method comprising:

presenting, by an electronic device, a user interface (UI) on a surface, the UI comprising a first user interface element and a second user interface element;

obtaining sensor data from at least one of a camera or a depth sensor of the electronic device;

determining, based on the sensor data, that the user has positioned a finger (i) within a first distance range from the surface and (ii) in proximity with the first user interface element;

responsive to determining that the user has positioned the finger (i) within the first distance range from the surface and (ii) in proximity with the first user interface element, modifying a visual characteristic of at least one of the first user interface element or the second user interface element.

2 . The method of claim 1 , wherein modifying a visual characteristic of at least one of the first user interface element or the second user interface element comprises:

changing a size of the first user interface element.

3 . The method of claim 1 , wherein modifying a visual characteristic of at least one of the first user interface element or the second user interface element comprises:

changing a size of the second user interface element.

4 . The method of claim 1 , wherein modifying a visual characteristic of at least one of the first user interface element or the second user interface element comprises:

moving the first user interface element relative to the second user interface element.

5 . The method of claim 1 , wherein modifying a visual characteristic of at least one of the first user interface element or the second user interface element comprises:

moving the second user interface element relative to the first user interface element.

6 . The method of claim 1 , further comprising:

subsequent to determining that the user has positioned the finger (i) within the first distance range from the surface and (ii) in proximity with the first user interface element, determining that the user has repositioned the finger within a second distance range from the surface, wherein the second distance range less than the first distance range; and

responsive to determining that the user has repositioned the finger within the second distance range from the surface, refraining from modifying the visual characteristic of the at least one of the first user interface element or the second user interface element based on the repositioning of the finger.

7 . The method of claim 6 , further comprising:

subsequent to determining that the user has repositioned the finger within the second distance range from the surface, determining that the user has touched the finger on the surface; and

responsive to determining that the user has touched the finger on the surface, performing one or more first operations associated with the first user interface element.

8 . The method of claim 1 , further comprising:

subsequent to determining that the user has positioned the finger (i) within the first distance range from the surface and (ii) in proximity with the first user interface element, determining that the user has moved the finger in a first direction; and

responsive to determining that the user has moved the finger in the first direction, moving the first user interface element in the first direction.

9 . The method of claim 1 , further comprising:

determining, based on the sensor data, that the user has moved the finger towards the surface; and

responsive to determining that the user has moved the finger towards the surface, performing a zoom in operation with respect to the VI.

10 . The method of claim 9 , further comprising:

determining, based on the sensor data, that the user has moved the finger in a first direction along the VI; and

responsive to determining that the user has moved the finger in the first direction along the VI, performing a scroll operation on the VI in the first direction.

11 . The method of claim 9 , further comprising:

determining, based on the sensor data, that the user has moved the finger away from the surface; and

responsive to determining that the user has moved the finger away from the surface, performing a zoom out operation with respect to the VI.

12 . The method of claim 1 , further comprising:

subsequent to determining that the user has positioned the finger (i) within the first distance range from the surface and (ii) in proximity with the first user interface element, determining that the user has moved the finger to a first position;

determining that the first position is within a boundary region enclosing the first user interface element; and

responsive to determining that the first position is within the boundary region, continuing to indicate that the finger is in proximity with the first user interface element.

13 . The method of claim 12 , further comprising:

determining that the user has moved the finger to a second position;

determining that the first position is beyond the boundary region and is in proximity with the second user interface element; and

responsive to determining that the first position is beyond the boundary region and in proximity with the second user interface element, indicating that the finger is in proximity with the second user interface element.

14 . The method of claim 13 , wherein the boundary region is larger than the first user interface element.

15 . The method of claim 13 , wherein a size of the boundary region varies depending on a distance between the finger and the surface.

16 . The method of claim 15 , wherein the size of the boundary region is inversely proportional to the distance between the finger and the surface.

17 . An electronic device, comprising:

a display device;

at least one of a camera or a depth sensor;

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

displaying, using the display device, a user interface (UI) on a surface, the UI comprising a first user interface element and a second user interface element;

obtaining sensor data from at least one of the camera or the depth sensor;

determining, based on the sensor data, that the user has positioned a finger (i) within a first distance range from the surface and (ii) in proximity with the first user interface element; and

responsive to determining that the user has positioned the finger (i) within the first distance range from the surface and (ii) in proximity with the first user interface element, modifying a visual characteristic of at least one of the first user interface element or the second user interface element.

18 . The electronic device of claim 17 , the operations further comprising:

subsequent to determining that the user has positioned the finger (i) within the first distance range from the surface and (ii) in proximity with the first user interface element, determining that the user has repositioned the finger within a second distance range from the surface, wherein the second distance range less than the first distance range; and

responsive to determining that the user has repositioned the finger within the second distance range from the surface, refraining from modifying the visual characteristic of the at least one of the first user interface element or the second user interface element based on the repositioning of the finger.

19 . The electronic device of claim 18 , the operations further comprising:

subsequent to determining that the user has positioned the finger within the second distance range from the surface, determining that the user has repositioned the finger outside the second distance range from the surface; and

responsive to determining that the user has repositioned the finger outside the second distance range from the surface, ceasing to refrain from modifying the visual characteristic of the at least one of the first user interface element or the second user interface element.

20 . The electronic device of claim 17 , wherein:

the display device is a laser projector;

the displaying is projecting using the laser projector; and

the UI is a virtual interface (VI).