Granted Patent B1

US 10,282,057 · App. 14/811,749 · Granted May 7, 2019

Inventors: Thomas Binder (Lübeck, DE); Ronald Frank Wotzlaw (Mountain View, CA)

Assignee: Google LLC

G06F3/0482G06F3/012G06F3/013G06F3/017G06F3/04842G06F3/04845G06F3/167

Abstract

Claims (69)

1. A computer-implemented method, comprising:

obtaining image information by a sensor unit of a wearable device, the image information including a representation of a moveable object associated with a user;

providing for display, on a display unit of the wearable device, a list of image adjustment types associated with an application for editing an image by a processing unit of the wearable device;

selecting at least one image adjustment type of the list of image adjustment types based on a first position of the moveable object detected by the sensor unit;

providing for display, on the display unit, a prompt including a plurality of levels of adjustment for the selected at least one image adjustment type;

selecting a level of adjustment from the plurality of levels of adjustment based on a second position of the moveable object;

selecting a portion of the image for applying the selected at least one image adjustment type with the selected level of adjustment, based on a third position of the moveable object; and

providing an image with the selected portion modified by the selected at least one image adjustment type with the selected level of adjustment, for display on the display unit.

2. The computer-implemented method of claim 1 , further comprising:

modifying the selected portion of the image using the level of adjustment for the selected at least one image adjustment type.

3. The computer-implemented method of claim 1 , further comprising:

receiving, at a processor unit of the wearable device, the image information as part of first image data from the sensor unit, the first image data comprising one or more images of the moveable object;

identifying one or more first movements by the moveable object in the one or more images;

determining that the one or more first movements correspond to a first gesture associated with enabling a user interface of the application; and

providing for display, on the display unit, the user interface of the application based on the one or more first movements, wherein the list of image adjustment types and the prompt including the plurality of levels of adjustment, are displayed in the user interface.

4. The computer-implemented method of claim 1 , wherein:

the moveable object relates to a hand of the user,

the second position of the moveable object relates to a hand gesture by the user, and

each image adjustment type of the list of image adjustment types is selectable by a different hand gesture position.

5. The computer-implemented method of claim 4 , wherein identifying the one or more first movements by the moveable object includes determining a shape template for each of the one or more first movements, and

wherein determining that the one or more first movements correspond to a first gesture associated with enabling the user interface includes matching the shape templates of each of the one or more first movements with stored shapes of gestures.

6. The computer-implemented method of claim 1 , wherein:

the moveable object relates to a head of the user,

the second position of the moveable object relates to a head gesture by the user, and

each image adjustment type of the list of image adjustment types is selectable by a different head gesture position.

7. The computer-implemented method of claim 1 , wherein:

the moveable object relates to an eye of the user,

the second position of the moveable object relates to a gaze direction of the eye, and

each image adjustment type of the list of image adjustment types is selectable by a different gaze direction.

8. The computer-implemented method of claim 1 , wherein selecting the at least one image adjustment type of the list of image adjustment types based on a first position of the moveable object, further comprises:

determining the first position of the moveable object relative to the list of image adjustment types; and

determining a match between a position of the at least one image adjustment type and the first position of the moveable object,

wherein the at least one image adjustment type is selected based on the match determined.

9. An apparatus, comprising:

a display unit;

one or more sensor units;

one or more memory units; and

one or more processor units configured to execute executable instructions to perform operations to:

receive, at the one or more processor units, first sensor data from the one or more sensor units, the first sensor data comprising first image information having a representation of a moveable object associated with a user;

identify one or more first movements by the moveable object included in the first image information, wherein the one or more first movements include one or more of a head movement by the user, a hand movement by the user or an eye gaze direction by the user;

determine that the one or more first movements correspond to a first gesture associated with enabling a user interface;

provide for display, on the display unit, the user interface of an application for editing an image based on the one or more first movements;

provide for display, on the display unit via the user interface, a list of image adjustment types;

determine a position of the first gesture relative to the list of image adjustment types;

determine a match between a position of at least one image adjustment type of the list of adjustment types and the position of the first gesture;

select the at least one image adjustment type based on the match determined;

provide for display, on the display unit via the user interface, a prompt including a plurality of levels of adjustment for the at least one image adjustment type selected;

receive, at the one or more processor units, second sensor data from the one or more sensor units in response to the prompt provided for display, the second sensor data comprising second image information having the representation of the moveable object;

determine one or more second movements by the moveable object included in the second image information, wherein the one or more second movements include one or more second head movements, one or more second hand movements, or one or more second eye movements by the user;

determine that the one or more second movements correspond to a second gesture associated with a second user input;

select a level of adjustment for the at least one image adjustment type, based on the one or more second movements;

determine that one or more third movements by the moveable object included in third sensor data received at the one or more processor units, wherein the one or more third movements include one or more of third head movements, third hand movements, or third eye movements, by the user;

select a portion of the image for applying the selected at least one image adjustment type with the selected level of adjustment, based on one or more third movements; and

provide an image with the selected portion modified by the selected at least one image adjustment type with the selected level of adjustment for display on the display unit.

10. The apparatus of claim 9 , wherein the one or more processing units are configured to execute the executable instructions to perform further operations to modify the selected portion of the image based on the level of adjustment, wherein the level of adjustment includes an action to increase or decrease a strength of the at least one image adjustment type selected.

11. The apparatus of claim 9 , wherein:

the moveable object relates to a hand of the user,

the position of the first gesture relates to a hand gesture by the user, and

each image adjustment type of the list of image adjustment types is selectable by a different hand gesture position.

12. The apparatus of claim 9 , wherein:

the moveable object relates to a head of the user,

the position of the first gesture relates to a head gesture by the user, and

each image adjustment type of the list of image adjustment types is selectable by a different head gesture position.

13. The apparatus of claim 9 , wherein:

the moveable object relates to an eye of the user,

the position of the first gesture relates to a gaze direction of the eye, and

each image adjustment type of the list of image adjustment types is selectable by a different gaze direction.

14. The apparatus of claim 9 , wherein identifying the one or more first movements by the moveable object includes determining a shape template for each of the one or more first movements, and

wherein determining that the one or more first movements correspond to the first gesture associated with enabling the user interface includes matching the shape templates of each of the one or more first movements with stored shapes of gestures.

Assignments (2)

Continuity (1)

Cited By (9)

US 12,190,900 US 12,198,664 US 12,205,295 US 12,367,616 US 12,380,618 US 12,412,347 US 12,462,507 US 12,475,880 US 12,670,643