IP Library › Granted Patent US 12,307,084
Granted Patent B2
US 12,307,084 · App. 17/659,658 · Granted May 20, 2025

Single contact scaling gesture

Inventors: Assaf Bart (Patch-Tikva, IL); Igor Rayboy (Hod-Hasharon, IL)
Assignee: Apple Inc.
G06F3/04883G06F3/0412G06F3/04842G06F3/04845G06F3/0486G06F2203/04104G06F2203/04806G06F2203/04808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,307,084
App. No.
17/659,658
Granted
May 20, 2025
Kind
B2
Abstract

Methods and systems for providing input to a computing device based on a single contact scaling gesture are provided. A scaling gesture can be performed on a touch-sensitive panel to zoom in or out of a displayed image, for example. One example of a scaling gesture can include two touch contacts moving towards or away from each other. A single contact scaling gesture can include selecting a scaling command based on a first touch input being held for a predetermined duration of time, or based on other criteria. Once the scaling command has been selected, subsequent touch input can determine both a scaling factor and a scaling direction of the scaling command.

Claims (139)

1. A method comprising:

at an electronic device in communication with a display device and one or more input devices:

displaying, via the display device, a user interface object;

while displaying the user interface object, receiving, via the one or more input devices, a first input directed to the user interface object, wherein the first input is received at a first input location corresponding to a hand of a user of the electronic device;

while receiving the first input, and in accordance with a determination that the first input corresponds to a request to manipulate the user interface object in a first manner, concurrently displaying, via the display device:

the user interface object being manipulated in the first manner in accordance with the first input; and

a first visual indication, separate from the user interface object, corresponding to the first manner of manipulation, wherein:

the first visual indication provides visual feedback of progression of the manipulation of the user interface object in the first manner, and

the first visual indication is displayed at a first display location, different from the first input location, wherein the first display location is based on the first input location;

while displaying the first visual indication, detecting movement of the hand of the user in a first direction, including movement along a first axis and movement along a second axis, different from the first axis, wherein detecting the movement of the hand of the user includes receiving, via the one or more input devices, a second input at a second input location, different from the first input location, corresponding to the hand of the user of the electronic device; and

in response to detecting the movement of the hand of the user in the first direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the first direction along the first axis and the second axis; and

moving the first visual indication, along a plurality of axes, from the first display location to a second display location, different from the first display location, in a first respective direction based on the first direction along the first axis and the second axis.

2. The method of claim 1 , further comprising:

while displaying the first visual indication, detecting movement of the hand of the user in a second direction, different from the first direction, including movement along the first axis and movement along the second axis; and

in response to detecting the movement of the hand of the user in the second direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the second direction along the first axis and the second axis; and

moving the first visual indication, along the plurality of axes, from the first display location to the second display location, different from the first display location, in a second respective direction based on the second direction along the first axis and the second axis, wherein the second respective direction is different from the first respective direction.

3. The method of claim 1 , further comprising:

while receiving the first input, and in accordance with a determination that the first input corresponds to a request to manipulate the user interface object in a second manner, different from the first manner:

displaying, via the display device, the user interface object being manipulated in the second manner in accordance with the first input without displaying the first visual indication.

4. The method of claim 3 , wherein the request to manipulate the user interface object in the second manner corresponds to a request to translate at least a portion of the user interface object.

5. The method of claim 1 , wherein the request to manipulate the user interface object in the first manner corresponds to a request to scale the user interface object.

6. The method of claim 1 , wherein the first visual indication is circular.

7. The method of claim 1 , wherein the movement of the first visual indication, along the plurality of axes, from the first display location and to the second display location is along a linear path.

8. The method of claim 7 , wherein is the linear path is based on a first respective point corresponding to the first input location associated with the hand of the user, and a second respective point corresponding to a location different from the first input location.

9. The method of claim 8 , wherein:

in accordance with a determination that a location associated with the hand of the user is a first respective input location, the first respective point has a second respective location; and

in accordance with a determination that the location associated with the hand of the user is a second respective input location, different from the first respective input location, the first respective point has a fourth respective location, different from the second respective location.

10. The method of claim 7 , wherein a manipulation center of the manipulation of the user interface object is located between respective endpoints of the linear path.

11. The method of claim 10 , further comprising:

while displaying the first visual indication, displaying, via the display device, a second visual indication at the manipulation center.

12. The method of claim 1 , wherein the first visual indication is displayed at the first display location based on an input location of a finger of the hand of the user.

13. The method of claim 1 , wherein the first visual indication is not displayed before receiving the first input.

14. The method of claim 1 , further comprising:

while displaying the user interface object, receiving, via the one or more input devices, a third input directed to the user interface object, wherein the third input is received at a third input location corresponding to the hand of the user of the electronic device;

while receiving the third input, and in accordance with a determination that the third input corresponds to a request to manipulate the user interface object in the first manner, concurrently displaying, via the display device:

the user interface object being manipulated in the first manner in accordance with the third input; and

a second visual indication, separate from the user interface object, corresponding to the first manner of manipulation, wherein:

the second visual indication provides visual feedback of progression of the manipulation of the user interface object in the first manner, and

the second visual indication is displayed at a third display location, different from the third input location, wherein the third display location is based on the third input location;

while displaying the second visual indication at the third display location, detecting movement of the hand of the user in a respective direction, wherein detecting the movement of the hand of the user includes receiving, via the one or more input devices, a fourth input at a fourth input location, different from the third input location, corresponding to the hand of the user of the electronic device; and

in response to detecting the movement of the hand of the user in the respective direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the respective direction; and

moving the second visual indication from the third display location to a fourth display location, different from the third display location, including:

in accordance with a determination that the respective direction is the first direction, moving the second visual indication in the first respective direction based on the first direction; and

in accordance with a determination that the respective direction is a second direction, different from the first direction, moving the second visual indication in a second respective direction, different from the first respective direction, based on the second direction.

15. An electronic device in communication with a display device and one or more input devices, the electronic device comprising one or more processors and memory storing instructions, which, when executed by the one or more processors, cause the electronic device to perform a method, comprising:

displaying, via the display device, a user interface object;

while displaying the user interface object, receiving, via the one or more input devices, a first input directed to the user interface object, wherein the first input is received at a first input location corresponding to a hand of a user of the electronic device;

while receiving the first input, and in accordance with a determination that the first input corresponds to a request to manipulate the user interface object in a first manner, concurrently displaying, via the display device:

the user interface object being manipulated in the first manner in accordance with the first input; and

a first visual indication, separate from the user interface object, corresponding to the first manner of manipulation, wherein:

the first visual indication provides visual feedback of progression of the manipulation of the user interface object in the first manner, and

the first visual indication is displayed at a first display location, different from the first input location, wherein the first display location is based on the first input location;

while displaying the first visual indication, detecting movement of the hand of the user in a first direction, including movement along a first axis and movement along a second axis, different from the first axis, wherein detecting the movement of the hand of the user includes receiving, via the one or more input devices, a second input at a second input location, different from the first input location, corresponding to the hand of the user of the electronic device; and

in response to detecting the movement of the hand of the user in the first direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the first direction along the first axis and the second axis; and

moving the first visual indication, along a plurality of axes, from the first display location to a second display location, different from the first display location, in a first respective direction based on the first direction along the first axis and the second axis.

16. The electronic device of claim 15 , wherein the instructions, when executed by the one or more processors, cause the electronic device to perform the method, further comprising:

while displaying the first visual indication, detecting movement of the hand of the user in a second direction, different from the first direction, including movement along the first axis and movement along the second axis; and

in response to detecting the movement of the hand of the user in the second direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the second direction along the first axis and the second axis; and

moving the first visual indication, along the plurality of axes, from the first display location to the second display location, different from the first display location, in a second respective direction based on the second direction along the first axis and the second axis, wherein the second respective direction is different from the first respective direction.

17. The electronic device of claim 15 , wherein the instructions, when executed by the one or more processors, cause the electronic device to perform the method, further comprising:

while receiving the first input, and in accordance with a determination that the first input corresponds to a request to manipulate the user interface object in a second manner, different from the first manner:

displaying, via the display device, the user interface object being manipulated in the second manner in accordance with the first input without displaying the first visual indication.

18. The electronic device of claim 17 , wherein the request to manipulate the user interface object in the second manner corresponds to a request to translate at least a portion of the user interface object.

19. The electronic device of claim 15 , wherein the request to manipulate the user interface object in the first manner corresponds to a request to scale the user interface object.

20. The electronic device of claim 15 , wherein the first visual indication is circular.

21. The electronic device of claim 15 , wherein the movement of the first visual indication, along the plurality of axes, from the first display location and to the second display location is along a linear path.

22. The electronic device of claim 21 , wherein is the linear path is based on a first respective point corresponding to the first input location associated with the hand of the user, and a second respective point corresponding to a location different from the first input location.

23. The electronic device of claim 22 , wherein:

in accordance with a determination that a location associated with the hand of the user is a first respective input location, the first respective point has a second respective location; and

in accordance with a determination that the location associated with the hand of the user is a second respective input location, different from the first respective input location, the first respective point has a fourth respective location, different from the second respective location.

24. The electronic device of claim 21 , wherein a manipulation center of the manipulation of the user interface object is located between respective endpoints of the linear path.

25. The electronic device of claim 24 , wherein the instructions, when executed by the one or more processors, cause the electronic device to perform the method, further comprising:

while displaying the first visual indication, displaying, via the display device, a second visual indication at the manipulation center.

26. The electronic device of claim 15 , wherein the first visual indication is displayed at the first display location based on an input location of a finger of the hand of the user.

27. The electronic device of claim 15 , wherein the first visual indication is not displayed before receiving the first input.

28. The electronic device of claim 15 , wherein the instructions, when executed by the one or more processors, cause the electronic device to perform the method, further comprising:

while displaying the user interface object, receiving, via the one or more input devices, a third input directed to the user interface object, wherein the third input is received at a third input location corresponding to the hand of the user of the electronic device;

while receiving the third input, and in accordance with a determination that the third input corresponds to a request to manipulate the user interface object in the first manner, concurrently displaying, via the display device:

the user interface object being manipulated in the first manner in accordance with the third input; and

a second visual indication, separate from the user interface object, corresponding to the first manner of manipulation, wherein:

the second visual indication provides visual feedback of progression of the manipulation of the user interface object in the first manner, and

the second visual indication is displayed at a third display location, different from the third input location, wherein the third display location is based on the third input location;

while displaying the second visual indication at the third display location, detecting movement of the hand of the user in a respective direction, wherein detecting the movement of the hand of the user includes receiving, via the one or more input devices, a fourth input at a fourth input location, different from the third input location, corresponding to the hand of the user of the electronic device; and

in response to detecting the movement of the hand of the user in the respective direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the respective direction; and

moving the second visual indication from the third display location to a fourth display location, different from the third display location, including:

in accordance with a determination that the respective direction is the first direction, moving the second visual indication in the first respective direction based on the first direction; and

in accordance with a determination that the respective direction is a second direction, different from the first direction, moving the second visual indication in a second respective direction, different from the first respective direction, based on the second direction.

29. A non-transitory computer readable storage medium storing instructions, which, when executed by a processor of an electronic device in communication with a display device and one or more input devices, cause the electronic device to perform a method, comprising:

displaying, via the display device, a user interface object;

while displaying the user interface object, receiving, via the one or more input devices, a first input directed to the user interface object, wherein the first input is received at a first input location corresponding to a hand of a user of the electronic device;

while receiving the first input, and in accordance with a determination that the first input corresponds to a request to manipulate the user interface object in a first manner, concurrently displaying, via the display device:

the user interface object being manipulated in the first manner in accordance with the first input; and

a first visual indication, separate from the user interface object, corresponding to the first manner of manipulation, wherein:

the first visual indication provides visual feedback of progression of the manipulation of the user interface object in the first manner, and

the first visual indication is displayed at a first display location, different from the first input location, wherein the first display location is based on the first input location;

while displaying the first visual indication, detecting movement of the hand of the user in a first direction, including movement along a first axis and movement along a second axis, different from the first axis, wherein detecting the movement of the hand of the user includes receiving, via the one or more input devices, a second input at a second input location, different from the first input location, corresponding to the hand of the user of the electronic device; and

in response to detecting the movement of the hand of the user in the first direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the first direction along the first axis and the second axis; and

moving the first visual indication, along a plurality of axes, from the first display location to a second display location, different from the first display location, in a first respective direction based on the first direction along the first axis and the second axis.

30. The non-transitory computer readable storage medium of claim 29 , wherein the instructions, when executed by the processor of the electronic device, cause the electronic device to perform the method, further comprising:

while displaying the first visual indication, detecting movement of the hand of the user in a second direction, different from the first direction, including movement along the first axis and movement along the second axis; and

in response to detecting the movement of the hand of the user in the second direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the second direction along the first axis and the second axis; and

moving the first visual indication, along the plurality of axes, from the first display location to the second display location, different from the first display location, in a second respective direction based on the second direction along the first axis and the second axis, wherein the second respective direction is different from the first respective direction.

31. The non-transitory computer readable storage medium of claim 29 , wherein the instructions, when executed by the processor of the electronic device, cause the electronic device to perform the method, further comprising:

while receiving the first input, and in accordance with a determination that the first input corresponds to a request to manipulate the user interface object in a second manner, different from the first manner:

displaying, via the display device, the user interface object being manipulated in the second manner in accordance with the first input without displaying the first visual indication.

32. The non-transitory computer readable storage medium of claim 31 , wherein the request to manipulate the user interface object in the second manner corresponds to a request to translate at least a portion of the user interface object.

33. The non-transitory computer readable storage medium of claim 29 , wherein the request to manipulate the user interface object in the first manner corresponds to a request to scale the user interface object.

34. The non-transitory computer readable storage medium of claim 29 , wherein the first visual indication is circular.

35. The non-transitory computer readable storage medium of claim 29 , wherein the movement of the first visual indication, along the plurality of axes, from the first display location and to the second display location is along a linear path.

36. The non-transitory computer readable storage medium of claim 35 , wherein is the linear path is based on a first respective point corresponding to the first input location associated with the hand of the user, and a second respective point corresponding to a location different from the first input location.

37. The non-transitory computer readable storage medium of claim 36 , wherein:

in accordance with a determination that a location associated with the hand of the user is a first respective input location, the first respective point has a second respective location; and

in accordance with a determination that the location associated with the hand of the user is a second respective input location, different from the first respective input location, the first respective point has a fourth respective location, different from the second respective location.

38. The non-transitory computer readable storage medium of claim 35 , wherein a manipulation center of the manipulation of the user interface object is located between respective endpoints of the linear path.

39. The non-transitory computer readable storage medium of claim 38 , wherein the instructions, when executed by the processor of the electronic device, cause the electronic device to perform the method, further comprising:

while displaying the first visual indication, displaying, via the display device, a second visual indication at the manipulation center.

40. The non-transitory computer readable storage medium of claim 29 , wherein the first visual indication is displayed at the first display location based on an input location of a finger of the hand of the user.

41. The non-transitory computer readable storage medium of claim 29 , wherein the first visual indication is not displayed before receiving the first input.

42. The non-transitory computer readable storage medium of claim 29 , wherein the instructions, when executed by the processor of the electronic device, cause the electronic device to perform the method, further comprising:

while displaying the user interface object, receiving, via the one or more input devices, a third input directed to the user interface object, wherein the third input is received at a third input location corresponding to the hand of the user of the electronic device;

while receiving the third input, and in accordance with a determination that the third input corresponds to a request to manipulate the user interface object in the first manner, concurrently displaying, via the display device:

the user interface object being manipulated in the first manner in accordance with the third input; and

a second visual indication, separate from the user interface object, corresponding to the first manner of manipulation, wherein:

the second visual indication provides visual feedback of progression of the manipulation of the user interface object in the first manner, and

the second visual indication is displayed at a third display location, different from the third input location, wherein the third display location is based on the third input location;

while displaying the second visual indication at the third display location, detecting movement of the hand of the user in a respective direction, wherein detecting the movement of the hand of the user includes receiving, via the one or more input devices, a fourth input at a fourth input location, different from the third input location, corresponding to the hand of the user of the electronic device; and

in response to detecting the movement of the hand of the user in the respective direction:

manipulating the user interface object in the first manner based on the movement of the hand of the user in the respective direction; and

moving the second visual indication from the third display location to a fourth display location, different from the third display location, including:

in accordance with a determination that the respective direction is the first direction, moving the second visual indication in the first respective direction based on the first direction; and

in accordance with a determination that the respective direction is a second direction, different from the first direction, moving the second visual indication in a second respective direction, different from the first respective direction, based on the second direction.

Continuity (3)
Continuation 16292094 · Mar 4, 2019
Continuation 13595943 · Aug 27, 2012
Related Publication 20220244844A1 · Aug 4, 2022
References Cited (74)
US 5483261A · Yasutake · 1996 [cited by applicant]
US 5488204A · Mead et al. · 1996 [cited by applicant]
US 5825352A · Bisset et al. · 1998 [cited by applicant]
US 5835079A · Shieh · 1998 [cited by applicant]
US 5880411A · Gillespie et al. · 1999 [cited by applicant]
US 6188391B1 · Seely et al. · 2001 [cited by applicant]
US 6310610B1 · Beaton et al. · 2001 [cited by applicant]
US 6323846B1 · Westerman et al. · 2001 [cited by applicant]
US 6570557B1 · Westerman et al. · 2003 [cited by applicant]
US 6677932B1 · Westerman · 2004 [cited by applicant]
US 6690387B2 · Zimmerman et al. · 2004 [cited by applicant]
US 7015894B2 · Morohoshi · 2006 [cited by applicant]
US 7184064B2 · Zimmerman et al. · 2007 [cited by applicant]
US 7614008B2 · Ording · 2009 [cited by applicant]
US 7633076B2 · Huppi et al. · 2009 [cited by applicant]
US 7653883B2 · Hotelling et al. · 2010 [cited by applicant]
US 7657849B2 · Chaudhri et al. · 2010 [cited by applicant]
US 7663607B2 · Hotelling et al. · 2010 [cited by applicant]
US 7844914B2 · Andre et al. · 2010 [cited by applicant]
US 7957762B2 · Herz et al. · 2011 [cited by applicant]
US 8006002B2 · Kalayjian et al. · 2011 [cited by applicant]
US 8239784B2 · Hotelling et al. · 2012 [cited by applicant]
US 8279180B2 · Hotelling et al. · 2012 [cited by applicant]
US 8381135B2 · Hotelling et al. · 2013 [cited by applicant]
US 8479122B2 · Hotelling et al. · 2013 [cited by applicant]
US 9348458B2 · Hotelling et al. · 2016 [cited by applicant]
US 9933937B2 · Lemay et al. · 2018 [cited by applicant]
US 10222975B2 · Bart et al. · 2019 [cited by applicant]
US 20020015024A1 · Westerman et al. · 2002 [cited by applicant]
US 20020056575A1 · Keely et al. · 2002 [cited by applicant]
US 20050190059A1 · Wehrenberg · 2005 [cited by applicant]
US 20060017692A1 · Wehrenberg et al. · 2006 [cited by applicant]
US 20060026521A1 · Hotelling et al. · 2006 [cited by applicant]
US 20060033724A1 · Chaudhri et al. · 2006 [cited by applicant]
US 20060197753A1 · Hotelling · 2006 [cited by applicant]
US 20060227116A1 · Zotov et al. · 2006 [cited by applicant]
US 20070177804A1 · Elias et al. · 2007 [cited by applicant]
US 20080129759A1 · Jeon · 2008 [cited by examiner]
US 20100053111A1 · Karlsson · 2010 [cited by applicant]
US 20100060588A1 · Fong · 2010 [cited by applicant]
US 20100103117A1 · Townsend et al. · 2010 [cited by applicant]
US 20100149114A1 · Li · 2010 [cited by examiner]
US 20110035700A1 · Meaney · 2011 [cited by examiner]
US 20110304584A1 · Hwang · 2011 [cited by examiner]
US 20120113008A1 · Makinen et al. · 2012 [cited by applicant]
US 20120127107A1 · Miyashita et al. · 2012 [cited by applicant]
US 20120162103A1 · Kobayashi et al. · 2012 [cited by applicant]
US 20120169776A1 · Rissa · 2012 [cited by examiner]
US 20140055374A1 · Bart et al. · 2014 [cited by applicant]
US 20190354280A1 · Bart et al. · 2019 [cited by applicant]
EP 2309370A2 · 2011 [cited by applicant]
EP 2482179A2 · 2012 [cited by applicant]
JP 2000163031A · 2000 [cited by applicant]
JP 2002342033A · 2002 [cited by applicant]
WO 2013169849A2 · 2013 [cited by applicant]
WO 2014035765A2 · 2014 [cited by applicant]
WO 2014105276A1 · 2014 [cited by applicant]
Final Office Action received for U.S. Appl. No. 13/595,943 mailed on May 18, 2015, 16 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 13/595,943 mailed on Oct. 5, 2017, 17 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/292,094, mailed on Aug. 11, 2020, 16 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/292,094, mailed on Jul. 23, 2021, 22 pages. [cited by applicant]
International Search Report received for PCT Patent Application No. PCT/US2013/056006 mailed on Apr. 9, 2014, 4 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 13/595,943 mailed on Aug. 5, 2014, 18 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 13/595,943 mailed on Jan. 9, 2017, 23 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 13/595,943 mailed on Mar. 11, 2016, 22 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/292,094 mailed on Dec. 30, 2020, 21 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/292,094, mailed on Feb. 27, 2020, 13 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 13/595,943, mailed on Oct. 15, 2018, 6 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/292,094, mailed on Dec. 15, 2021, 12 pages. [cited by applicant]
Lee et al., “A Multi-Touch Three Dimensional Touch-Sensitive Tablet”, CHI'85 Proceedings, Apr. 1985, pp. 21-25. [cited by applicant]
Rubine, Dean, “Combining Gestures and Direct Manipulation”, CHI'92, May 3-7, 1992, pp. 659-660. [cited by applicant]
Rubine, Dean H., “The Automatic Recognition of Gestures”, CMU-CS-91-202, Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science at Carnegie Mellon University, Dec… [cited by applicant]
Westerman, Wayne, “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface”, A Dissertation Submitted to the Faculty of the University of Delaware in Partial Fulfillment of the Requiremen… [cited by applicant]
Youtube, “Sony Ericsson “One Finger” Zoom Tutorial for Android”, Available at http://www.youtube.com/watch?v=Erj67oRHeeE, Aug. 22, 2012, 2 pages. [cited by applicant]