IP Library › Granted Patent US 8,358,281
Granted Patent B2
US 8,358,281 · App. 12/638,736 · Granted Jan 22, 2013

Device, method, and graphical user interface for management and manipulation of user interface elements

Inventors: Ian Patrick McCullough (Wilkinsburg, PA); Peter Glen Berger (Irwin, PA)
Assignee: Apple Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,358,281
App. No.
12/638,736
Granted
Jan 22, 2013
Kind
B2
Abstract

Context-sensitive, automated use of a magnification loupe is disclosed to facilitate management and manipulation of user interface content and small user interface elements via gestures on a touch-sensitive surface. In one embodiment, a magnifying loupe is displayed based on the context associated with a finger-based gesture on a touch-sensitive surface. For example, a magnification loupe is displayed when one or more user interface elements corresponding to the location of the gesture on the touch-sensitive surface is smaller than a predefined size threshold, but the loupe is not displayed when the user interface elements corresponding to the location of the gesture on the touch-sensitive surface are larger than the predefined size threshold. In another embodiment, the magnification power of the loupe varies based on the size of the one or more user interface elements corresponding to the location of the gesture on the touch-sensitive surface.

Claims (95)

1. A method, comprising:

at a computing device with a display and a touch-sensitive surface:

displaying on the display a plurality of user interface elements;

detecting a point of contact by a user on the touch-sensitive surface, wherein:

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface:

determining whether the feature size of the one or more of the plurality of user interface elements exceeds a first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintaining the display at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, displaying on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface:

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

2. The method of claim 1 , further comprising:

while continuing to detect the point of contact by the user on the touch-sensitive surface:

detecting a movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, continuously changing a respective displayed location of the loupe in accordance with the movement of the point of contact on the touch-sensitive surface.

3. The method of claim 1 , further comprising:

detecting movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, updating the selection indicia to correspond to respective user interface elements in accordance with the movement of the point of contact when the point of contact on the touch-sensitive surface corresponds to respective locations of respective user interface elements displayed on the display.

4. The method of claim 1 , wherein the loupe uses a magnification factor that scales in accordance with the feature size of the one or more of the plurality of user interface elements.

5. The method of claim 1 , wherein the display and the touch-sensitive surface comprise a touch-screen display.

6. The method of claim 1 , wherein the plurality of user interface elements includes displayed features within an electronic document.

7. The method of claim 1 , wherein the magnified image is displayed at a location on the display corresponding to a location proximate to the point of contact by the user on the touch-sensitive surface.

8. The method of claim 1 , wherein the magnified image is displayed at a respective location on the display corresponding to a location offset from the point of contact by the user on the touch-sensitive surface.

9. A computing device, comprising:

a display;

a touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying on the display a plurality of user interface elements;

detecting a point of contact by a user on the touch-sensitive surface, wherein:

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface:

determining whether the feature size of the one or more of the plurality of user interface elements exceeds a first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintaining the display at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, displaying on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface:

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

10. The computing device of claim 9 , further comprising:

while continuing to detect the point of contact by the user on the touch-sensitive surface:

detecting a movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, continuously changing a respective displayed location of the loupe in accordance with the movement of the point of contact on the touch-sensitive surface.

11. The computing device of claim 9 , further comprising:

detecting movement of the point of contact by the user on the touch-sensitive surface; and

in response to detecting the movement, updating the selection indicia to correspond to respective user interface elements in accordance with the movement of the point of contact when the point of contact on the touch-sensitive surface corresponds to respective locations of respective user interface elements displayed on the display.

12. The computing device of claim 9 , wherein the loupe uses a magnification factor that scales in accordance with the feature size of the one or more of the plurality of user interface elements.

13. The computing device of claim 9 , wherein the display and the touch-sensitive surface comprise a touch-screen display.

14. The computing device of claim 9 , wherein the plurality of user interface elements includes displayed features within an electronic document.

15. The computing device of claim 9 , wherein the magnified image is displayed at a location on the display corresponding to a location proximate to the point of contact by the user on the touch-sensitive surface.

16. The computing device of claim 9 , wherein the magnified image is displayed at a respective location on the display corresponding to a location offset from the point of contact by the user on the touch-sensitive surface.

17. A graphical user interface on a computing device with a touch-sensitive surface and a display, the graphical user interface comprising:

a plurality of user interface elements;

wherein:

a point of contact by a user is detected on the touch-sensitive surface, wherein:

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface, and in response to detecting the point of contact:

the feature size of the one or more of the plurality of user interface elements is compared with a first predefined size threshold to determine whether the feature size of the one or more of the plurality of user interface elements exceeds the first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, the display is maintained at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, a loupe is displayed on the display, the loupe depicting a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface:

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

18. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device with a touch-sensitive surface and a display, cause the device to:

display on the display a plurality of user interface elements;

detect a point of contact by a user on the touch-sensitive surface, wherein:

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and,

the one or more of the plurality of user interface elements have a feature size;

while detecting the point of contact by the user on the touch-sensitive surface:

determine whether the feature size of the one or more of the plurality of user interface elements exceeds a first predefined size threshold;

when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintain the display at a constant magnification; and

when the feature size of the one or more of the plurality of user interface elements is less than the first predefined size threshold, display on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image corresponds to the area of the display corresponding to the location surrounding the point of contact on the touch-sensitive surface,

while continuing to detect the point of contact by the user on the touch-sensitive surface:

displaying within the loupe a selection indicia in conjunction with at least one of the plurality of user interface elements displayed within the loupe, the selection indicia corresponding to a selected user interface element displayed on the display at a location corresponding to the point of contact on the touch-sensitive surface;

detecting an action gesture on the touch-sensitive surface; and

performing an action associated with the action gesture on the selected user interface element.

19. A method, comprising:

at a computing device with a display and a touch-sensitive surface:

displaying on the display a plurality of user interface elements;

detecting a point of contact by a user on the touch-sensitive surface, wherein:

the point of contact on the touch-sensitive surface corresponds to a location on the display of one or more of the plurality of user interface elements, and

a smallest displayed feature size is associated with at least one of the plurality of user interface elements on the location of the display corresponding to the point of contact on the touch-sensitive surface;

while detecting the point of contact by the user on the touch-sensitive surface:

determining whether the smallest displayed feature size exceeds a first predefined size threshold;

when the smallest displayed feature size is less than the first predefined size threshold:

scaling a magnification factor in accordance with the feature size of the one or more of the plurality of user interface elements; and

displaying on the display a loupe that depicts a magnified image of at least one of the one or more of the plurality of user interface elements, wherein the magnified image is displayed in accordance with the scaled magnification factor.

20. The method of claim 19 , when the feature size of the one or more of the plurality of user interface elements is greater than the first predefined size threshold, maintaining the display at a constant magnification.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2010
From: MCCULLOUGH, IAN; BERGER, PETER
To: APPLE INC.
Reel/Frame 023898/0285 →
Continuity (1)
Related Publication 20110141031A1 · Jun 16, 2011