IP Library Granted Patent US 11,720,171
Granted Patent B2
US 11,720,171 · App. 17/479,791 · Granted Aug 8, 2023

Methods for navigating user interfaces

Inventors: Israel Pastrana Vicente (San Jose, CA); Jay Moon (San Francisco, CA); Jesse Chand (San Francisco, CA); Jonathan R. Dascola (San Francisco, CA); Jeffrey M. Faulkner (San Francisco, CA); Pol Pla I Conesa (San Francisco, CA); Dorian D. Dargan (Danville, CA)
Assignee: Apple Inc.
G06F3/013G06F3/017G06F3/0481G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,720,171
App. No.
17/479,791
Filed
Sep 20, 2021
Granted
Aug 8, 2023
Kind
B2
Art Unit
2171
USPC
715/710
Abstract

In some embodiments, an electronic device navigates between user interfaces based at least on detecting a gaze of the user. In some embodiments, an electronic device enhances interactions with control elements of user interfaces. In some embodiments, an electronic device scrolls representations of categories and subcategories in a coordinated manner. In some embodiments, an electronic device navigates back from user interfaces having different levels of immersion in different ways.

Claims (94)

1. A method comprising:

at an electronic device in communication with a display generation component and one or more input devices including an eye tracking device:

displaying, via the display generation component, a first user interface that includes a respective user interface element associated with a second user interface;

while displaying the first user interface, detecting, via the eye tracking device, that a gaze of a user is directed to the respective user interface element; and

in response to detecting an input that includes the gaze of the user directed to the respective user interface element:

in accordance with a determination that the gaze of the user continues to be directed to the respective user interface element for longer than a time threshold, navigating to the second user interface; and

in accordance with a determination that a selection input is detected via the one or more input devices when the gaze of the user has been directed to the respective user interface element for shorter than the time threshold, navigating to the second user interface without waiting for the gaze to continue to be directed to the respective user interface element for longer than the time threshold.

2. The method of claim 1 , wherein the selection input comprises a respective gesture performed by a hand of the user detected by a hand tracking device in communication with the electronic device.

3. The method of claim 1 , wherein the respective user interface element is displayed at a first size, and navigating to the second user interface includes displaying the second user interface at a second size, larger than the first size.

4. The method of claim 1 , wherein before detecting the input that includes the gaze of the user directed to the respective user interface element, the respective user interface element is displayed over a background with a visual characteristic having a first value, and navigating to the second user interface includes displaying the second user interface over the background with the visual characteristic having a second value, different from the first value.

5. The method of claim 1 , wherein navigating to the second user interface includes displaying the second user interface with a lighting effect that affects one or more other representations displayed via the display generation component.

6. The method of claim 1 , further comprising:

while the gaze of the user is directed to the respective user interface element and before the gaze of the user is directed to the respective user interface element for longer than the time threshold and before navigating to the second user interface, detecting, via the eye tracking device, that the gaze of the user is no longer directed to the respective user interface element; and

in response to detecting that the gaze of the user is no longer directed to the respective user interface element, forgoing navigating to the second user interface.

7. The method of claim 1 , further comprising:

while the gaze of the user is directed to the respective user interface element and before the gaze of the user is directed to the respective user interface element for longer than the time threshold and before navigating to the second user interface, displaying, via the display generation component, a visual indication that continued gaze directed to the respective user interface element will cause navigation to the second user interface.

8. The method of claim 7 , wherein the visual indication includes an animation of the respective user interface element expanding into the second user interface.

9. The method of claim 7 , wherein displaying the visual indication includes initiating an animation of content in the second user interface.

10. The method of claim 7 , wherein the first user interface includes a background over which the respective user interface element is displayed, and the visual indication includes obscuring display of the background.

11. The method of claim 1 , wherein navigating to the second user interface includes changing a relative simulated depth between the first user interface and the second user interface.

12. The method of claim 1 , wherein:

before detecting the input directed to the respective user interface element, the first user interface is displayed with a visual characteristic having a first value,

after navigating to the second user interface, the second user interface is displayed over the first user interface displayed with the visual characteristic having a second value, different from the first value,

the first user interface includes a second respective user interface element associated with a third user interface, the method further comprising:

while displaying the second user interface over the first user interface displayed with the visual characteristic having the second value, receiving, via the one or more input devices, an input for navigating from the second user interface to the third user interface; and

in response to receiving the input for navigating from the second user interface to the third user interface, while maintaining display of the first user interface with the visual characteristic having the second value, ceasing display of the second user interface over the first user interface, and displaying the third user interface over the first user interface.

13. The method of claim 1 , further comprising:

in response to detecting that the gaze of the user is directed to the respective user interface element, initiating an animation corresponding to navigating to the second user interface; and

in response to detecting the input that includes the gaze of the user directed to the respective user interface element:

in accordance with the determination that the gaze of the user continues to be directed to the respective user interface element for longer than the time threshold, completing, over the time threshold, the animation corresponding to navigating to the second user interface and navigating to the second user interface; and

in accordance with the determination that the selection input is detected via the one or more input devices when the gaze of the user has been directed to the respective user interface element for shorter than the time threshold, navigating to the second user interface without completing, over the time threshold, the animation corresponding to navigating to the second user interface.

14. An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via a display generation component, a first user interface that includes a respective user interface element associated with a second user interface;

while displaying the first user interface, detecting, via an eye tracking device, that a gaze of a user is directed to the respective user interface element; and

in response to detecting an input that includes the gaze of the user directed to the respective user interface element:

in accordance with a determination that the gaze of the user continues to be directed to the respective user interface element for longer than a time threshold, navigating to the second user interface; and

in accordance with a determination that a selection input is detected via one or more input devices when the gaze of the user has been directed to the respective user interface element for shorter than the time threshold, navigating to the second user interface without waiting for the gaze to continue to be directed to the respective user interface element for longer than the time threshold.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:

display, via a display generation component, a first user interface that includes a respective user interface element associated with a second user interface;

while displaying the first user interface, detect, via an eye tracking device, that a gaze of a user is directed to the respective user interface element; and

in response to detecting an input that includes the gaze of the user directed to the respective user interface element:

in accordance with a determination that the gaze of the user continues to be directed to the respective user interface element for longer than a time threshold, navigate to the second user interface; and

in accordance with a determination that a selection input is detected via one or more input devices when the gaze of the user has been directed to the respective user interface element for shorter than the time threshold, navigate to the second user interface without waiting for the gaze to continue to be directed to the respective user interface element for longer than the time threshold.

16. The electronic device of claim 14 , wherein the selection input comprises a respective gesture performed by a hand of the user detected by a hand tracking device in communication with the electronic device.

17. The electronic device of claim 14 , wherein the respective user interface element is displayed at a first size, and navigating to the second user interface includes displaying the second user interface at a second size, larger than the first size.

18. The electronic device of claim 14 , wherein before detecting the input that includes the gaze of the user directed to the respective user interface element, the respective user interface element is displayed over a background with a visual characteristic having a first value, and navigating to the second user interface includes displaying the second user interface over the background with the visual characteristic having a second value, different from the first value.

19. The electronic device of claim 14 , wherein navigating to the second user interface includes displaying the second user interface with a lighting effect that affects one or more other representations displayed via the display generation component.

20. The electronic device of claim 14 , wherein the one or more programs further include instructions for:

while the gaze of the user is directed to the respective user interface element and before the gaze of the user is directed to the respective user interface element for longer than the time threshold and before navigating to the second user interface, detecting, via the eye tracking device, that the gaze of the user is no longer directed to the respective user interface element; and

in response to detecting that the gaze of the user is no longer directed to the respective user interface element, forgoing navigating to the second user interface.

21. The electronic device of claim 14 , wherein the one or more programs further includes instructions for:

while the gaze of the user is directed to the respective user interface element and before the gaze of the user is directed to the respective user interface element for longer than the time threshold and before navigating to the second user interface, displaying, via the display generation component, a visual indication that continued gaze directed to the respective user interface element will cause navigation to the second user interface.

22. The electronic device of claim 21 , wherein the visual indication includes an animation of the respective user interface element expanding into the second user interface.

23. The electronic device of claim 21 , wherein displaying the visual indication includes initiating an animation of content in the second user interface.

24. The electronic device of claim 21 , wherein the first user interface includes a background over which the respective user interface element is displayed, and the visual indication includes obscuring display of the background.

25. The electronic device of claim 14 , wherein navigating to the second user interface includes changing a relative simulated depth between the first user interface and the second user interface.

26. The electronic device of claim 14 , wherein:

before detecting the input directed to the respective user interface element, the first user interface is displayed with a visual characteristic having a first value,

after navigating to the second user interface, the second user interface is displayed over the first user interface displayed with the visual characteristic having a second value, different from the first value,

the first user interface includes a second respective user interface element associated with a third user interface, the one or more programs further including instructions for:

while displaying the second user interface over the first user interface displayed with the visual characteristic having the second value, receiving, via the one or more input devices, an input for navigating from the second user interface to the third user interface; and

in response to receiving the input for navigating from the second user interface to the third user interface, while maintaining display of the first user interface with the visual characteristic having the second value, ceasing display of the second user interface over the first user interface, and displaying the third user interface over the first user interface.

27. The electronic device of claim 14 , wherein the one or more programs further include instructions for:

in response to detecting that the gaze of the user is directed to the respective user interface element, initiating an animation corresponding to navigating to the second user interface; and

in response to detecting the input that includes the gaze of the user directed to the respective user interface element:

in accordance with the determination that the gaze of the user continues to be directed to the respective user interface element for longer than the time threshold, completing, over the time threshold, the animation corresponding to navigating to the second user interface and navigating to the second user interface; and

in accordance with the determination that the selection input is detected via the one or more input devices when the gaze of the user has been directed to the respective user interface element for shorter than the time threshold, navigating to the second user interface without completing, over the time threshold, the animation corresponding to navigating to the second user interface.

28. The non-transitory computer readable storage medium of claim 15 , wherein the selection input comprises a respective gesture performed by a hand of the user detected by a hand tracking device in communication with the electronic device.

29. The non-transitory computer readable storage medium of claim 15 , wherein the respective user interface element is displayed at a first size, and navigating to the second user interface includes displaying the second user interface at a second size, larger than the first size.

30. The non-transitory computer readable storage medium of claim 15 , wherein before detecting the input that includes the gaze of the user directed to the respective user interface element, the respective user interface element is displayed over a background with a visual characteristic having a first value, and navigating to the second user interface includes displaying the second user interface over the background with the visual characteristic having a second value, different from the first value.

31. The non-transitory computer readable storage medium of claim 15 , wherein navigating to the second user interface includes displaying the second user interface with a lighting effect that affects one or more other representations displayed via the display generation component.

32. The non-transitory computer readable storage medium of claim 15 , wherein the instructions further cause the electronic device to:

while the gaze of the user is directed to the respective user interface element and before the gaze of the user is directed to the respective user interface element for longer than the time threshold and before navigating to the second user interface, detect, via the eye tracking device, that the gaze of the user is no longer directed to the respective user interface element; and

in response to detecting that the gaze of the user is no longer directed to the respective user interface element, forgo navigating to the second user interface.

33. The non-transitory computer readable storage medium of claim 15 , wherein the instructions further cause the electronic device to:

while the gaze of the user is directed to the respective user interface element and before the gaze of the user is directed to the respective user interface element for longer than the time threshold and before navigating to the second user interface, display, via the display generation component, a visual indication that continued gaze directed to the respective user interface element will cause navigation to the second user interface.

34. The non-transitory computer readable storage medium of claim 33 , wherein the visual indication includes an animation of the respective user interface element expanding into the second user interface.

35. The non-transitory computer readable storage medium of claim 33 , wherein displaying the visual indication includes initiating an animation of content in the second user interface.

36. The non-transitory computer readable storage medium of claim 33 , wherein the first user interface includes a background over which the respective user interface element is displayed, and the visual indication includes obscuring display of the background.

37. The non-transitory computer readable storage medium of claim 15 , wherein navigating to the second user interface includes changing a relative simulated depth between the first user interface and the second user interface.

38. The non-transitory computer readable storage medium of claim 15 , wherein:

before detecting the input directed to the respective user interface element, the first user interface is displayed with a visual characteristic having a first value,

after navigating to the second user interface, the second user interface is displayed over the first user interface displayed with the visual characteristic having a second value, different from the first value,

the first user interface includes a second respective user interface element associated with a third user interface, wherein the instructions further cause the electronic device to:

while displaying the second user interface over the first user interface displayed with the visual characteristic having the second value, receive, via the one or more input devices, an input for navigating from the second user interface to the third user interface; and

in response to receiving the input for navigating from the second user interface to the third user interface, while maintaining display of the first user interface with the visual characteristic having the second value, cease display of the second user interface over the first user interface, and displaying the third user interface over the first user interface.

39. The non-transitory computer readable storage medium of claim 15 , wherein the instructions further cause the electronic device to:

in response to detecting that the gaze of the user is directed to the respective user interface element, initiate an animation corresponding to navigating to the second user interface; and

in response to detecting the input that includes the gaze of the user directed to the respective user interface element:

in accordance with the determination that the gaze of the user continues to be directed to the respective user interface element for longer than the time threshold, complete, over the time threshold, the animation corresponding to navigating to the second user interface and navigating to the second user interface; and

in accordance with the determination that the selection input is detected via the one or more input devices when the gaze of the user has been directed to the respective user interface element for shorter than the time threshold, navigate to the second user interface without completing, over the time threshold, the animation corresponding to navigating to the second user interface.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY DATA PREVIOUSLY RECORDED ON REEL 057536 FRAME 0281. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 6, 2023
From: PASTRANA VICENTE, ISRAEL; MOON, JAY; CHAND, JESSE; DASCOLA, JONATHAN R.; FAULKNER, JEFFREY M.; PLA I CONESA, POL; DARGAN, DORIAN D.
To: APPLE INC.
Reel/Frame 062683/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2021
From: PASTRANA VICENTE, ISRAEL; MOON, JAY; CHAND, JESSE; DASCOLA, JONATHAN R.; FAULKNER, JEFFREY M.; PLA I CONESA, POL; SORRENTINO, WILLIAM A., III; LEMAY, STEPHEN O.
To: APPLE INC.
Reel/Frame 057536/0281 →
Continuity (2)
Provisional Application 63083804 · Sep 25, 2020
Related Publication 20220100270A1 · Mar 31, 2022
Cited By (39)
US 12,271,520 US 12,272,005 US 12,299,251 US 12,315,091 US 12,321,563 US 12,321,666 US 12,347,348 US 12,353,672 US 12,373,081 US 12,394,167 US 12,405,704 US 12,432,330 US 12,443,273 US 12,443,286 US 12,456,271 US 12,461,641 US 12,475,635 US 12,511,009 US 12,511,847 US 12,524,142 US 12,524,977 US 12,535,931 US 12,541,280 US 12,566,532 US 12,593,023 US 12,596,472 US 12,608,115 US 12,608,877 US 12,608,890 US 12,620,187 US 12,625,608 US 12,632,170 US 12,657,958 US 12,663,875 US 12,663,907 US 12,675,958 US 12,681,587 US 12,687,922 US 12,688,660