IP Library › Granted Patent US 12,711,724

Granted Patent B2

US 12,711,724 · App. 18/731,022 · Granted Aug 18, 2026

Devices, methods, and graphical user interfaces for content applications

Inventors: Alexa Abelson (Cupertino, CA); Matias A. Franco (Menlo Park, CA); Sruti Harikumar (Los Gatos, CA); Tyler C. Dahl (San Jose, CA); Danvin Ruangchan (San Jose, CA); Matan Stauber (Brooklyn, NY); Alfred B. Huergo Wagner (Redwood City, CA); Stephen O Lemay (Palo Alto, CA); William A Sorrentino, III (Kentfield, CA); Peter D. Anton (Portola Valley, CA)

Assignee: Apple Inc.

G06T19/20 G06T19/006 G06T2219/2004 G06T2219/2016

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12,711,724
App. No.: 18/731,022
Granted: Aug 18, 2026
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

In some embodiments, a computer system generates virtual lighting effects while presenting a content item. In some embodiments, a computer system generates an animated three-dimensional object while presenting a content item. In some embodiments, a computer system displays a condensed user interface in place of an expanded user interface in response to different inputs.

Claims (169)

1 . A method comprising:

at a computer system in communication with a display generation component and one or more input devices:

displaying, via the display generation component, an expanded user interface of an application at a first location in a three-dimensional environment, wherein:

the application is controlling playback of a first content item at the computer system,

the expanded user interface includes a first selectable user interface object that is selectable to initiate playback of a second content item, different from the first content item, at the computer system, and

the expanded user interface is displayed concurrently with a second selectable user interface object that is displayed at a second location in the three-dimensional environment, separate from the expanded user interface;

while displaying the expanded user interface of the application at the first location in the three-dimensional environment and the second selectable user interface object at the second location in the three-dimensional environment, receiving via the one or more input devices, a first input corresponding to selection of the second selectable user interface object; and

in response to receiving the first input:

displaying, in the three-dimensional environment, a condensed user interface of the application for controlling the playback of the first content item at the computer system, wherein the condensed user interface is displayed at a third location, different from the first location and the second location, in the three-dimensional environment;

cease displaying, in the three-dimensional environment, the expanded user interface and the second selectable user interface object;

while displaying the condensed user interface, receiving, via the one or more input devices, a second input corresponding to a request to resize the condensed user interface; and

in response to receiving the second input corresponding to the request to resize the condensed user interface, updating a size of the condensed user interface in the three-dimensional environment in accordance with the second input corresponding to the request to resize the condensed user interface.

2 . The method of claim 1 , further comprising:

displaying, via the display generation component, a playback control user interface of the application for controlling playback of the first content item concurrently with, and separate from, the expanded user interface in the three-dimensional environment.

3 . The method of claim 2 , wherein the playback control user interface includes an image corresponding to the first content item and a third selectable user interface object for modifying playback of the first content item.

4 . The method of claim 3 , wherein the second selectable user interface object comprises the image corresponding to the first content item.

5 . The method of claim 1 , further comprising:

while displaying the condensed user interface of the application, receiving, via the one or more input devices, a second input corresponding to a request to display a second user interface corresponding to a second application, different from the application, in the three-dimensional environment; and

in response to receiving the second input corresponding to displaying the second user interface:

concurrently displaying, in the three-dimensional environment, the condensed user interface of the application and the second user interface corresponding to the second application.

6 . The method of claim 5 , further comprising

while displaying the second user interface corresponding to the second application, receiving, via the one or more input devices, a third input corresponding to a request to display a third user interface corresponding to a third application, different from the application and the second application; and in response to receiving the third input corresponding to displaying the third user interface:

ceasing the display of the second user interface and displaying the third user interface.

7 . The method of claim 5 , wherein the condensed user interface includes a third selectable user interface object that is selectable to redisplay the expanded user interface, and the method further comprises:

while displaying the third selectable user interface object displayed concurrently with the condensed user interface, receiving, via the one or more input devices, a fourth input corresponding to selection of the third selectable user interface object; and in response to receiving the fourth input corresponding to the selection of the third selectable user interface object:

displaying the expanded user interface and ceasing display of the second user interface corresponding to the second application.

8 . The method of claim 2 , wherein the condensed user interface includes a third selectable user interface object that is selectable to display a representation of lyrics of the first content item and the playback control user interface includes a fourth selectable user interface object that is selectable to display a representation of lyrics of the first content item.

9 . The method of claim 8 , further comprising:

while displaying the condensed user interface including the third selectable user interface object, receiving, via the one or more input devices, a second input corresponding to selection of the third selectable user interface object; and

in response to receiving the second input, displaying the representation of the lyrics of the first content item concurrently with the condensed user interface in the three-dimensional environment, wherein the representation of the lyrics is displayed at a fourth location in the three-dimensional environment and the condensed user interface is displayed at a fifth location, different from the fourth location, in the three-dimensional environment.

10 . The method of claim 8 , further comprising:

while displaying the representation of the lyrics at a fourth location in the three-dimensional environment and the condensed user interface is at a fifth location in the three-dimensional environment, receiving, via the one or more input devices, a second input corresponding to a request to move the condensed user interface; and

in response to receiving the second input:

moving the condensed user interface to a sixth location in the three-dimensional environment in accordance with the second input; and

maintaining the representation of the lyrics of the first content item at the fourth location in the three-dimensional environment.

11 . The method of claim 8 , further comprising:

in response to receiving the second input corresponding to moving the representation of the lyrics of the first content item:

moving the representation of the lyrics of the first content item to a sixth location; and

continuing to display the condensed user interface at the fifth location.

12 . The method of claim 8 , further comprising:

while displaying the representation of the lyrics with a first size in the three-dimensional environment, receiving, via the one or more input devices, a second input corresponding to a request to modify a size of the representation of the lyrics of the first content item; and

in response to receiving the second input:

modifying the representation of the lyrics of the first content item to have a second size, different from the first size, in the three-dimensional environment in accordance with the second input; and

maintaining a size of the condensed user interface in the three-dimensional environment.

13 . The method of claim 1 , further comprising:

while displaying the expanded user interface and a third selectable user interface object that is selectable to display a representation of lyrics of the first content item, wherein the expanded user interface is displayed at the first location in the three-dimensional environment, receiving, via the one or more input devices, a second input corresponding to a selection of the third selectable user interface object; and in response to receiving the second input:

ceasing display of the expanded user interface in the three-dimensional environment at the first location; and

displaying, in the three-dimensional environment, the representation of the lyrics of the first content item at the first location.

14 . The method of claim 13 , wherein displaying the representation of the lyrics of the first content item at the first location includes displaying the representation of the lyrics of the first content item with a size that is different from a size of the expanded user interface that was displayed when the second input was detected.

15 . The method of claim 13 , wherein when the second input was detected, the expanded user interface was displayed concurrently with a playback control user interface that includes the second selectable user interface object, the method further comprising:

in response to receiving the second input, displaying the representation of the lyrics of the first content item concurrently with the playback control user interface;

while concurrently displaying the representation of the lyrics of the first content item with the playback control user interface, receiving, via the one or more input device, a third input corresponding to a request to move the playback control user interface in the three-dimensional environment; and

in response to receiving the third input:

moving the playback control user interface in the three-dimensional environment in accordance with the third input; and

moving the representation of the lyrics of the first content item in the three-dimensional environment in accordance with the third input.

16 . A computer system that is in communication with a display generation component and one or more input devices, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the display generation component, an expanded user interface of an application at a first location in a three-dimensional environment, wherein:

the application is controlling playback of a first content item at the computer system,

in response to receiving the first input:

cease displaying, in the three-dimensional environment, the expanded user interface and the second selectable user interface object;

while displaying the condensed user interface, receiving, via the one or more input devices, a second input corresponding to a request to resize the condensed user interface; and

17 . The computer system of claim 16 , wherein the one or more programs further include instructions for:

18 . The computer system of claim 17 , wherein the playback control user interface includes an image corresponding to the first content item and a third selectable user interface object for modifying playback of the first content item.

19 . The computer system of claim 18 , wherein the second selectable user interface object comprises the image corresponding to the first content item.

20 . The computer system of claim 17 , wherein the condensed user interface includes a third selectable user interface object that is selectable to display a representation of lyrics of the first content item and the playback control user interface includes a fourth selectable user interface object that is selectable to display a representation of lyrics of the first content item.

21 . The computer system of claim 20 , wherein the one or more programs further include instructions for:

22 . The computer system of claim 20 , wherein the one or more programs further include instructions for:

in response to receiving the second input:

moving the condensed user interface to a sixth location in the three-dimensional environment in accordance with the second input; and

maintaining the representation of the lyrics of the first content item at the fourth location in the three-dimensional environment.

23 . The computer system of claim 20 , wherein the one or more programs further include instructions for:

while displaying the representation of the lyrics at a fourth location in the three- dimensional environment and the condensed user interface is at a fifth location in the three- dimensional environment, receiving, via the one or more input devices, a second input corresponding to a request to move the representation of the lyrics of the first content item; and

in response to receiving the second input corresponding to moving the representation of the lyrics of the first content item:

moving the representation of the lyrics of the first content item to a sixth location; and

continuing to display the condensed user interface at the fifth location.

24 . The computer system of claim 20 , wherein the one or more programs further include instructions for:

in response to receiving the second input:

maintaining a size of the condensed user interface in the three-dimensional environment.

25 . The computer system of claim 16 , wherein the one or more programs further include instructions for:

in response to receiving the second input corresponding to displaying the second user interface:

concurrently displaying, in the three-dimensional environment, the condensed user interface of the application and the second user interface corresponding to the second application.

26 . The computer system of claim 25 , wherein the one or more programs further include instructions for:

ceasing the display of the second user interface and displaying the third user interface.

27 . The computer system of claim 25 , wherein the condensed user interface includes a third selectable user interface object that is selectable to redisplay the expanded user interface, and the one or more programs further include instructions for:

displaying the expanded user interface and ceasing display of the second user interface corresponding to the second application.

28 . The computer system of claim 16 , wherein the one or more programs further include instructions for:

ceasing display of the expanded user interface in the three-dimensional environment at the first location; and

displaying, in the three-dimensional environment, the representation of the lyrics of the first content item at the first location.

29 . The computer system of claim 28 , wherein displaying the representation of the lyrics of the first content item at the first location includes displaying the representation of the lyrics of the first content item with a size that is different from a size of the expanded user interface that was displayed when the second input was detected.

30 . The computer system of claim 28 , wherein when the second input was detected, the expanded user interface was displayed concurrently with a playback control user interface that includes the second selectable user interface object, the one or more programs further including instructions for:

in response to receiving the second input, displaying the representation of the lyrics of the first content item concurrently with the playback control user interface;

in response to receiving the third input:

moving the playback control user interface in the three-dimensional environment in accordance with the third input; and

moving the representation of the lyrics of the first content item in the three-dimensional environment in accordance with the third input.

31 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a computer system that is in communication with a display generation component and one or more input devices, cause the computer system to perform a method comprising:

displaying, via the display generation component, an expanded user interface of an application at a first location in a three-dimensional environment, wherein:

the application is controlling playback of a first content item at the computer system,

in response to receiving the first input:

cease displaying, in the three-dimensional environment, the expanded user interface and the second selectable user interface object;

while displaying the condensed user interface, receiving, via the one or more input devices, a second input corresponding to a request to resize the condensed user interface; and

32 . The non-transitory computer readable storage medium of claim 31 , the method further comprising:

33 . The non-transitory computer readable storage medium of claim 32 , wherein the playback control user interface includes an image corresponding to the first content item and a third selectable user interface object for modifying playback of the first content item.

34 . The non-transitory computer readable storage medium of claim 33 , wherein the second selectable user interface object comprises the image corresponding to the first content item.

35 . The non-transitory computer readable storage medium of claim 32 , wherein the condensed user interface includes a third selectable user interface object that is selectable to display a representation of lyrics of the first content item and the playback control user interface includes a fourth selectable user interface object that is selectable to display a representation of lyrics of the first content item.

36 . The non-transitory computer readable storage medium of claim 35 , the method further comprising:

37 . The non-transitory computer readable storage medium of claim 35 , the method further comprising:

in response to receiving the second input:

moving the condensed user interface to a sixth location in the three-dimensional environment in accordance with the second input; and

maintaining the representation of the lyrics of the first content item at the fourth location in the three-dimensional environment.

38 . The non-transitory computer readable storage medium of claim 35 , the method further comprising:

in response to receiving the second input corresponding to moving the representation of the lyrics of the first content item:

moving the representation of the lyrics of the first content item to a sixth location; and

continuing to display the condensed user interface at the fifth location.

39 . The non-transitory computer readable storage medium of claim 35 , the method further comprising:

in response to receiving the second input:

maintaining a size of the condensed user interface in the three-dimensional environment.

40 . The non-transitory computer readable storage medium of claim 31 , the method further comprising:

in response to receiving the second input corresponding to displaying the second user interface:

concurrently displaying, in the three-dimensional environment, the condensed user interface of the application and the second user interface corresponding to the second application.

41 . The non-transitory computer readable storage medium of claim 40 , the method further comprising:

ceasing the display of the second user interface and displaying the third user interface.

42 . The non-transitory computer readable storage medium of claim 40 , wherein the condensed user interface includes a third selectable user interface object that is selectable to redisplay the expanded user interface, and the method further comprises:

displaying the expanded user interface and ceasing display of the second user interface corresponding to the second application.

43 . The non-transitory computer readable storage medium of claim 31 , the method further comprising:

ceasing display of the expanded user interface in the three-dimensional environment at the first location; and

displaying, in the three-dimensional environment, the representation of the lyrics of the first content item at the first location.

44 . The non-transitory computer readable storage medium of claim 43 , wherein displaying the representation of the lyrics of the first content item at the first location includes displaying the representation of the lyrics of the first content item with a size that is different from a size of the expanded user interface that was displayed when the second input was detected.

45 . The non-transitory computer readable storage medium of claim 43 , wherein when the second input was detected, the expanded user interface was displayed concurrently with a playback control user interface that includes the second selectable user interface object, the method further comprising:

in response to receiving the second input, displaying the representation of the lyrics of the first content item concurrently with the playback control user interface;

in response to receiving the third input:

moving the playback control user interface in the three-dimensional environment in accordance with the third input; and

moving the representation of the lyrics of the first content item in the three-dimensional environment in accordance with the third input.