IP Library › Granted Patent US 11,681,408
Granted Patent B2
US 11,681,408 · App. 17/744,499 · Granted Jun 20, 2023

User interfaces for retrieving contextually relevant media content

Inventors: Britt S. Miura (Menlo Park, CA); Simon Bovet (Zurich, CH); Eric Circlaeys (Los Gatos, CA); Alan C. Dye (San Francisco, CA); Daniel E. Gobera Rubalcava (San Jose, CA); Cyrus Daniel Irani (Los Altos, CA); Brendan J. Langoulant (San Francisco, CA); Stephen O. Lemay (Palo Alto, CA); Justin S. Titi (Morgan Hill, CA); Gary Ian Butcher (Los Gatos, CA); Paulo Michaelo Lopez (Los Gatos, CA); Henrique Penha (San Francisco, CA); Christopher Wilson (Sonoma, CA)
Assignee: Apple Inc.
G06F3/0481G06F3/03547G06F3/04817G06F3/04842G06F3/04883G06F3/04886G06F16/178G06F16/435G06F16/438G06F16/44G06F2203/04105G06T1/0007G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,681,408
App. No.
17/744,499
Filed
May 13, 2022
Granted
Jun 20, 2023
Kind
B2
Art Unit
2173
USPC
715/730
Abstract

The present disclosure generally relates to retrieving and displaying contextually-relevant media content. In some embodiments, a device receives a request to display contextually-relevant media and, in response, displays a representation of a collection of media items relevant to a context of the device. In some embodiments, a device displays a visual media item of a sequence of items and, in response to receiving a swipe gesture, displays a detail user interface comprising related content for the media item. In some embodiments, a device, while displaying a first detail user interface, displays an affordance corresponding to a plurality of individuals identified as having attended a first event, that when selected, causes display of visual media corresponding to a plurality of events attended by the individuals. In some embodiments, a device, in response to user input, obtains an automatically-generated collection of visual media and displays a corresponding affordance.

Claims (113)

1. A method, comprising:

at a device with a display:

displaying, on the display, a first user interface that includes a plurality of visual media items;

while displaying the plurality of visual media items, receiving a first user input;

in response to receiving the first user input:

concurrently displaying, on the display:

a second user interface that includes an affordance associated with a portion of the plurality of visual media items that share a set of common characteristics, wherein the affordance includes an image representative of the portion of the plurality of visual media items and selected from the portion of the plurality of visual media items that share a set of common characteristics; and

a textual identifier overlaid with the affordance, wherein the textual identifier is automatically determined based on context from the set of common characteristics;

receiving a second user input corresponding to selection of the affordance; and

in response to receiving the second user input, displaying, on the display, a detail user interface that includes the portion of the plurality of visual media items.

2. The method of claim 1 , further comprising:

identifying one or more faces in the image representative of the portion of the plurality of visual media items; and

adjusting location of the textual identifier with respect to the one or more identified faces in the image representative of the portion of the plurality of visual media items so that the textual identifier does not overlap the one or more identified faces.

3. The method of claim 1 , further comprising:

identifying one or more faces in the image representative of the portion of the plurality of visual media items; and

modifying the image representative of the portion of the plurality of visual media items with respect to the textual identifier so that the textual identifier does not overlap the one or more identified faces.

4. The method of claim 1 , further comprising:

identifying one or more faces in the image representative of the portion of the plurality of visual media items, wherein identifying one or more faces in the image representative of the portion of the plurality of visual media items includes one or both of:

analyzing the image representative of the portion of the plurality of visual media items using a face detection algorithm, and

using information associated with the image representative of the portion of the plurality of visual media items.

5. The method of claim 1 , wherein the textual identifier includes one or more words that explain relevance of the plurality of visual media items to the context from the set of common characteristics.

6. The method of claim 1 , wherein the context from the set of common characteristics is based on one or more of:

one or more time ranges;

a particular day of year or holiday;

one or more geographic locations; and

at least one name of a person identified from one or more faces in the image representative of the portion of the plurality of visual media items.

7. The method of claim 1 , further comprising:

scaling the image representative of the portion of the plurality of visual media items.

8. The method of claim 1 , further comprising:

while displaying the detail user interface that includes the portion of the plurality of visual media items, displaying, on the display, a slideshow including the portion of the plurality of visual media items;

receiving user input corresponding to a selection of the slideshow; and

in response to receiving the user input corresponding to the selection of the slideshow, displaying, on the display, a video including the portion of the plurality of visual media items, wherein the slideshow and the video are different.

9. The method of claim 8 , further comprising:

receiving user input corresponding to a request to edit the slideshow; and

in response to receiving the user input corresponding to the request to edit the slideshow, displaying, on the display, a slideshow editing user interface.

10. The method of claim 1 , wherein a location of the textual identifier is shifted based on information associated with the image representative of the portion of the plurality of visual media items.

11. The method of claim 10 , wherein the information associated with the image representative of the portion of the plurality of visual media items includes content of the image.

12. An electronic device, comprising:

a display;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, on the display, a first user interface that includes a plurality of visual media items;

while displaying the plurality of visual media items, receiving a first user input;

in response to receiving the first user input:

concurrently displaying, on the display:

a second user interface that includes an affordance associated with a portion of the plurality of visual media items that share a set of common characteristics, wherein the affordance includes an image representative of the portion of the plurality of visual media items and selected from the portion of the plurality of visual media items that share a set of common characteristics; and

a textual identifier overlaid with the affordance, wherein the textual identifier is automatically determined based on context from the set of common characteristics;

receiving a second user input corresponding to selection of the affordance; and

in response to receiving the second user input, displaying, on the display, a detail user interface that includes the portion of the plurality of visual media items.

13. The electronic device of claim 12 , the one or more programs further including instructions for:

identifying one or more faces in the image representative of the portion of the plurality of visual media items; and

adjusting location of the textual identifier with respect to the one or more identified faces in the image representative of the portion of the plurality of visual media items so that the textual identifier does not overlap the one or more identified faces.

14. The electronic device of claim 12 , the one or more programs further including instructions for:

identifying one or more faces in the image representative of the portion of the plurality of visual media items; and

modifying the image representative of the portion of the plurality of visual media items with respect to the textual identifier so that the textual identifier does not overlap the one or more identified faces.

15. The electronic device of claim 12 , the one or more programs further including instructions for:

identifying one or more faces in the image representative of the portion of the plurality of visual media items, wherein identifying one or more faces in the image representative of the portion of the plurality of visual media items includes one or both of:

analyzing the image representative of the portion of the plurality of visual media items using a face detection algorithm, and

using information associated with the image representative of the portion of the plurality of visual media items.

16. The electronic device of claim 12 , wherein the textual identifier includes one or more words that explain relevance of the plurality of visual media items to the context from the set of common characteristics.

17. The electronic device of claim 12 , wherein the context from the set of common characteristics is based on one or more of:

one or more time ranges;

a particular day of year or holiday;

one or more geographic locations; and

at least one name of a person identified from one or more faces in the image representative of the portion of the plurality of visual media items.

18. The electronic device of claim 12 , the one or more programs further including instructions for:

scaling the image representative of the portion of the plurality of visual media items.

19. The electronic device of claim 12 , the one or more programs further including instructions for:

while displaying the detail user interface that includes the portion of the plurality of visual media items, displaying, on the display, a slideshow including the portion of the plurality of visual media items;

receiving user input corresponding to a selection of the slideshow; and

in response to receiving the user input corresponding to the selection of the slideshow, displaying, on the display, a video including the portion of the plurality of visual media items, wherein the slideshow and the video are different.

20. The electronic device of claim 19 , the one or more programs further including instructions for:

receiving user input corresponding to a request to edit the slideshow; and

in response to receiving the user input corresponding to the request to edit the slideshow, displaying, on the display, a slideshow editing user interface.

21. The electronic device of claim 12 , wherein a location of the textual identifier is shifted based on information associated with the image representative of the portion of the plurality of visual media items.

22. The electronic device of claim 21 , wherein the information associated with the image representative of the portion of the plurality of visual media items includes content of the image.

23. A non-transitory computer-readable storage medium storing one or more programs to be executed by one or more processors of an electronic device with a display, the one or more programs including instructions for:

displaying, on the display, a first user interface that includes a plurality of visual media items;

while displaying the plurality of visual media items, receiving a first user input;

in response to receiving the first user input:

concurrently displaying, on the display:

a second user interface that includes an affordance associated with a portion of the plurality of visual media items that share a set of common characteristics, wherein the affordance includes an image representative of the portion of the plurality of visual media items and selected from the portion of the plurality of visual media items that share a set of common characteristics; and

a textual identifier overlaid with the affordance, wherein the textual identifier is automatically determined based on context from the set of common characteristics;

receiving a second user input corresponding to selection of the affordance; and

in response to receiving the second user input, displaying, on the display, a detail user interface that includes the portion of the plurality of visual media items.

24. The non-transitory computer-readable storage medium of claim 23 , the one or more programs further including instructions for:

identifying one or more faces in the image representative of the portion of the plurality of visual media items; and

adjusting location of the textual identifier with respect to the one or more identified faces in the image representative of the portion of the plurality of visual media items so that the textual identifier does not overlap the one or more identified faces.

25. The non-transitory computer-readable storage medium of claim 23 , the one or more programs further including instructions for:

identifying one or more faces in the image representative of the portion of the plurality of visual media items; and

modifying the image representative of the portion of the plurality of visual media items with respect to the textual identifier so that the textual identifier does not overlap the one or more identified faces.

26. The non-transitory computer-readable storage medium of claim 23 , the one or more programs further including instructions for:

identifying one or more faces in the image representative of the portion of the plurality of visual media items, wherein identifying one or more faces in the image representative of the portion of the plurality of visual media items includes one or both of:

analyzing the image representative of the portion of the plurality of visual media items using a face detection algorithm, and

using information associated with the image representative of the portion of the plurality of visual media items.

27. The non-transitory computer-readable storage medium of claim 23 , wherein the textual identifier includes one or more words that explain relevance of the plurality of visual media items to the context from the set of common characteristics.

28. The non-transitory computer-readable storage medium of claim 23 , wherein the context from the set of common characteristics is based on one or more of:

one or more time ranges;

a particular day of year or holiday;

one or more geographic locations; and

at least one name of a person identified from one or more faces in the image representative of the portion of the plurality of visual media items.

29. The non-transitory computer-readable storage medium of claim 23 , the one or more programs further including instructions for:

scaling the image representative of the portion of the plurality of visual media items.

30. The non-transitory computer-readable storage medium of claim 23 , the one or more programs further including instructions for:

while displaying the detail user interface that includes the portion of the plurality of visual media items, displaying, on the display, a slideshow including the portion of the plurality of visual media items;

receiving user input corresponding to a selection of the slideshow; and

in response to receiving the user input corresponding to the selection of the slideshow, displaying, on the display, a video including the portion of the plurality of visual media items, wherein the slideshow and the video are different.

31. The non-transitory computer-readable storage medium of claim 30 , the one or more programs further including instructions for:

receiving user input corresponding to a request to edit the slideshow; and

in response to receiving the user input corresponding to the request to edit the slideshow, displaying, on the display, a slideshow editing user interface.

32. The non-transitory computer-readable storage medium of claim 23 , wherein a location of the textual identifier is shifted based on information associated with the image representative of the portion of the plurality of visual media items.

33. The non-transitory computer-readable storage medium of claim 32 , wherein the information associated with the image representative of the portion of the plurality of visual media items includes content of the image.

Continuity (5)
Continuation 17125744 · Dec 17, 2020
Continuation 16109487 · Aug 22, 2018
Continuation 15275294 · Sep 23, 2016
Provisional Application 62349109 · Jun 12, 2016
Related Publication 20220276750A1 · Sep 1, 2022