IP Library Granted Patent US 11,061,543
Granted Patent B1
US 11,061,543 · App. 17/019,140 · Granted Jul 13, 2021

Providing relevant data items based on context

Inventors: John L. Blatz (San Francisco, CA); Akshay Aggarwal (Cupertino, CA); Radhika Bhargava (San Francisco, CA); Daiwei Liu (San Jose, CA); Pallavika Ramaswamy (Cupertino, CA); Kelvin Ting Pui So (San Jose, CA)
Assignee: Apple Inc.
G06F3/04842G06F3/0482
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,061,543
App. No.
17/019,140
Granted
Jul 13, 2021
Kind
B1
Abstract

Systems and processes for operating an intelligent automated assistant are provided. In one example, a plurality of data items selected by a user are received, wherein a plurality of confidence values corresponding to the plurality of data items are identified. The plurality of data items is ordered. The first data item is displayed, and updated context information associated with the electronic device is received. An update to the plurality of confidence values is detected, wherein the updated plurality of confidence values includes a third confidence value associated with a third data item of the plurality of ordered data items. In accordance with a determination that the third confidence value is higher than a first confidence value of the first data item, an order of the plurality of ordered data items is modified, and the third data item of the plurality of ordered data items is displayed.

Claims (241)

1. An electronic device, comprising:

one or more processors:

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving a plurality of data items selected by a user, wherein the plurality of data items is associated with a ranking previously configured by the user;

identifying a plurality of confidence values corresponding to the plurality of data items, wherein the confidence values are based on:

a relevance of respective data items to current context information, and

the ranking previously configured by the user;

ordering the plurality of data items based on the plurality of confidence values, wherein:

a first data item of the plurality of ordered data items is associated with a first confidence value of the plurality of confidence values, and

a second data item of the plurality of ordered data items is associated with a second confidence value of the plurality of confidence values, wherein the first confidence value is higher than the second confidence value;

displaying the first data item, wherein a user input corresponding to the first data item causes display of the second data item replacing display of the first data item;

retrieving updated context information associated with the electronic device;

detecting, based on the updated context information, an update to the plurality of confidence values, wherein the updated plurality of confidence values includes a third confidence value associated with a third data item of the plurality of ordered data items; and

in accordance with a determination that the third confidence value is higher than the first confidence value:

modifying, based on the context information, an order of the plurality of ordered data items; and

displaying the third data item of the plurality of ordered data items.

2. The electronic device of claim 1 , wherein displaying the first data item comprises:

displaying a grouping of the ordered plurality of data items; and

displaying the first data item as overlaid on the grouping of the ordered plurality of data items.

3. The electronic device of claim 1 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and a location of the electronic device;

detecting movement of the electronic device from a first location to a second location; and

in accordance with a determination that the respective data item includes an association with the second location, increasing the respective confidence value.

4. The electronic device of claim 1 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and a calendar event;

identifying a start time associated with a respective calendar event, wherein the start time is within a threshold time from a current time; and

in accordance with a determination that the respective data item includes an association with the respective calendar event, increasing the respective confidence value.

5. The electronic device of claim 1 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and current information associated with a device application;

receiving updated information corresponding to the device application; and

in accordance with a determination that the respective data item includes an association with the updated information, adjusting the respective confidence value.

6. The electronic device of claim 1 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based on at least one of a user preference and a user interaction history;

receiving updated information corresponding to at least one of the user preference and the user interaction history; and

in accordance with a determination that the respective data item includes an association with the updated information, adjusting the respective confidence value.

7. The electronic device of claim 1 , wherein modifying, based on the context information, an order of the plurality of ordered data items comprises:

modifying an order value of the third data item, wherein the modified order value of the third data item corresponds to a highest order value of plurality of ordered data items; and

modifying an order value of each data item of the plurality of data items, wherein the modified order values are arranged in descending order based on a descending order of the updated confidence values.

8. The electronic device of claim 7 , wherein a fourth data item is associated with a second highest order value of the plurality of ordered data items, comprising:

receiving a user input corresponding to the displayed third data item, wherein the user input corresponding to the displayed third data item includes a contact motion in a first direction;

in response to receiving the user input, causing display of the fourth data item replacing display of the third data item; and

modifying an order value of the fourth data item, wherein the modified order value of the fourth data item corresponds to a highest order value of plurality of ordered data items.

9. The electronic device of claim 1 , the one or more programs including instructions for:

in response to retrieving the updated context information associated with the electronic device, identifying an additional data item associated with a respective confidence value; and

in accordance with a determination that the respective confidence value exceeds a confidence threshold, adding the additional data item to the plurality of data items selected by the user.

10. The electronic device of claim 9 , wherein identifying an additional data item associated with a respective confidence value comprises:

receiving an input corresponding to at least one of a user interaction history and a movement history of the electronic device; and

identifying, based on the received input, a prediction of a user action as the additional data item.

11. The electronic device of claim 9 , wherein identifying an additional data item associated with a respective confidence value comprises:

obtaining at least one of information associated with a device application and information from a remote source; and

identifying, based on the obtained information, a notification as the additional data item.

12. The electronic device of claim 9 , wherein identifying an additional data item associated with a respective confidence value comprises:

obtaining, based on the current context information, a prediction of a device application; and

identifying the device application associated with the prediction as the additional data item.

13. The electronic device of claim 1 , the one or more programs including instructions for:

in accordance with a determination that no confidence value of the plurality of identified confidence values exceeds a confidence threshold, identifying an additional data item associated with a usage value; and

in accordance with a determination that the usage value does not exceed a usage threshold, adding the additional data item to the plurality of data items selected by the user.

14. The electronic device of claim 1 , the one or more programs including instructions for:

receiving the user input corresponding to the first data item, wherein the user input corresponding to the first data item includes a contact motion in a first direction;

in response to receiving the user input, causing display of the second data item replacing display of the first data item;

receiving a second user input corresponding to the second data item, wherein the second user input includes a contact motion in a second direction opposite the first direction; and

in response to receiving the second user input, causing display of the first data item replacing display of the second data item.

15. The electronic device of claim 1 , wherein a displayed data item is associated with a device application, the one or more programs including instructions for:

receiving a user input including a selection of the displayed data item;

increasing a confidence value associated with the displayed data item; and

invoking the device application associated with the displayed data item, wherein invoking the application includes replacing display of the displayed data item with the invoked application.

16. The electronic device of claim 1 , wherein a displayed data item is associated with an actionable command, the one or more programs including instructions for:

receiving a user input including a selection of the displayed data item;

increasing a confidence value associated with the displayed data item; and

performing a task associated with the displayed data item, wherein the task corresponds to the actionable command.

17. A computer-implemented method, comprising:

at an electronic device with one or more processors and memory:

receiving a plurality of data items selected by a user, wherein the plurality of data items is associated with a ranking previously configured by the user;

identifying a plurality of confidence values corresponding to the plurality of data items, wherein the confidence values are based on:

a relevance of respective data items to current context information, and

the ranking previously configured by the user;

ordering the plurality of data items based on the plurality of confidence values, wherein:

a first data item of the plurality of ordered data items is associated with a first confidence value of the plurality of confidence values, and

a second data item of the plurality of ordered data items is associated with a second confidence value of the plurality of confidence values, wherein the first confidence value is higher than the second confidence value;

displaying the first data item, wherein a user input corresponding to the first data item causes display of the second data item replacing display of the first data item;

retrieving updated context information associated with the electronic device;

detecting, based on the updated context information, an update to the plurality of confidence values, wherein the updated plurality of confidence values includes a third confidence value associated with a third data item of the plurality of ordered data items; and

in accordance with a determination that the third confidence value is higher than the first confidence value:

modifying, based on the context information, an order of the plurality of ordered data items; and

displaying the third data item of the plurality of ordered data items.

18. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:

receive a plurality of data items selected by a user, wherein the plurality of data items is associated with a ranking previously configured by the user;

identify a plurality of confidence values corresponding to the plurality of data items, wherein the confidence values are based on:

a relevance of respective data items to current context information, and

the ranking previously configured by the user;

order the plurality of data items based on the plurality of confidence values, wherein:

a first data item of the plurality of ordered data items is associated with a first confidence value of the plurality of confidence values, and

a second data item of the plurality of ordered data items is associated with a second confidence value of the plurality of confidence values, wherein the first confidence value is higher than the second confidence value;

display the first data item, wherein a user input corresponding to the first data item causes display of the second data item replacing display of the first data item;

retrieve updated context information associated with the electronic device;

detect, based on the updated context information, an update to the plurality of confidence values, wherein the updated plurality of confidence values includes a third confidence value associated with a third data item of the plurality of ordered data items; and

in accordance with a determination that the third confidence value is higher than the first confidence value:

modify, based on the context information, an order of the plurality of ordered data items; and

display the third data item of the plurality of ordered data items.

19. The method of claim 17 , wherein displaying the first data item comprises:

displaying a grouping of the ordered plurality of data items; and

displaying the first data item as overlaid on the grouping of the ordered plurality of data items.

20. The method of claim 17 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and a location of the electronic device;

detecting movement of the electronic device from a first location to a second location; and

in accordance with a determination that the respective data item includes an association with the second location, increasing the respective confidence value.

21. The method of claim 17 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and a calendar event;

identifying a start time associated with a respective calendar event, wherein the start time is within a threshold time from a current time; and

in accordance with a determination that the respective data item includes an association with the respective calendar event, increasing the respective confidence value.

22. The method of claim 17 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and current information associated with a device application;

receiving updated information corresponding to the device application; and

in accordance with a determination that the respective data item includes an association with the updated information, adjusting the respective confidence value.

23. The method of claim 17 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based on at least one of a user preference and a user interaction history;

receiving updated information corresponding to at least one of the user preference and the user interaction history; and

in accordance with a determination that the respective data item includes an association with the updated information, adjusting the respective confidence value.

24. The method of claim 17 , wherein modifying, based on the context information, an order of the plurality of ordered data items comprises:

modifying an order value of the third data item, wherein the modified order value of the third data item corresponds to a highest order value of plurality of ordered data items; and

modifying an order value of each data item of the plurality of data items, wherein the modified order values are arranged in descending order based on a descending order of the updated confidence values.

25. The method of claim 17 , wherein a fourth data item is associated with a second highest order value of the plurality of ordered data items, comprising:

receiving a user input corresponding to the displayed third data item, wherein the user input corresponding to the displayed third data item includes a contact motion in a first direction;

in response to receiving the user input, causing display of the fourth data item replacing display of the third data item; and

modifying an order value of the fourth data item, wherein the modified order value of the fourth data item corresponds to a highest order value of plurality of ordered data items.

26. The method of claim 17 , comprising:

in response to retrieving the updated context information associated with the electronic device, identifying an additional data item associated with a respective confidence value; and

in accordance with a determination that the respective confidence value exceeds a confidence threshold, adding the additional data item to the plurality of data items selected by the user.

27. The method of claim 26 , wherein identifying an additional data item associated with a respective confidence value comprises:

receiving an input corresponding to at least one of a user interaction history and a movement history of the electronic device; and

identifying, based on the received input, a prediction of a user action as the additional data item.

28. The method of claim 26 , wherein identifying an additional data item associated with a respective confidence value comprises:

obtaining at least one of information associated with a device application and information from a remote source; and

identifying, based on the obtained information, a notification as the additional data item.

29. The method of claim 26 , wherein identifying an additional data item associated with a respective confidence value comprises:

obtaining, based on the current context information, a prediction of a device application; and

identifying the device application associated with the prediction as the additional data item.

30. The method of claim 17 , comprising:

in accordance with a determination that no confidence value of the plurality of identified confidence values exceeds a confidence threshold, identifying an additional data item associated with a usage value; and

in accordance with a determination that the usage value does not exceed a usage threshold, adding the additional data item to the plurality of data items selected by the user.

31. The method of claim 17 , comprising:

receiving the user input corresponding to the first data item, wherein the user input corresponding to the first data item includes a contact motion in a first direction;

in response to receiving the user input, causing display of the second data item replacing display of the first data item;

receiving a second user input corresponding to the second data item, wherein the second user input includes a contact motion in a second direction opposite the first direction; and

in response to receiving the second user input, causing display of the first data item replacing display of the second data item.

32. The method of claim 17 , wherein a displayed data item is associated with a device application, comprising:

receiving a user input including a selection of the displayed data item;

increasing a confidence value associated with the displayed data item; and

invoking the device application associated with the displayed data item, wherein invoking the application includes replacing display of the displayed data item with the invoked application.

33. The method of claim 17 , wherein a displayed data item is associated with an actionable command, comprising:

receiving a user input including a selection of the displayed data item;

increasing a confidence value associated with the displayed data item; and

performing a task associated with the displayed data item, wherein the task corresponds to the actionable command.

34. The computer-readable storage medium of claim 18 , wherein displaying the first data item comprises:

displaying a grouping of the ordered plurality of data items; and

displaying the first data item as overlaid on the grouping of the ordered plurality of data items.

35. The computer-readable storage medium of claim 18 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and a location of the electronic device;

detecting movement of the electronic device from a first location to a second location; and

in accordance with a determination that the respective data item includes an association with the second location, increasing the respective confidence value.

36. The computer-readable storage medium of claim 18 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and a calendar event;

identifying a start time associated with a respective calendar event, wherein the start time is within a threshold time from a current time, and

in accordance with a determination that the respective data item includes an association with the respective calendar event, increasing the respective confidence value.

37. The computer-readable storage medium of claim 18 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based at least in part on an association between the respective data item and current information associated with a device application;

receiving updated information corresponding to the device application; and

in accordance with a determination that the respective data item includes an association with the updated information, adjusting the respective confidence value.

38. The computer-readable storage medium of claim 18 , wherein detecting, based on the updated context information, an update to the plurality of confidence values comprises:

identifying a respective confidence value associated with a respective data item, wherein the respective confidence value is based on at least one of a user preference and a user interaction history;

receiving updated information corresponding to at least one of the user preference and the user interaction history; and

in accordance with a determination that the respective data item includes an association with the updated information, adjusting the respective confidence value.

39. The computer-readable storage medium of claim 18 , wherein modifying, based on the context information, an order of the plurality of ordered data items comprises:

modifying an order value of the third data item, wherein the modified order value of the third data item corresponds to a highest order value of plurality of ordered data items; and

modifying an order value of each data item of the plurality of data items, wherein the modified order values are arranged in descending order based on a descending order of the updated confidence values.

40. The computer-readable storage medium of claim 18 , wherein a fourth data item is associated with a second highest order value of the plurality of ordered data items, wherein the instructions further cause the electronic device to:

receive a user input corresponding to the displayed third data item, wherein the user input corresponding to the displayed third data item includes a contact motion in a first direction;

in response to receiving the user input, cause display of the fourth data item replacing display of the third data item; and

modify an order value of the fourth data item, wherein the modified order value of the fourth data item corresponds to a highest order value of plurality of ordered data items.

41. The computer-readable storage medium of claim 18 , wherein the instructions further cause the electronic device to:

in response to retrieving the updated context information associated with the electronic device, identify an additional data item associated with a respective confidence value; and

in accordance with a determination that the respective confidence value exceeds a confidence threshold, add the additional data item to the plurality of data items selected by the user.

42. The computer-readable storage medium of claim 41 , wherein identifying an additional data item associated with a respective confidence value comprises:

receiving an input corresponding to at least one of a user interaction history and a movement history of the electronic device; and

identifying, based on the received input, a prediction of a user action as the additional data item.

43. The computer-readable storage medium of claim 41 , wherein identifying an additional data item associated with a respective confidence value comprises:

obtaining at least one of information associated with a device application and information from a remote source; and

identifying, based on the obtained information, a notification as the additional data item.

44. The computer-readable storage medium of claim 41 , wherein identifying an additional data item associated with a respective confidence value comprises:

obtaining, based on the current context information, a prediction of a device application; and

identifying the device application associated with the prediction as the additional data item.

45. The computer-readable storage medium of claim 18 , wherein the instructions further cause the electronic device to:

in accordance with a determination that no confidence value of the plurality of identified confidence values exceeds a confidence threshold, identify an additional data item associated with a usage value; and

in accordance with a determination that the usage value does not exceed a usage threshold, add the additional data item to the plurality of data items selected by the user.

46. The computer-readable storage medium of claim 18 , wherein the instructions further cause the electronic device to:

receive the user input corresponding to the first data item, wherein the user input corresponding to the first data item includes a contact motion in a first direction;

in response to receiving the user input, cause display of the second data item replacing display of the first data item;

receive a second user input corresponding to the second data item, wherein the second user input includes a contact motion in a second direction opposite the first direction; and

in response to receiving the second user input, cause display of the first data item replacing display of the second data item.

47. The computer-readable storage medium of claim 18 , wherein a displayed data item is associated with a device application, wherein the instructions further cause the electronic device to:

receive a user input including a selection of the displayed data item;

increase a confidence value associated with the displayed data item; and

invoke the device application associated with the displayed data item, wherein invoking the application includes replacing display of the displayed data item with the invoked application.

48. The computer-readable storage medium of claim 18 , wherein a displayed data item is associated with an actionable command, wherein the instructions further cause the electronic device to:

receive a user input including a selection of the displayed data item;

increase a confidence value associated with the displayed data item; and

perform a task associated with the displayed data item, wherein the task corresponds to the actionable command.

49. The electronic device of claim 1 , the one or more programs including instructions for:

receiving a first user input associated with a first ranking of a first respective data item of the plurality of data items;

receiving a second user input associated with a second ranking of a second respective data item of the plurality of data items, wherein the second ranking is lower than the first ranking;

identifying a first confidence value of the first respective data item based on the first ranking; and

identifying a second confidence value of the second respective data item based on the second ranking, wherein the second confidence value is lower than the first confidence value.

50. The electronic device of claim 1 , the one or more programs including instructions for:

receiving a user input corresponding to a respective data item of the plurality of data items, wherein the user input includes a predetermined motion pattern;

in response to receiving the user input, removing the respective data item from the plurality of data items.

51. The electronic device of claim 1 , the one or more programs including instructions for:

receiving a first user input associated with a first respective data item of the plurality of data items, wherein the first user input includes movement of the first respective data item to a position lower than a second respective data item; and

modifying a first confidence value of the first respective data item based on the first user input, wherein the modified first confidence value is lower than a confidence value associated with the second respective data item.

52. The method of claim 17 , comprising:

receiving a first user input associated with a first ranking of a first respective data item of the plurality of data items;

receiving a second user input associated with a second ranking of a second respective data item of the plurality of data items, wherein the second ranking is lower than the first ranking;

identifying a first confidence value of the first respective data item based on the first ranking; and

identifying a second confidence value of the second respective data item based on the second ranking, wherein the second confidence value is lower than the first confidence value.

53. The method of claim 17 , comprising:

receiving a user input corresponding to a respective data item of the plurality of data items, wherein the user input includes a predetermined motion pattern;

in response to receiving the user input, removing the respective data item from the plurality of data items.

54. The method of claim 17 , comprising:

receiving a first user input associated with a first respective data item of the plurality of data items, wherein the first user input includes movement of the first respective data item to a position lower than a second respective data item; and

modifying a first confidence value of the first respective data item based on the first user input, wherein the modified first confidence value is lower than a confidence value associated with the second respective data item.

55. The computer-readable storage medium of claim 18 , wherein the instructions further cause the electronic device to:

receive a first user input associated with a first ranking of a first respective data item of the plurality of data items;

receive a second user input associated with a second ranking of a second respective data item of the plurality of data items, wherein the second ranking is lower than the first ranking;

identify a first confidence value of the first respective data item based on the first ranking; and

identify a second confidence value of the second respective data item based on the second ranking, wherein the second confidence value is lower than the first confidence value.

56. The computer-readable storage medium of claim 18 , wherein the instructions further cause the electronic device to:

receive a user input corresponding to a respective data item of the plurality of data items, wherein the user input includes a predetermined motion pattern;

in response to receiving the user input, remove the respective data item from the plurality of data items.

57. The computer-readable storage medium of claim 18 , wherein the instructions further cause the electronic device to:

receive a first user input associated with a first respective data item of the plurality of data items, wherein the first user input includes movement of the first respective data item to a position lower than a second respective data item, and

modifying a first confidence value of the first respective data item based on the first user input, wherein the modified first confidence value is lower than a confidence value associated with the second respective data item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2021
From: BLATZ, JOHN L.; AGGARWAL, AKSHAY; BHARGAVA, RADHIKA; LIU, DAIWEI; RAMASWAMY, PALLAVIKA; SO, KELVIN TING PUI
To: APPLE INC.
Reel/Frame 055979/0082 →
Continuity (1)
Provisional Application 63023174 · May 11, 2020
Cited By (27)
US 12,197,712 US 12,197,817 US 12,200,297 US 12,204,932 US 12,211,502 US 12,216,894 US 12,219,314 US 12,223,282 US 12,231,739 US 12,236,952 US 12,254,887 US 12,260,234 US 12,277,954 US 12,293,763 US 12,301,635 US 12,333,404 US 12,361,943 US 12,367,879 US 12,386,434 US 12,386,491 US 12,431,128 US 12,477,470 US 12,498,758 US 12,556,890 US 12,608,171 US 12,613,730 US 12,619,452