IP Library › Granted Patent US 11,675,829
Granted Patent B2
US 11,675,829 · App. 17/162,448 · Granted Jun 13, 2023

Intelligent automated assistant for media exploration

Inventors: David Chance Graham (Columbus, OH); Cyrus Daniel Irani (Palo Alto, CA); Aimee Piercy (Mountain View, CA); Thomas Alsina (Mountain View, CA)
Assignee: Apple Inc.
G06F16/634G06F3/167G06F9/453G06F16/3329G06F16/433G06F16/435G06F16/635G06F16/685G10L15/1815G10L15/22G10L15/30G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,675,829
App. No.
17/162,448
Granted
Jun 13, 2023
Kind
B2
Abstract

Systems and processes for operating an intelligent automated assistant are provided. In accordance with one example, a method includes, at an electronic device with one or more processors and memory, receiving a first natural-language speech input indicative of a request for media, where the first natural-language speech input comprises a first search parameter; providing, by a digital assistant, a first media item identified based on the first search parameter. The method further includes, while providing the first media item, receiving a second natural-language speech input and determining whether the second input corresponds to a user intent of refining the request for media. The method further includes, in accordance with a determination that the second speech input corresponds to a user intent of refining the request for media: identifying, based on the first parameter and the second speech input, a second media item and providing the second media item.

Claims (106)

1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:

receive a speech input indicative of a request for media;

detect, by a digital assistant, physical presence of a plurality of users to the electronic device, the plurality of users including a first user, and wherein detecting the physical presence of the plurality of users includes:

providing an audio prompt for confirmation of the physical presence of the first user; and

receiving, from the first user, an audio input confirming the physical presence of the first user;

in response to detecting the physical presence of the plurality of users, obtain a plurality of preference profiles corresponding to the plurality of users;

provide, by the digital assistant, a merged preference profile based on the plurality of preference profiles;

provide, by the digital assistant, an audio output of a first media item identified based on the merged preference profile;

detect, by the digital assistant, a lack of presence of the first user of the plurality of users;

after detecting the lack of presence of the first user, update the merged preference profile; and

provide, by the digital assistant, an audio output of a second media item different from the first media item, wherein the second media item is identified based on the updated merged preference profile.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the electronic device is a first electronic device associated with the first user of the plurality of users, and wherein detecting the physical presence of the plurality of users to the electronic device comprises:

receiving information corresponding to a second electronic device associated with the second user of the plurality of users.

3. The non-transitory computer-readable storage medium of claim 2 , wherein receiving information corresponding to the second electronic device comprises: receiving, at the first electronic device, identification information from the second electronic device.

4. The non-transitory computer-readable storage medium of claim 2 , wherein receiving information corresponding to the second electronic device comprises: receiving identification information from a routing device, wherein the routing device is connected to the first electronic device and the second electronic device.

5. The non-transitory computer-readable storage medium of claim 2 , wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the electronic device to:

receive a preference profile corresponding to the second user from a remote device.

6. The non-transitory computer-readable storage medium of claim 2 , wherein a preference profile corresponding to the first user is stored on the electronic device.

7. The non-transitory computer-readable storage medium of claim 2 , wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the electronic device to:

identify, by the digital assistant, a plurality of media items based on the merged preference profile, wherein:

the plurality of media items comprises a first set of media items associated with the first user and a second set of media items associated with the second user.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the first media item is part of the first set of media items, and wherein the first media item is not part of the second set of media items.

9. The non-transitory computer-readable storage medium of claim 7 , wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the electronic device to:

after detecting the lack of presence of the first user:

update the plurality of media items.

10. The non-transitory computer-readable storage medium of claim 9 , wherein updating the plurality of media items comprises removing the first media item from the plurality of media items and wherein the second media item is identified from the updated plurality of media items.

11. The non-transitory computer-readable storage medium of claim 2 , wherein the speech input is received from the first user, and wherein the first user is not authorized to access the first media item and the second user is authorized to access the first media item.

12. The non-transitory computer-readable storage medium of claim 1 , wherein providing the merged preference profile comprises:

identifying one or more preferences shared by each of the plurality of preference profiles.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the identified first media item is associated with metadata matching the one or more preferences.

14. The non-transitory computer-readable storage medium of claim 1 , wherein the audio output of the first media item includes a verbal description of the first media item.

15. The non-transitory computer-readable storage medium of claim 1 , wherein the audio output of the first media item includes a speech output indicative of the merged preference profile.

16. The non-transitory computer-readable storage medium of claim 1 , wherein the identified first media item is a song, an audio book, a podcast, a station, a playlist, or any combination thereof.

17. The non-transitory computer-readable storage medium of claim 1 , wherein the electronic device is a computer, a set-top box, a speaker, a smart watch, a phone, or any combination thereof.

18. A method for operating a digital assistant, the method comprising:

at an electronic device with one or more processors and memory:

receiving a speech input indicative of a request for media;

detecting, by the digital assistant, physical presence of a plurality of users to the electronic device, the plurality of users including a first user, and wherein detecting the physical presence of the plurality of users includes:

providing an audio prompt for confirmation of the physical presence of the first user; and

receiving, from the first user, an audio input confirming the physical presence of the first user;

in response to detecting the physical presence of the plurality of users, obtaining a plurality of preference profiles corresponding to the plurality of users;

providing, by the digital assistant, a merged preference profile based on the plurality of preference profiles;

providing, by the digital assistant, an audio output of a first media item identified based on the merged preference profile;

detecting, by the digital assistant, a lack of presence of the first user of the plurality of users;

after detecting the lack of presence of the first user, updating the merged preference profile; and

providing, by the digital assistant, an audio output of a second media item different from the first media item, wherein the second media item is identified based on the updated merged preference profile.

19. The method of claim 18 , wherein the electronic device is a first electronic device associated with the first user of the plurality of users, and wherein detecting the physical presence of the plurality of users to the electronic device comprises:

receiving information corresponding to a second electronic device associated with the second user of the plurality of users.

20. The method of claim 19 , wherein receiving information corresponding to the second electronic device comprises: receiving, at the first electronic device, identification information from the second electronic device.

21. The method of claim 19 , wherein receiving information corresponding to the second electronic device comprises: receiving identification information from a routing device, wherein the routing device is connected to the first electronic device and the second electronic device.

22. The method of claim 19 , further comprising:

receiving a preference profile corresponding to the second user from a remote device.

23. The method of claim 19 , wherein a preference profile corresponding to the first user is stored on the electronic device.

24. The method of claim 19 , further comprising:

identifying, by the digital assistant, a plurality of media items based on the merged preference profile, wherein:

the plurality of media items comprises a first set of media items associated with the first user and a second set of media items associated with the second user.

25. The method of claim 24 , wherein the first media item is part of the first set of media items, and wherein the first media item is not part of the second set of media items.

26. The method of claim 24 , further comprising:

after detecting the lack of presence of the first user:

updating the plurality of media items.

27. The method of claim 26 , wherein updating the plurality of media items comprises removing the first media item from the plurality of media items and wherein the second media item is identified from the updated plurality of media items.

28. The method of claim 19 , wherein the speech input is received from the first user, and wherein the first user is not authorized to access the first media item and the second user is authorized to access the first media item.

29. The method of claim 18 , wherein providing the merged preference profile comprises:

identifying one or more preferences shared by each of the plurality of preference profiles.

30. The method of claim 29 , wherein the identified first media item is associated with metadata matching the one or more preferences.

31. The method of claim 18 , wherein the audio output of the first media item includes a verbal description of the first media item.

32. The method of claim 18 , wherein the audio output of the first media item includes a speech output indicative of the merged preference profile.

33. The method of claim 18 , wherein the identified first media item is a song, an audio book, a podcast, a station, a playlist, or any combination thereof.

34. The method of claim 18 , wherein the electronic device is a computer, a set-top box, a speaker, a smart watch, a phone, or any combination thereof.

35. An electronic device, comprising:

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving a speech input indicative of a request for media;

detecting, by a digital assistant, physical presence of a plurality of users to the electronic device, the plurality of users including a first user, and wherein detecting the physical presence of the plurality of users includes:

providing an audio prompt for confirmation of the physical presence of the first user; and

receiving, from the first user, an audio input confirming the physical presence of the first user;

in response to detecting the physical presence of the plurality of users, obtaining a plurality of preference profiles corresponding to the plurality of users;

providing, by the digital assistant, a merged preference profile based on the plurality of preference profiles;

providing, by the digital assistant, an audio output of a first media item identified based on the merged preference profile;

detecting, by the digital assistant, a lack of presence of the first user of the plurality of users;

after detecting the lack of presence of the first user, updating the merged preference profile; and

providing, by the digital assistant, an audio output of a second media item different from the first media item, wherein the second media item is identified based on the updated merged preference profile.

36. The electronic device of claim 35 , wherein the electronic device is a first electronic device associated with the first user of the plurality of users, and wherein detecting the physical presence of the plurality of users to the electronic device comprises:

receiving information corresponding to a second electronic device associated with the second user of the plurality of users.

37. The electronic device of claim 36 , wherein receiving information corresponding to the second electronic device comprises: receiving, at the first electronic device, identification information from the second electronic device.

38. The electronic device of claim 36 , wherein receiving information corresponding to the second electronic device comprises: receiving identification information from a routing device, wherein the routing device is connected to the first electronic device and the second electronic device.

39. The electronic device of claim 36 , the one or more programs further including instructions for:

receiving a preference profile corresponding to the second user from a remote device.

40. The electronic device of claim 36 , wherein a preference profile corresponding to the first user is stored on the electronic device.

41. The electronic device of claim 36 , the one or more programs further including instructions for:

identifying, by the digital assistant, a plurality of media items based on the merged preference profile, wherein:

the plurality of media items comprises a first set of media items associated with the first user and a second set of media items associated with the second user.

42. The electronic device of claim 41 , wherein the first media item is part of the first set of media items, and wherein the first media item is not part of the second set of media items.

43. The electronic device of claim 41 , the one or more programs further including instructions for:

after detecting the lack of presence of the first user:

updating the plurality of media items.

44. The electronic device of claim 43 , wherein updating the plurality of media items comprises removing the first media item from the plurality of media items and wherein the second media item is identified from the updated plurality of media items.

45. The electronic device of claim 36 , wherein the speech input is received from the first user, and wherein the user is not authorized to access the first media item and the second user is authorized to access the first media item.

46. The electronic device of claim 35 , wherein providing the merged preference profile comprises:

identifying one or more preferences shared by each of the plurality of preference profiles.

47. The electronic device of claim 46 , wherein the identified first media item is associated with metadata matching the one or more preferences.

48. The electronic device of claim 35 , wherein the audio output of the first media item includes a verbal description of the first media item.

49. The electronic device of claim 35 , wherein the audio output of the first media item includes a speech output indicative of the merged preference profile.

50. The electronic device of claim 35 , wherein the identified first media item is a song, an audio book, a podcast, a station, a playlist, or any combination thereof.

51. The electronic device of claim 35 , wherein the electronic device is a computer, a set-top box, a speaker, a smart watch, a phone, or any combination thereof.

Priority Claims (2)
DK PA201770425 · Jun 1, 2017 · national
DK PA201770426 · Jun 1, 2017 · national
Continuity (4)
Continuation 16290737 · Mar 1, 2019
Continuation 15940203 · Mar 29, 2018
Provisional Application 62506981 · May 16, 2017
Related Publication 20210165826A1 · Jun 3, 2021
Cited By (7)
US 12,216,963 US 12,333,404 US 12,386,434 US 12,477,470 US 12,562,172 US 12,608,171 US 12,626,702