IP Library Granted Patent US 11,657,813
Granted Patent B2
US 11,657,813 · App. 17/032,676 · Granted May 23, 2023

Voice identification in digital assistant systems

Inventors: Corey J. Peterson (Cupertino, CA); Jessica Peck (San Jose, CA); Anumita Biswas (Santa Clara, CA); Harry Simmonds (Cupertino, CA)
Assignee: Apple Inc.
G10L15/22G06F3/167G06F21/32G10L15/18G10L17/00G10L17/14G10L2015/223G10L2015/225G10L2015/227
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,657,813
App. No.
17/032,676
Filed
Sep 25, 2020
Granted
May 23, 2023
Kind
B2
Examiner
HAN, QI
Art Unit
2659
USPC
704/275
Abstract

Systems and processes for operating an intelligent automated assistant are provided. An example method includes receiving, from one or more external electronic devices, a plurality of speaker profiles for a plurality of users; receiving a natural language speech input; determining, based on comparing the natural language speech input to the plurality of speaker profiles: a first likelihood that the natural language speech input corresponds to a first user of the plurality of users; and a second likelihood that the natural language speech input corresponds to a second user of the plurality of users; determining whether the first likelihood and the second likelihood are within a first threshold; and in accordance with determining that the first likelihood and the second likelihood are not within the first threshold: providing a response to the natural language speech input, the response being personalized for the first user.

Claims (181)

1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to

receive a spoken media request;

determine whether a user, of a plurality of registered users, corresponds to the spoken media request;

in accordance with determining that a first user of the plurality of registered users corresponds to the spoken media request:

provide a first response to the spoken media request, the first response being personalized for the first user; and

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request:

determine whether the spoken media request includes a personal media request;

in accordance with determining that the spoken media request includes a personal media request:

obtain an identification of a user who provided the spoken media request; and

in accordance with obtaining the identification: provide a second response to the spoken media request; the second response being personalized for the user who provided the spoken media request.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the one or more programs further include instructions, which when executed by the one or more processors, cause the electronic device to:

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request and in accordance with determining that the spoken media request does not include a personal media request:

determine whether a media account of a first type is associated with the electronic device;

in accordance with determining that a media account of the first type is associated with the electronic device:

provide a third response to the spoken media request, the third response being based on the media account of the first type; and

in accordance with determining that a media account of the first type is not associated with the electronic device:

provide a fourth response to the spoken media request, the fourth response being based on a media account of a second type different from the first type.

3. The non-transitory computer-readable storage medium of claim 1 , wherein the one or more programs further include instructions, which when executed by the one or more processors, cause the electronic device to:

determine that a plurality of users of the plurality of registered users correspond to the spoken media request;

in accordance with determining that the plurality of users correspond to the spoken media request:

determine whether the spoken media request includes a personal request.

4. The non-transitory computer-readable storage medium of claim 3 , wherein the one or more programs further include instructions, which when executed by the one or more processors, cause the electronic device to:

in accordance with determining that the spoken media request includes a personal request:

determine whether a media account of a third type is associated with the electronic device; and

in accordance with determining that a media account of the third type is associated with the electronic device:

determine whether a user associated with the media account of the is a user of the plurality of users; and

in accordance with determining that the user associated with the media account of the third type is a user of the plurality of users, provide a fifth response to the spoken media request; the fifth response being based on the media account of the third type.

5. The non-transitory computer-readable storage medium of claim 3 , wherein the one or more programs further include instructions, which when executed by the one or more processors, cause the electronic device to:

in accordance with determining that the spoken media request does not include a personal request:

provide a sixth response to the spoken media request, the sixth response being based on a media account associated with the electronic device.

6. The non-transitory computer-readable storage medium of claim 1 , wherein determining whether the spoken media request includes a personal media request includes:

determining that the spoken media request includes one or more words indicative of personalization.

7. The non-transitory computer-readable storage medium of claim 1 , wherein determining whether the spoken media request includes a personal media request includes:

determining that the spoken media request is associated with a predetermined type of user intent.

8. The non-transitory computer-readable storage medium of claim 1 , wherein obtaining the identification of the user who provided the spoken media request includes:

providing an output indicative of a request for user identity;

in response to providing the output indicative of the request for user identity, receiving a speech input; and

obtaining the identification based on the speech input.

9. The non-transitory computer-readable storage medium of claim 1 , wherein:

the spoken media request includes a name of a second user of the plurality of registered users;

the second user of the plurality of registered users is different from the first user of the plurality of registered users; and

the first response to the spoken media request includes playback of a media item associated with the second user.

10. The non-transitory computer-readable storage medium of claim 1 , wherein:

the spoken media request includes a name of a media collection associated with a third user of the plurality of registered users;

the third user of the plurality of registered users is different from the first user of the plurality of registered users; and

the first response to the spoken media request includes playback of a media item from the media collection associated with the third user.

11. The non-transitory computer-readable storage medium of claim 1 , wherein the one or more programs further include instructions, which when executed by the one or more processors, cause the electronic device to:

in accordance with determining that the first user of the plurality of registered users corresponds to the spoken media request:

update a media preference of the first user based on the spoken media request; and

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request:

forgo updating any media preference of any user based on the spoken media request.

12. The non-transitory computer-readable storage medium of claim 11 , wherein:

the spoken media request includes a request to switch a content provider;

the first response to the spoken media request indicates that the content provider has been switched; and

updating the media preference of the first user includes updating a content provider preference of the first user based on the spoken media request.

13. The non-transitory computer-readable storage medium of claim 1 , wherein the first response to the spoken media request includes one or more words indicative of personalization for the first user.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the one or more words include a name of the first user.

15. The non-transitory computer-readable storage medium of claim 1 , wherein the first response to the spoken media request includes playback of a media item from a first media account associated with the first user.

16. The non-transitory computer-readable storage medium of claim 1 , wherein providing the first response to the spoken media request includes updating a second media account associated with the first user.

17. An electronic device, comprising:

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving a spoken media request;

determining whether a user, of a plurality of registered users, corresponds to the spoken media request;

in accordance with determining that a first user of the plurality of registered users corresponds to the spoken media request:

providing a first response to the spoken media request, the first response being personalized for the first user; and

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request:

determining whether the spoken media request includes a personal media request;

in accordance with determining that the spoken media request includes a personal media request:

obtaining an identification of a user who provided the spoken media request; and

in accordance with obtaining the identification: providing a second response to the spoken media request, the second response being personalized for the user who provided the spoken media request.

18. The electronic device of claim 17 , wherein the one or more programs further include instructions for:

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request and in accordance with determining that the spoken media request does not include a personal media request:

determining whether a media account of a first type is associated with the electronic device;

in accordance with determining that a media account of the first type is associated with the electronic device:

providing a third response to the spoken media request, the third response being based on the media account of the first type; and

in accordance with determining that a media account of the first type is not associated with the electronic device:

providing a fourth response to the spoken media request, the fourth response being based on a media account of a second type different from the first type.

19. The electronic device of claim 17 , wherein the one or more programs further include instructions for:

determining that a plurality of users of the plurality of registered users correspond to the spoken media request;

in accordance with determining that the plurality of users correspond to the spoken media request:

determining whether the spoken media request includes a personal request.

20. The electronic device of claim 19 , wherein the one or more programs further include instructions for:

in accordance with determining that the spoken media request includes a personal request:

determining whether a media account of a third type is associated with the electronic device; and

in accordance with determining that a media account of the third type is associated with the electronic device:

determining whether a user associated with the media account of the third type is a user of the plurality of users; and

in accordance with determining that the user associated with the media account of the third type is a user of the plurality of users, providing a fifth response to the spoken media request, the fifth response being based on the media account of the third type.

21. The electronic device of claim 19 , wherein the one or more programs further include instructions for:

in accordance with determining that the spoken media request does not include a personal request:

providing a sixth response to the spoken media request, the sixth response being based on a media account associated with the electronic device.

22. The electronic device of claim 17 , wherein determining whether the spoken media request includes a personal media request includes:

determining that the spoken media request includes one or more words indicative of personalization.

23. The electronic device of claim 17 , wherein determining whether the spoken media request includes a personal media request includes:

determining that the spoken media request is associated with a predetermined type of user intent.

24. The electronic device of claim 17 , wherein obtaining the identification of the user who provided the spoken media request includes:

providing an output indicative of a request for user identity;

in response to providing the output indicative of the request for user identity, receiving a speech input; and

obtaining the identification based on the speech input.

25. The electronic device of claim 17 , wherein:

the spoken media request includes a name of a second user of the plurality of registered users;

the second user of the plurality of registered users is different from the first user of the plurality of registered users; and

the first response to the spoken media request includes playback of a media item associated with the second user.

26. The electronic device of claim 17 , wherein:

the spoken media request includes a name of a media collection associated with a third user of the plurality of registered users;

the third user of the plurality of registered users is different from the first user of the plurality of registered users; and

the first response to the spoken media request includes playback of a media item from the media collection associated with the third user.

27. The electronic device of claim 17 , wherein the one or more programs further include instructions for:

in accordance with determining that the first user of the plurality of registered users corresponds to the spoken media request:

updating a media preference of the first user based on the spoken media request; and

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request:

forgoing updating any media preference of any user based on the spoken media request.

28. The electronic device of claim 27 , wherein:

the spoken media request includes a request to switch a content provider;

the first response to the spoken media request indicates that the content provider has been switched; and

updating the media preference of the first user includes updating a content provider preference of the first user based on the spoken media request.

29. The electronic device of claim 17 , wherein the first response to the spoken media request includes one or more words indicative of personalization for the first user.

30. The electronic device of claim 29 , wherein the one or more words include a name of the first user.

31. The electronic device of claim 17 , wherein the first response to the spoken media request includes playback of a media item from a first media account associated with the first user.

32. The electronic device of claim 17 , wherein providing the first response to the spoken media request includes updating a second media account associated with the first user.

33. A method for providing media content, the method comprising:

at an electronic device with one or more processors and memory:

receiving a spoken media request;

determining whether a user, of a plurality of registered users, corresponds to the spoken media request;

in accordance with determining that a first user of the plurality of registered users corresponds to the spoken media request:

providing a first response to the spoken media request, the first response being personalized for the first user; and

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request:

determining whether the spoken media request includes a personal media request;

in accordance with determining that the spoken media request includes a personal media request:

obtaining an identification of a user who provided the spoken media request, and

in accordance with obtaining the identification: providing a second response to the spoken media request, the second response being personalized for the user who provided the spoken media request.

34. The method of claim 33 , further comprising:

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request and in accordance with determining that the spoken media request does not include a personal media request:

determining whether a media account of a first type is associated with the electronic device;

in accordance with determining that a media account of the first type is associated with the electronic device:

providing a third response to the spoken media request, the third response being based on the media account of the first type; and

in accordance with determining that a media account of the first type is not associated with the electronic device:

providing a fourth response to the spoken media request, the fourth response being based on a media account of a second type different from the first type.

35. The method of claim 33 , further comprising:

determining that a plurality of users of the plurality of registered users correspond to the spoken media request;

in accordance with determining that the plurality of users correspond to the spoken media request:

determining whether the spoken media request includes a personal request.

36. The method of claim 35 , further comprising:

in accordance with determining that the spoken media request includes a personal request:

determining whether a media account of a third type is associated with the electronic device; and

in accordance with determining that a media account of the third type is associated with the electronic device:

determining whether a user associated with the media account of the third type is a user of the plurality of users; and

in accordance with determining that the user associated with the media account of the third type is a user of the plurality of users, providing a fifth response to the spoken media request, the fifth response being based on the media account of the third type.

37. The method of claim 35 , further comprising:

in accordance with determining that the spoken media request does not include a personal request:

providing a sixth response to the spoken media request, the sixth response being based on a media account associated with the electronic device.

38. The method of claim 33 , wherein determining whether the spoken media request includes a personal media request includes:

determining that the spoken media request includes one or more words indicative of personalization.

39. The method of claim 33 , wherein determining whether the spoken media request includes a personal media request includes:

determining that the spoken media request is associated with a predetermined type of user intent.

40. The method of claim 33 , wherein obtaining the identification of the user who provided the spoken media request includes:

providing an output indicative of a request for user identity;

in response to providing the output indicative of the request for user identity, receiving a speech input; and

obtaining the identification based on the speech input.

41. The method of claim 33 , wherein:

the spoken media request includes a name of a second user of the plurality of registered users;

the second user of the plurality of registered users is different from the first user of the plurality of registered users; and

the first response to the spoken media request includes playback of a media item associated with the second user.

42. The method of claim 33 , wherein:

the spoken media request includes a name of a media collection associated with a third user of the plurality of registered users;

the third user of the plurality of registered users is different from the first user of the plurality of registered users; and

the first response to the spoken media request includes playback of a media item from the media collection associated with the third user.

43. The method of claim 33 , further comprising:

in accordance with determining that the first user of the plurality of registered users corresponds to the spoken media request:

updating a media preference of the first user based on the spoken media request; and

in accordance with determining that no user of the plurality of registered users corresponds to the spoken media request:

forgoing updating any media preference of any user based on the spoken media request.

44. The method of claim 43 , wherein:

the spoken media request includes a request to switch a content provider;

the first response to the spoken media request indicates that the content provider has been switched; and

updating the media preference of the first user includes updating a content provider preference of the first user based on the spoken media request.

45. The method of claim 33 , wherein the first response to the spoken media request includes one or more words indicative of personalization for the first user.

46. The method of claim 45 , wherein the one or more words include a name of the first user.

47. The method of claim 33 , wherein the first response to the spoken media request includes playback of a media item from a first media account associated with the first user.

48. The method of claim 33 , wherein providing the first response to the spoken media request includes updating a second media account associated with the first user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2021
From: PETERSON, COREY J.; PECK, JESSICA; BISWAS, ANUMITA; SIMMONDS, HARRY
To: APPLE INC.
Reel/Frame 055702/0918 →
Continuity (3)
Continuation 16815984 · Mar 11, 2020
Provisional Application 62855778 · May 31, 2019
Related Publication 20210012776A1 · Jan 14, 2021
Cited By (3)
US 12,216,963 US 12,468,792 US 12,487,793