IP Library › Granted Patent US 12,412,560
Granted Patent B2
US 12,412,560 · App. 17/384,336 · Granted Sep 9, 2025

Systems and methods for selecting a voice to use during a communication with a user

Inventors: Matthew John Lawrenson (Bussigny, CH); Julian Charles Nolan (Pully, CH)
Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
G10L13/033G06F3/167G10L15/22G10L25/63G10L25/90H04M3/493H04M3/4936G06Q30/02H04M2203/401
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,412,560
App. No.
17/384,336
Granted
Sep 9, 2025
Kind
B2
Abstract

A computing device having the capability to dynamically select a voice that will be used by a speech synthesizer in creating synthesized speech for use in communicating with a user of the computing device is provided. For example, in some embodiments, the computing device: i) employs the speech synthesizer to have a first audible communication with the user using a first voice; ii) stores user satisfaction data that can be used to determine a user's satisfaction with an action the user took in response to the first audible communication; and iii) determines whether a different voice should be used during a second audible communication with the user based on the stored user satisfaction data.

Claims (62)

1. A method in a computing device for audibly communicating with a particular user of the computing device, the method comprising:

performing a first audible communication with the particular user using a first voice;

obtaining information indicating an effectiveness of the first voice in influencing the particular user to make a change to an operational parameter of the computing device or make a purchase, wherein obtaining the information indicating the effectiveness of the first voice comprises obtaining a first value that indicates a total number of times the particular user accepted a recommendation that was made to the particular user using the first voice;

determining, based on the first value that indicates the total number of times the particular user accepted a recommendation that was made to the particular user using the first voice, whether to perform a second audible communication with the particular user using a second voice that replaces the first voice; and

performing the second audible communication with the particular user using the second voice, wherein

the first audible communication comprises synthesized speech that was synthesized using the first voice, and

the second audible communication comprises synthesized speech that was synthesized using the second voice having a different voice characteristic than the first voice.

2. The method of claim 1 , wherein

the second voice is different than the first voice with respect to at least one voice characteristic, and

the at least one voice characteristic is an emotion, an intonation, a gender, a pitch, an accent, or a tone.

3. The method of claim 1 , wherein

performing the first audible communication comprises audibly providing to the particular user a recommendation to make the change to the operational parameter of the computing device, and

obtaining the information indicating the effectiveness of the first voice comprises determining whether the particular user made the change to the operational parameter of the computing device.

4. The method of claim 3 , wherein obtaining the information indicating the effectiveness of the first voice comprises determining whether the particular user reversed the change to the operational parameter.

5. The method of claim 1 , wherein obtaining the information indicating the effectiveness of the first voice further comprises:

determining whether the particular user made the change to the operational parameter of the computing device or made the purchase; and

as a result of determining that the particular user made the change to the operational parameter of the computing device or made the purchase, updating the first value.

6. The method of claim 5 , wherein

the recommendation is a particular type of recommendation, and

the first value indicates a total number of times the particular user accepted recommendations of the particular type that were made to the particular user using the first voice.

7. The method of claim 6 , further comprising, prior to performing the first audible communication with the particular user using the first voice, storing a second value that indicates a total number of times that the first voice was used to audibly provide to the particular user a recommendation of the particular type.

8. The method of claim 7 , further comprising:

storing a third value that indicates a total number of times that the second voice was used to audibly provide to the particular user a recommendation of the particular type, and

storing a fourth value that indicates a total number of times the particular user accepted recommendations of the particular type that were made to the particular user using the second voice.

9. The method of claim 5 , wherein the method further comprises, prior to performing the first audible communication with the particular user using the first voice, storing a second value that indicates a total number of times the particular user accepted a recommendation that was made to the particular user using the second voice.

10. The method of claim 9 , wherein the method further comprises, prior to performing the first audible communication with the particular user using the first voice:

storing a third value that indicates a total number of times that the first voice was used to audibly provide to the particular user a recommendation, and

storing a fourth value that indicates a total number of times that the second voice was used to audibly provide to the particular user a recommendation.

11. The method of claim 1 , wherein

performing the first audible communication comprises audibly providing to the particular user a recommendation to make the purchase.

12. The method of claim 11 , wherein

obtaining the information indicating the effectiveness of the first voice comprises determining whether the particular user made the purchase.

13. The method of claim 1 , the information indicating the effectiveness of the first voice in influencing the particular user to change an operational parameter of the computer device comprises information indicating the effectiveness of the first voice in influencing the particular user to activate a module of the computing device.

14. A computer program product comprising a non-transitory computer readable medium storing a computer program for configuring a computing device to perform the method of claim 1 .

15. A computing device, the computing device comprising:

a memory; and

a processor coupled to the memory, wherein the computing device is configured to:

perform a first audible communication with the particular user using a first voice;

obtain information indicating an effectiveness of the first voice in influencing the particular user to make a change to an operational parameter of the computing device or make a purchase, wherein obtaining the information indicating the effectiveness of the first voice comprises obtaining a first value that indicates a total number of times the particular user accepted a recommendation that was made to the particular user using the first voice;

determine, based on the first value that indicates a total number of times the particular user accepted a recommendation that was made to the particular user using the first voice, whether to perform a second audible communication with the particular user using a second voice that replaces the first voice; and

perform the second audible communication with the particular user using the second voice, wherein

the first audible communication comprises synthesized speech that was synthesized using the first voice, and

the second audible communication comprises synthesized speech that was synthesized using the second voice having a different voice characteristic than the first voice.

16. The computing device of claim 15 , wherein

the second voice is different than the first voice with respect to at least one voice characteristic, and

the at least one voice characteristic is an emotion, an intonation, a gender, a pitch, an accent, or a tone.

17. The computing device of claim 15 , wherein

the computing device is configured to perform the first audible communication by audibly providing to the particular user a recommendation to make the change to the operational parameter of the computing device, and

the computing device is configured to obtain the information indicating the effectiveness of the first voice by performing a process that includes determining whether the particular user made the change to the operational parameter of the computing device.

18. The computing device of claim 17 , wherein

the process further comprises: as a result of determining that the particular user made the change to the operational parameter of the computing device, updating the first value.

19. The computing device of claim 18 , wherein

the recommendation is a particular type of recommendation, and

the first value indicates a total number of times the particular user accepted recommendations of the particular type that were made to the particular user using the first voice.

20. The computing device of claim 19 , wherein the computing device is further configured to store a second value that indicates a total number of times that the first voice was used to audibly provide to the particular user a recommendation of the particular type.

21. The computing device of claim 20 , wherein the computing device is further configured to:

store a third value that indicates a total number of times that the second voice was used to audibly provide to the particular user a recommendation of the particular type, and

store a fourth value that indicates a total number of times the particular user accepted recommendations of the particular type that were made to the particular user using the second voice.

22. The computing device of claim 17 , wherein the process further comprises determining whether the particular user reversed the configuration change.

23. The computing device of claim 15 , wherein the first audible communication comprises a recommendation that the particular user make a purchase.

24. The computing device of claim 23 , wherein

the computing device is configured to obtain the information indicating the effectiveness of the first voice by performing a process that includes determining whether the particular user made the purchase.

Continuity (3)
Continuation 16264874 · Feb 1, 2019
Continuation 15525720
Related Publication 20210350785A1 · Nov 11, 2021
References Cited (34)
US 5704007A · Cecys · 1997 [cited by examiner]
US 6269336B1 · Ladd et al. · 2001 [cited by applicant]
US 6847714B2 · Das et al. · 2005 [cited by applicant]
US 7180997B2 · Knappe · 2007 [cited by applicant]
US 7349527B2 · Yacoub et al. · 2008 [cited by applicant]
US 7372952B1 · Wu et al. · 2008 [cited by applicant]
US 7653543B1 · Blair et al. · 2010 [cited by applicant]
US 8600753B1 · Conkie · 2013 [cited by examiner]
US 8666746B2 · Bangalore · 2014 [cited by examiner]
US 8837706B2 · Odinak · 2014 [cited by examiner]
US 8856007B1 · Stuttle · 2014 [cited by examiner]
US 9472182B2 · Luan · 2016 [cited by examiner]
US 10224022B2 · Lawrenson et al. · 2019 [cited by applicant]
US 11087736B2 · Lawrenson · 2021 [cited by examiner]
US 20020128838A1 · Veprek · 2002 [cited by applicant]
US 20020184027A1 · Brittan et al. · 2002 [cited by applicant]
US 20030216920A1 · Bao · 2003 [cited by examiner]
US 20040073427A1 · Moore · 2004 [cited by examiner]
US 20040174434A1 · Walker · 2004 [cited by examiner]
US 20080109845A1 · Hengel · 2008 [cited by examiner]
US 20080167875A1 · Bakis · 2008 [cited by examiner]
US 20100312564A1 · Plljmpe · 2010 [cited by applicant]
US 20100312565A1 · Wang · 2010 [cited by examiner]
US 20120296654A1 · Hendrickson · 2012 [cited by examiner]
US 20140025383A1 · Dai et al. · 2014 [cited by applicant]
US 20140038578A1 · Bouzid · 2014 [cited by examiner]
US 20140365226A1 · Sinha · 2014 [cited by applicant]
US 20150286937A1 · Hildebrand · 2015 [cited by examiner]
CN 103543979 · 2011 [cited by applicant]
JP 2003099080A · 2003 [cited by examiner]
International Search Report and Written Opinion issued in Application No. PCT/SE2014!051336 dated Jun. 25, 2015, 10 pages. [cited by applicant]
Olinger, M.: “How to Measure App Success”, Jul. 21, 2014 (Jul. 21, 2014), XP055196201, Retrieved from Internet: WRL: http://www.appmakr.com/blog/how-to-measure-app-success/, 6 pages. [cited by applicant]
European Office Action issued in Application No. 14806747.3 dated Jan. 18, 2018, 7 pages. [cited by applicant]
Office Action dated Sep. 12, 2019 issued by China National Intellectual Property Administration in Application No. 201480083090_3 (11 pages), and English-language translation thereof (5 pages). [cited by applicant]