SYSTEM WITH SPEAKER REPRESENTATION, ELECTRONIC DEVICE AND RELATED METHODS
System, electronic device, and related methods, in particular a method of operating a system comprising an electronic device is disclosed, the method comprising obtaining one or more audio signals including a first audio signal; determining one or more first sentiment metrics indicative of a first speaker state based on the first audio signal, the one or more first sentiment metrics including a first primary sentiment metric indicative of a primary sentiment state of a first speaker; determining one or more first appearance metrics indicative of an appearance of the first speaker, the one or more first appearance metrics including a first primary appearance metric indicative of a primary appearance of the first speaker; determining a first speaker representation based on the first primary sentiment metric and the first primary appearance metric; and outputting, via the interface of the electronic device, the first speaker representation.
1 . A method of operating a system comprising an electronic device, the electronic device comprising an interface, a processor, and a memory, the method comprising:
obtaining one or more audio signals including a first audio signal;
determining one or more first sentiment metrics indicative of a first speaker state based on the first audio signal, the one or more first sentiment metrics including a first primary sentiment metric indicative of a primary sentiment state of a first speaker;
determining one or more first appearance metrics indicative of an appearance of the first speaker, the one or more first appearance metrics including a first primary appearance metric indicative of a primary appearance of the first speaker;
determining a first speaker representation based on the first primary sentiment metric and the first primary appearance metric; and
outputting, via the interface of the electronic device, the first speaker representation.
2 . Method according to claim 1 , wherein the one or more first sentiment metrics includes a first secondary sentiment metric indicative of a secondary sentiment state of the first speaker.
3 . Method according to claim 1 , wherein the one or more first appearance metrics includes a first secondary appearance metric indicative of a secondary appearance of the first speaker.
4 . Method according to claim 1 , wherein the first speaker representation is a caller representation.
5 . Method according to claim 1 , wherein the first speaker representation is an agent representation.
6 . Method according to claim 1 , wherein determining the first speaker representation comprises determining a first primary feature of a first avatar based on the first primary sentiment metric, and wherein the first speaker representation comprises the first avatar.
7 . Method according to claim 6 , wherein the first primary feature is selected from a mouth feature, an eye feature, a nose feature, a forehead feature, an eyebrow feature, a hair feature, an ear feature, a beard feature, a gender feature, a cheek feature, an accessory feature, a skin feature, a body feature, and a head dimension feature.
8 . Method according to claim 1 , wherein determining the first speaker representation comprises determining a first secondary feature of a first avatar based on the first primary appearance metric.
9 . Method according to claim 8 , wherein the first secondary feature is different from a first primary feature of the first avatar, wherein the first primary feature is based on the first primary sentiment metric, and wherein the first secondary feature is selected from a mouth feature, an eye feature, a nose feature, a forehead feature, an eyebrow feature, a hair feature, an ear feature, a beard feature, a gender feature, a cheek feature, an accessory feature, a skin feature, a body feature, and a head dimension feature.
10 . Method according to claim 1 , wherein obtaining one or more audio signals comprises obtaining a second audio signal; the method comprising:
determining one or more second sentiment metrics indicative of a second speaker state based on the second audio signal, the one or more second sentiment metrics including a second primary sentiment metric indicative of a primary sentiment state of a second speaker;
obtaining one or more second appearance metrics indicative of an appearance of the second speaker, the one or more second appearance metrics including a second primary appearance metric indicative of a primary appearance of the second speaker;
determining a second speaker representation based on the second primary sentiment metric and the second appearance metric; and
outputting, via the interface of the electronic device, the second speaker representation.
11 . Method according to claim 1 , wherein the second speaker representation is an agent representation.
12 . Method according to claim 1 , the method comprising detecting a termination of speech, and in accordance with detecting the termination of speech, storing a speaker record in the memory and/or transmitting a speaker record to a server device of the system, the speaker record comprising a first speaker record indicative of one or more of first appearance metric data and first sentiment metric data of the first speaker.
13 . (canceled)
14 . Electronic device comprising a processor, a memory, and an interface, wherein the processor is configured to:
obtain one or more audio signals including a first audio signal;
determine one or more first sentiment metrics indicative of a first speaker state based on the first audio signal, the one or more first sentiment metrics including a first primary sentiment metric indicative of a primary sentiment state of the first speaker;
determine one or more first appearance metrics indicative of an appearance of the first speaker, the one or more first appearance metrics including a first primary appearance metric indicative of a primary appearance of the first speaker;
determine a first speaker representation based on the first primary sentiment metric and the first primary appearance metric; and
output, via the interface, the first speaker representation.
15 . (canceled)
16 . Electronic device of claim 14 , wherein the electronic device is selected from the group consisting of a mobile phone, a laptop computer, and a table computer.
17 . Electronic device of claim 14 , wherein the interface comprises a display.
18 . Electronic device of claim 14 , wherein to determine the first speaker representation comprises to determine a first primary feature of a first avatar based on the first primary sentiment metric, and wherein the first speaker representation comprises the first avatar.
19 . Electronic device of claim 14 , wherein to obtain the one or more audio signals comprises to generate the one or more audio signals.
20 . System comprising:
a server device; and
an electronic device in communication with the server device, the electronic device comprising a processor, a memory, and an interface, wherein the processor is configured to:
obtain one or more audio signals including a first audio signal;
determine one or more first sentiment metrics indicative of a first speaker state based on the first audio signal, the one or more first sentiment metrics including a first primary sentiment metric indicative of a primary sentiment state of the first speaker;
determine one or more first appearance metrics indicative of an appearance of the first speaker, the one or more first appearance metrics including a first primary appearance metric indicative of a primary appearance of the first speaker;
determine a first speaker representation based on the first primary sentiment metric and the first primary appearance metric; and
output, via the interface, the first speaker representation.
21 . System of claim 20 , wherein the processor is configured to receive the first speaker representation from the server device.
22 . System of claim 20 , wherein the server device is a cloud server.