IP Library Granted Patent US 10,852,813
Granted Patent B2
US 10,852,813 · App. 16/074,666 · Granted Dec 1, 2020

Information processing system, client terminal, information processing method, and recording medium

Inventor: Atsushi Shionozaki (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/01G06F3/011G06F16/00G06Q30/0631G10L17/22G06F2203/011G10L13/10G10L25/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,852,813
App. No.
16/074,666
Granted
Dec 1, 2020
Kind
B2
Abstract

To provide an information processing system, a client terminal, an information processing method, and a recording medium capable of selecting an appropriate agent from among multiple agents according to a user emotion, and providing more comfortable dialogue. An information processing system including: a storage section that holds a plurality of agent programs with different attributes; a communication section that provides an agent service by the agent programs to a client terminal of a user; and a control section that selects, from among the plurality of agent programs, one agent program suited to an emotion of a user who can use the agent service.

Claims (121)

1. An information processing system, comprising:

a storage section configured to:

store a plurality of agents associated with a plurality of attributes; and

store phoneme data corresponding to each of the plurality of agents;

a communication section configured to receive user-related information from a client terminal of a user; and

a control section configured to:

determine an emotion of the user based on the received user-related information;

select, from the plurality of agents, a first agent based on the determined emotion of the user;

execute, based on the stored phoneme data corresponding to the selected first agent, a first dialogue process between the selected first agent and the user; and

provide an agent service to the client terminal of the user based on the execution of the first dialogue process.

2. The information processing system according to claim 1 , wherein the control section is further configured to:

detect a change in the determined emotion of the user during the execution of the first dialogue process;

switch to a second agent of the plurality of agents based on the detected change in the determined emotion of the user change;

execute a second dialogue process between the second agent and the user; and

provide the agent service to the client terminal of the user based on the execution of the second dialogue process.

3. The information processing system according to claim 1 , wherein the control section is further configured to execute the first dialogue process based on information indicating that the user owns a usage right for the selected first agent.

4. The information processing system according to claim 3 , wherein the control section is further configured to:

acquire a user feedback associated with the agent service provided to the client terminal; and

store, in the storage section, preference information of the user based on the acquired user feedback.

5. The information processing system according to claim 4 , wherein the control section is further configured to select, from the plurality of agents, the first agent based on the stored preference information.

6. The information processing system according to claim 4 , wherein the acquired user feedback is input through one of text or speech by the user on the client terminal.

7. The information processing system according to claim 4 , wherein

the acquired user feedback is at least one of biological information, speech information, a captured image, or action information of the user,

sensor detects the at least one of the biological information, the speech information, the captured image, or the action information, and

the sensor transmits the detected at least one of the biological information, the speech information, the captured image, or the action information to the client terminal.

8. The information processing system according to claim 4 , wherein

the acquired user feedback is emotion information based on at least one of biological information, speech information, a captured image, or action information of the user,

a sensor detects the at least one of the biological information, the speech information, the captured image, or the action information, and the sensor transmits the detected at least one of the biological information, the speech information, the captured image, or the action information to the client terminal.

9. The information processing system according to claim 1 , wherein

the control section is further configured to issue, in a case where the user does not own a usage right for the selected first agent, a notification for encouragement of the user to purchase the selected first agent.

10. The information processing system according to claim 1 , wherein

the storage section is further configured to store applicable user emotion information for each of the plurality of agents, and

the control section is further configured to select, from the plurality of agents, the first agent based on the stored applicable user emotion information.

11. The information processing system according to claim 1 , wherein the control section is further configured to:

receive, from the client terminal, biological information of the user; and

determine the emotion of the user based on the biological information of the user.

12. The information processing system according to claim 1 , wherein

the client terminal estimates the emotion of the user based on biological information of the user, and

the control section is further configured to receive the estimated emotion of the user as the user-related information, from the client terminal.

13. A client terminal, comprising:

a communication section; and

a control section configured to:

control the communication section to transmit user-related information to a server,

wherein the server:

stores a plurality of agents associated with a plurality of attributes,

stores phoneme data corresponding to each of the plurality of agents,

determines an emotion of a user of the client terminal based on the user-related information,

selects a first agent from the plurality of agents based on the determined emotion of the user, and

executes, based on the stored phoneme data corresponding to the selected first agent, a first dialogue process between the selected first agent and the user; and

control the communication section to receive, from the server, a first dialogue corresponding to an agent service, wherein

the first dialogue is received based on the execution of the first dialogue process, and

the agent service is associated with the selected first agent.

14. The client terminal according to claim 13 , wherein the control section is further configured to control the communication section to continually transmit the user-related information,

the server detects a change in the determined emotion of the user during the execution of the first dialogue process,

the server switches to a second agent of the plurality of agents based on the detected change in the determined emotion of the user,

the server executes a second dialogue process between the second agent and the user,

the control section is further configured to control the communication section to receive a second dialogue from the server, and

the second dialogue is received based on the execution of the second dialogue process.

15. The client terminal according to claim 13 , wherein

the control section is further configured to control the communication section to receive the agent service, and

the agent service is received based on information indicating that the user owns a usage right for the selected first agent.

16. The client terminal according to claim 13 , wherein

the control section is further configured to control the communication section to transmit feedback of the user to the server and

the feedback is associated with the agent service.

17. The client terminal according to claim 16 , wherein the transmitted feedback is input through one of text or speech on the client terminal by the user.

18. The client terminal according to claim 16 , wherein

a sensor detects biological information of the user,

the control section is further configured to control the communication section to receive the biological information of the user from the sensor, and

the transmitted feedback corresponds to the biological information of the user.

19. The client terminal according to claim 18 , wherein

the transmitted feedback corresponds to emotion information, and

the emotion information is based on the biological information of the user.

20. The client terminal according to claim 13 , wherein

the control section is further configured to control, in a case where the user does not own a usage right for the selected first agent, the communication section to receive a notification for encouragement of the user to purchase the selected first agent.

21. The client terminal according to claim 13 , wherein

a sensor detects biological information of the user, and

the control section is further configured to control the communication section to:

receive the biological information of the user from the sensor, and transmit, to the server, the biological information of the user as the user-related information.

22. The client terminal according to claim 13 , wherein

a sensor detects biological information of the user, and

the control section is further configured to:

control the communication section to receive the biological information of the user from the sensor;

estimate the emotion of the user based on the biological information of the user; and

control the communication section to transmit, to the server, the estimated emotion of the user as the user-related information.

23. An information processing system, comprising:

a storage section configured to:

store a plurality of agents associated with a plurality of attributes; and

store phoneme data corresponding to each of the plurality of agents; a control section configured to:

receive user-related information from a client terminal of a user;

determine an emotion of the user based on the received user-related information;

select an agent from the plurality of agents based on the determined emotion of the user; and

execute, based on the stored phoneme data corresponding to the selected agent, a dialogue process between the selected agent and the user; and

an interface section configured to provide a specific agent service to the client terminal of the user based on the execution of the dialogue process.

24. An information processing method, comprising:

in an information processing system:

storing, by a storage section of the information processing system, a plurality of agents associated with a plurality of attributes;

storing, by the storage section, phoneme data corresponding to each of the plurality of agents;

receiving, by a communication section of the information processing system, user-related information from a client terminal of a user;

determining, by a control section of the information processing system, an emotion of the user based on the received user-related information;

selecting, by the control section, an agent from the plurality of agents based on the determined emotion of the user;

executing, by the control section, a dialogue process between the selected agent and the user, based on the stored phoneme data corresponding to the selected agent; and

providing, by the control section, a specific agent service to the client terminal of the user based on the execution of the dialogue process.

25. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a client terminal, cause the client terminal to execute operations, the operations comprising:

controlling, by a control section of the client terminal, a communication section of the client terminal to transmit user-related information to a server,

wherein the server:

stores a plurality of agents associated with a plurality of attributes,

stores phoneme data corresponding to each of the plurality of agents,

determines an emotion of a user of the client terminal based on the user-related information,

select an agent from the plurality of agents based on the determined emotion of the user, and

execute, based on the stored phoneme data corresponding to the selected agent, a dialogue process between the selected agent and the user; and

controlling, by the control section, the communication section to receive a dialogue from the server, wherein

the dialogue is received based on the execution of the dialogue process, and

the dialogue corresponds to a specific agent service associated with the selected agent.

26. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by an information processing system, cause the information processing system to execute operations, the operations comprising:

storing, by a storage section of the information processing system, a plurality of agents associated with a plurality of attributes;

storing, by the storage section, phoneme data corresponding to each of the plurality of agents;

receiving, by a control section of the information processing system, user-related information from a client terminal of a user;

determining, by the control section, an emotion of the user based on the received user-related information;

selecting, by the control section, an agent from the plurality of agents based on the determined emotion of the user;

executing, by the control section, a dialogue process between the selected agent and the user, based on the stored phoneme data corresponding to the selected agent; and

providing, by an interface section of the information processing system, a specific agent service to the client terminal of the user based on the execution of the dialogue process.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2018
From: SHIONOZAKI, ATSUSHI
To: SONY CORPORATION
Reel/Frame 046528/0322 →
Priority Claims (1)
JP 2016-035543 · Feb 26, 2016 · national
Continuity (1)
Related Publication 20190033957A1 · Jan 31, 2019