IP Library › Granted Patent US 12,002,487
Granted Patent B2
US 12,002,487 · App. 17/430,755 · Granted Jun 4, 2024

Information processing apparatus and information processing method for selecting a character response to a user based on emotion and intimacy

Inventor: Hideo Nagasaka (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G10L25/63G06T7/20G06T13/40G10L13/00G10L15/1815G10L21/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,002,487
App. No.
17/430,755
Granted
Jun 4, 2024
Kind
B2
Abstract

Provided are an information processing apparatus, an information processing method, and a program that make it possible to assign more natural motions reflecting the emotions of a character. [Solving Means] The information processing apparatus includes a control unit configured to perform the processing of: determining an emotion on the basis of a result of utterance sentence analysis performed on an utterance sentence of a character included in a scenario; selecting, depending on a content of the utterance sentence and the emotion determined, a motion of the character that is synchronized with the utterance sentence; adjusting a character movement speed based on the selected motion and an intimacy between the character and a user; and adding, to the scenario, a description for adjusting presentation of the selected motion to match a voice output timing of the utterance sentence.

Claims (37)

1. An information processing apparatus, comprising:

circuitry configured to:

determine, based on a result of analysis of a first utterance sentence of a plurality of utterance sentences, a first emotion corresponding to the first utterance sentence of a character included in a scenarios;

select a response attitude pattern from a plurality of response attitude patterns, based on each of the determined first emotion and an intimacy between the character and a user, wherein each of the plurality of response attitude patterns is mapped with corresponding emotion levels and intimacy levels;

select, based on a content of the first utterance sentence and the determined first emotion, a first motion of a plurality of motions for the character that is synchronized with the first utterance sentence;

adjust a movement speed of the selected first motion based on the selected response attitude pattern; and

add, to the scenario, a description for adjustment of presentation of the selected first motion to match a voice output timing of the first utterance sentence.

2. The information processing apparatus according to claim 1 , wherein

the circuitry is further configured to select, based on a word from the first utterance sentence and a word class of the word, the first motion associated with the determined first emotion, and

the first motion is selected from emotion-based motions associated with the word.

3. The information processing apparatus according to claim 2 , wherein the circuitry is further configured to:

refer to a database of co-occurrence words corresponding to a plurality of emotions, and

determine an emotion corresponding to the word from the first utterance sentence as the first emotion of the character.

4. The information processing apparatus according to claim 3 , wherein the circuitry is further configured to:

analyze a tense of the first utterance sentence based on the result of analysis of the first utterance sentence, and

change, based on the tense, a degree of the first emotion corresponding to the word or the first emotion of the character.

5. The information processing apparatus according to claim 2 , wherein the circuitry is further configured to set, based on the word in the first utterance sentence, an utterance voice parameter to output the first utterance sentence as voice.

6. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to continue the determined first emotion until one of a specific time has elapsed or a second emotion is determined.

7. The information processing apparatus according to claim 6 , wherein

the circuitry is further configured to:

determine, based on a result of analysis of a second utterance sentence of the plurality of utterance sentences, the second emotion corresponding to the second utterance sentence; and

select, based on a content of the second utterance sentence and the determined second emotion, a second motion of the plurality of motions for the character that is synchronized with the second utterance sentence.

8. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to set, based on the first emotion, an utterance voice parameter that is used to output the first utterance sentence as voice.

9. The information processing apparatus according to claim 8 , wherein the circuitry is further configured to add, to the scenario, a description in which the utterance voice parameter is associated with the first utterance sentence.

10. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to reduce a degree of the first emotion, based on one of an elapsed time or a number of utterance sentences.

11. An information processing method, comprising:

determining, based on a result of analysis of a first utterance sentence of a plurality of utterance sentences, a first emotion corresponding to the first utterance sentence of a character included in a scenario;

selecting a response attitude pattern from a plurality of response attitude patterns, based on each of the determined first emotion and an intimacy between the character and a user, wherein each of the plurality of response attitude patterns is mapped with corresponding emotion levels and intimacy levels;

selecting, based on a content of the first utterance sentence and the determined first emotion, a first motion of a plurality of motions for the character that is synchronized with the first utterance sentence;

adjusting a movement speed of the selected first motion based on the selected response attitude; and

adding, to the scenario, a description for adjustment presentation of the selected first motion to match a voice output timing of the first utterance sentence.

12. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

determining, based on a result of analysis of a first utterance sentence of a plurality of utterance sentences, a first emotion corresponding to the first utterance sentence of a character included in a scenario;

selecting a response attitude pattern from a plurality of response attitude patterns, based on each of the determined first emotion and an intimacy between the character and a user, wherein each of the plurality of response attitude patterns is mapped with corresponding emotion levels and intimacy levels;

selecting, based on a content of the first utterance sentence and the determined first emotion, a first motion of a plurality of motions for the character that is synchronized with the first utterance sentence;

adjusting a movement speed of the selected first motion based on the selected response attitude pattern; and

adding, to the scenario, a description for adjustment presentation of the selected first motion to match a voice output timing of the first utterance sentence.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2021
From: NAGASAKA, HIDEO
To: SONY GROUP CORPORATION
Reel/Frame 057168/0302 →
Continuity (1)
Related Publication 20220165293A1 · May 26, 2022