IP Library Granted Patent US 11,354,511
Granted Patent B2
US 11,354,511 · App. 16/623,508 · Granted Jun 7, 2022

Information processing device, information processing method, and recording medium

Inventor: Atsushi Negishi (Tokyo, JP)
Assignee: SONY CORPORATION
G06F40/30G06F40/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,511
App. No.
16/623,508
Granted
Jun 7, 2022
Kind
B2
Abstract

Provided is an information processing device including a control section that recognizes an intention of a first action subject on a basis of an action performed by the first action subject in a first context, generates information indicating the intention of the first action subject in a second context of the second action subject, and causes the information to be outputted to the second action subject. The first action subject is one of a user or a communication target of the user. The second action subject is another of the user or the communication target of the user.

Claims (63)

1. A first information processing device, comprising:

circuitry configured to:

recognize an intention of a first action subject based on a first message expressed by the first action subject in a first context, wherein the first message is in a first language;

convert the first message in the first language into a second message in a second language, wherein

the second message is in a second context of a second action subject, and

the first language is different from the second language;

convert first meta-information of the first message into second meta-information of the second message, wherein the first meta-information indicates at least one of a speaking speed or a voice volume;

generate first information indicating the intention of the first action subject in the second context of the second action subject, based on the conversion of the first message and the conversion of the first meta-information of the first message; and

control output of the first information to the second action subject, wherein

the first action subject is a first user, and

the second action subject is a communication target of the first user.

2. The first information processing device according to claim 1 , wherein the communication target is a second user.

3. The first information processing device according to claim 2 , wherein

the first message expressed by the first action subject is in a spoken language, and

the second message is a moving image of an avatar performing a sign language gesture corresponding to the first message.

4. The first information processing device according to claim 2 , wherein

the first message expressed by the first action subject is in a spoken language,

the second message is a moving image of a hand performing a sign language gesture corresponding to the first message,

the sign language gesture is superimposed and displayed on an image of the first action subject in an augmented reality (AR) manner, and

the image of the first action subject is displayed on a transmissive display.

5. The first information processing device according to claim 2 , wherein the circuitry is further configured to execute the conversion of the first message for each word of a plurality of words in the first message.

6. The first information processing device according to claim 2 , wherein the circuitry is further configured to output, to the first user, second information indicating a chronological relationship of communication performed between a plurality of communication targets of the first user.

7. The first information processing device according to claim 1 , wherein the second meta-information of the second message indicates at least one of a gesture speed or a gesture size.

8. The first information processing device according to claim 1 , wherein

the communication target is a second user,

the first context and the second context are different in prerequisite knowledge,

the circuitry is further configured to convert the first message, expressed based on first prerequisite knowledge, into the second message having supplemental information added thereto, and

the supplemental information causes the first message to be understood in second prerequisite knowledge.

9. The first information processing device according to claim 1 , wherein

the communication target is a second user, and

the circuitry is further configured to:

transmit second information indicating a result of the recognition of the intention of the first user to a second information processing device;

generate third information indicating an intention of the second user in the first context, based on fourth information from the second information processing device, wherein the fourth information indicates a result of recognition of the intention of the second user; and

control output of the third information to the first user.

10. The first information processing device according to claim 1 , wherein

the communication target is a device of a plurality of devices,

the intention is an action that the first user intends the device to perform, and

the circuitry is further configured to:

generate a control command to control the device to perform the action, and

output the control command to the device.

11. The first information processing device according to claim 10 , wherein the circuitry is further configured to establish a communication path between the plurality of devices.

12. The first information processing device according to claim 1 , wherein the circuitry is further configured to recognize at least one of the first context, the second context, or an action performed by the first action subject, based on second information sensed by a device worn by the first user.

13. The first information processing device according to claim 1 , wherein the circuitry is further configured to control a device, worn by the first user, to output the first information to the second action subject.

14. An information processing method, comprising:

recognizing an intention of a first action subject based on a first message expressed by the first action subject in a first context, wherein the first message is in a first language;

converting the first message in the first language into a second message in a second language, wherein

the second message is in a second context of a second action subject, and

the first language is different from the second language; and

converting first meta-information of the first message into second meta-information of the second message, wherein the first meta-information comprises at least one of a speaking speed or a voice volume;

generating information indicating the intention of the first action subject in the second context of the second action subject, based on the conversion of the first message and the conversion of the first meta-information of the first message; and

controlling an output device to output the information to the second action subject, wherein

the first action subject is a user, and

the second action subject is a communication target of the user.

15. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

recognizing an intention of a first action subject based on a first message expressed by the first action subject in a first context, wherein the first message is in a first language;

converting the first message in the first language into a second message in a second language, wherein

the second message is in a second context of a second action subject, and

the first language is different from the second language; and

converting first meta-information of the first message into second meta-information of the second message, wherein the first meta-information comprises at least one of a speaking speed or a voice volume;

generating information indicating the intention of the first action subject in the second context of the second action subject based on the conversion of the first message and the conversion of the first meta-information of the first message; and

controlling output of the information to the second action subject, wherein

the first action subject is a user, and

the second action subject is a communication target of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2020
From: NEGISHI, ATSUSHI
To: SONY CORPORATION
Reel/Frame 051965/0867 →
Priority Claims (1)
JP JP2017-123953 · Jun 26, 2017 · national
Continuity (1)
Related Publication 20210150145A1 · May 20, 2021