IP Library › Granted Patent US 10,587,542
Granted Patent B2
US 10,587,542 · App. 15/769,653 · Granted Mar 10, 2020

Communication system and storage medium for transmitting physical expression information

Inventor: Keigo Ihara (Tokyo, JP)
Assignee: SONY CORPORATION
H04L51/046G06K9/00221H04L51/10H04M1/72552H04M1/72555
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,587,542
App. No.
15/769,653
Granted
Mar 10, 2020
Kind
B2
Abstract

[Object] To provide a communication system and a storage medium that are capable of transmitting physical expression information of a user via a versatile communication application. [Solution] The communication system includes: a control unit configured to execute a communication application for directly or indirectly transmitting and receiving text information to and from a communication destination; and a communication unit configured to directly or indirectly transmit text information acquired via the communication application, to a communication destination. The control unit activates a utility in response to a request from the communication application. The utility acquires sensor data detected by a sensor, extracts specific expression information from the sensor data, converts the specific expression information into text information, and outputs the text information to the communication application.

Claims (73)

1. A communication system, comprising:

a control unit configured to:

execute a communication application, wherein the communication application displays a message input screen at a specific time;

activate a utility at a time concurrent to the specific time at which the communication application displays the message input screen;

acquire sensor data from at least one sensor of a plurality of sensors based on the activation of the utility;

extract first user expression information from the sensor data;

convert the first user expression information into first text information based on an expression table, wherein

the expression table corresponds to a table for specific users, and

the specific users include a first user associated with the communication system and a second user associated with a communication destination; and

output the first text information to the communication application; and

a communication unit configured to:

receive the first text information from the communication application; and

transmit the first text information to the communication destination, wherein

after the transmission of the first text information to the communication destination, the control unit is further configured to display specific expression information based on reception of a message from the communication destination within a fixed period of time,

the specific expression information indicates that the first user expression information and second user expression information are same,

the second user expression information is associated with the message,

the message comprises second text information including a natural language and a specific code,

the specific expression information comprises information, and

the information indicates that a feeling associated with the first user is same as a feeling associated with the second user.

2. The communication system according to claim 1 , wherein

the control unit is further configured to activate the utility at a time of selection of a leading path to the utility, and

the leading path to the utility is displayed on the message input screen of the communication application.

3. The communication system according to claim 1 , wherein

the control unit is further configured to acquire, via the communication unit, a latest expression table, and

the latest expression table is stored in an external server.

4. The communication system according to claim 1 ,

wherein the expression table includes one of versatile love expression information or limited love expression information based on the specific users.

5. The communication system according to claim 1 ,

wherein the first text information comprises the natural language and the specific code.

6. The communication system according to claim 1 ,

wherein the control unit is further configured to detect at least one of a blow on a user device, a clutch of hand on the user device, a press on the user device, or a user hand wave as the first user expression information.

7. The communication system according to claim 1 , further comprising a display screen, wherein

the communication application receives the message from the communication destination, and

the control unit is further configured to:

extract the specific code from the received message;

convert the specific code into the second user expression information; and

display the second user expression information on the display screen.

8. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

executing a communication application, wherein the communication application displays a message input screen at a specific time;

activating a utility at a time concurrent to the specific time at which the communication application displays the message input screen;

acquiring sensor data from at least one sensor of a plurality of sensors based on the activation of the utility;

extracting first user expression information from the sensor data;

converting the first user expression information into first text information based on an expression table, wherein

the expression table corresponds to a table for specific users, and

the specific users include a first user associated with a communication system, and a second user associated with a communication destination;

outputting the first text information to the communication application;

receiving the first text information from the communication application;

transmitting the first text information to the communication destination; and

after transmitting the first text information to the communication destination, displaying specific expression information based on reception of a message from the communication destination within a fixed period of time, wherein

the specific expression information indicates that the first user expression information and second user expression information are same,

the second user expression information is associated with the message,

the message comprises second text information including a natural language and a specific code,

the specific expression information comprises information, and

the information indicates that a feeling associated with the first user is same as a feeling associated with the second user.

9. A communication system, comprising:

a control unit configured to:

receive a request from a communication application based on execution of the communication application;

acquire sensor data from at least one sensor of a plurality of sensors based on the received request;

extract first user expression information from the sensor data;

convert the first user expression information into first text information based on an expression table, wherein

the expression table corresponds to a table for specific users, and

the specific users include a first user associated with the communication system, and a second user associated with a communication destination; and

output the first text information to the communication application; and

a communication unit configured to:

receive the first text information from the communication application; and

transmit the first text information to the communication destination, wherein

the communication application receives a message from the communication destination,

after the transmission of the first text information to the communication destination, the control unit is further configured to display specific expression information based on the message received within a fixed period of time,

the specific expression information indicates that the first user expression information and second user expression information are same,

the second user expression information is associated with the message,

the message comprises second text information including a natural language and a specific code,

the specific expression information comprises information, and

the information indicates a feeling associated with the first user is same as a feeling associated with the second user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2018
From: IHARA, KEIGO
To: SONY CORPORATION
Reel/Frame 045591/0941 →
Priority Claims (1)
JP 2015-222866 · Nov 13, 2015 · national
Continuity (1)
Related Publication 20180309703A1 · Oct 25, 2018