IP Library Granted Patent US 11,145,219
Granted Patent B2
US 11,145,219 · App. 16/308,502 · Granted Oct 12, 2021

System and method for changing content based on user reaction

Inventors: Kiyoshi Yoshikawa (Saitama, JP); Naoya Sazuka (Tokyo, JP); Yoshihiro Wakita (Tokyo, JP)
Assignee: SONY CORPORATION
G09B19/00A61B5/021A61B5/024A61B5/0816A61B5/1104A61B5/163A61B5/4266A61B5/4803G09B7/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,145,219
App. No.
16/308,502
Granted
Oct 12, 2021
Kind
B2
Abstract

Provided is an information processing apparatus including a processing unit that presents content to a user on a basis of sensor information acquired by a sensor that detects reaction of the user to a stimulus given to the user.

Claims (53)

1. An information processing apparatus, comprising:

a sensor configured to:

detect a first reaction of a user to a stimulus given to the user; and

output first sensor information based on the detected first reaction of the user; and

a processing unit configured to acquire the first sensor information from the sensor, wherein the processing unit includes:

a model setting unit configured to:

specify a sense type of the user among a plurality of sense types based on the acquired first sensor information, wherein

each of the plurality of sense types represents a corresponding way of recognition of the stimulus by the user; and

set a user model of the user based on the specified sense type, wherein the user model represents the first reaction of the user to the stimulus; and

a presentation processing unit configured to control presentation of content to the user based on the set user model.

2. The information processing apparatus according to claim 1 , wherein the processing unit is further configured to control the presentation of the content to the user further based on a user characteristic.

3. The information processing apparatus according to claim 1 , wherein the sensor includes at least one of a biometric sensor configured to acquire biometric information of the user or an imaging device configured to capture an image of the user.

4. The information processing apparatus according to claim 1 , wherein the specified sense type includes at least one of a visual sense type, an auditory sense type, or a tactile sense type.

5. The information processing apparatus according to claim 1 , wherein the model setting unit is further configured to:

in a case where the plurality of sense types corresponds to the first reaction of the user, give weight to the plurality of sense types; and

set the user model of the user based on the weight to the plurality of sense types.

6. The information processing apparatus according to claim 1 , further comprising a storage unit configured to store a specific initial user model as the user model.

7. The information processing apparatus according to claim 1 , wherein

the presentation processing unit is further configured to control presentation of test content to the user, and

the model setting unit is further configured to:

evaluate the first reaction of the user based on the acquired first sensor information,

wherein the acquired first sensor information is based on the presentation of the test content; and

execute initial setting of the user model of the user based on the evaluation of the first reaction of the user.

8. The information processing apparatus according to claim 1 , wherein the model setting unit is further configured to:

acquire second sensor information from the sensor based on the presentation of the content to the user;

evaluate a second reaction of the user based on the acquired second sensor information; and

update the user model of the user based on the evaluation of the second reaction of the user.

9. The information processing apparatus according to claim 1 , wherein the presentation processing unit is further configured to:

set, based on the user model, stimulus information on an impression object of a plurality of objects included in the content, wherein

the impression object is for provision of an impression to the user; and

control presentation of the impression object based on the set stimulus information.

10. The information processing apparatus according to claim 9 , wherein the stimulus information is information to one of scale up or scale down the impression object.

11. The information processing apparatus according to claim 9 , wherein the stimulus information is information to blink the impression object.

12. The information processing apparatus according to claim 9 , wherein the stimulus information is information for addition of speech to the impression object to be displayed.

13. The information processing apparatus according to claim 9 , wherein the stimulus information is information for vibration of a specific equipment together with the presentation of the impression object.

14. The information processing apparatus according to claim 9 , wherein the presentation processing unit is further configured to change the stimulus information based on a degree of importance of the impression object.

15. An information processing method, comprising:

in an information processing apparatus that includes a sensor and a processing unit, wherein the processing unit includes a model setting unit and a presentation processing unit:

detecting, by the sensor, a reaction of a user to a stimulus given to the user;

outputting, by the sensor, sensor information based on the detected reaction of the user;

acquiring, by the processing unit, the sensor information from the sensor;

specifying, by the model setting unit, a sense type of the user among a plurality of sense types based on the acquired sensor information, wherein

each of the plurality of sense types represents a corresponding way of recognition of the stimulus by the user;

setting, by the model setting unit, a user model of the user based on the specified sense type, wherein the user model represents the reaction of the user to the stimulus; and

controlling, by the presentation processing unit, presentation of content to the user based on the set user model.

16. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by an information processing apparatus, cause the information processing apparatus to execute operations, the operations comprising:

detecting, by a sensor of the information processing apparatus, a reaction of a user to a stimulus given to the user;

outputting, by the sensor, sensor information based on the detected reaction of the user;

acquiring, by a processing unit of the information processing apparatus, the sensor information from the sensor;

specifying, by a model setting unit of the processing unit, a sense type of the user among a plurality of sense types based on the acquired sensor information, wherein

each of the plurality of sense types represents a corresponding way of recognition of the stimulus by the user;

setting, by the model setting unit, a user model of the user based on the specified sense type, wherein the user model represents the reaction of the user to the stimulus; and

controlling, by a presentation processing unit of the processing unit, presentation of content to the user based on the set user model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2018
From: YOSHIKAWA, KIYOSHI; SAZUKA, NAOYA; WAKITA, YOSHIHIRO
To: SONY CORPORATION
Reel/Frame 047758/0897 →
Priority Claims (1)
JP JP2016-124091 · Jun 23, 2016 · national
Continuity (1)
Related Publication 20200184843A1 · Jun 11, 2020