Granted Patent B2

US 12,376,774 · App. 17/688,825 · Granted Aug 5, 2025

Inventors: Kenji Makino (Saitama, JP); Masahiro Terada (Saitama, JP); Daisuke Hayashi (Saitama, JP); Shunta Ego (Saitama, JP)

Assignee: FUJIFILM Corporation

A61B5/165A61B5/0077A61B5/4803A61B5/7267G06Q30/0201G06V40/166G06V40/175G10L25/63A61B2576/02

Abstract

Claims (78)

1. An information processing system comprising:

a memory; and

a processor configured to:

capture a time series of images of each person of a plurality of people in a first area;

measure an index of emotion of each person of the plurality of people in the first area based on the time series of images;

create a heat map representing the measured index of emotion of each person of the plurality of people in the first area in association with a position of each person of the plurality of people in the first area;

estimate an emotion transmission ability of each person of the plurality of people in the first area based on the heat map;

register and store the estimated emotion transmission ability of each person of the plurality of people in the first area in the memory;

receive information on a target person to be placed in a second area;

acquire information on emotion transmission abilities of a plurality of registered people placed in the second area from the memory; and

decide placement of the target person in the second area based on the information on the emotion transmission abilities of the plurality of registered people placed in the second area.

2. The information processing system according to claim 1 ,

wherein the processor is further configured to:

for each person of the plurality of people in the first area,

measure emotion of the person in the first area, and

calculate the index of emotion of the person in the first area based on a measurement result of emotion of the person in the first area.

3. The information processing system according to claim 2 ,

wherein the processor is further configured to, for each person of the plurality of people in the first area, calculate the index of emotion of the person in the first area based on the measurement result of emotion of the person in the first area as at least one of a level of emotion or amplitude of emotion of the person in the first area.

4. The information processing system according to claim 2 ,

wherein the processor is further configured to:

for each person of the plurality of people in the first area,

detect a face of the person in the first area from the captured time series of images, and

measure emotion of the person in the first area based on an image of the detected face of the person in the first area.

5. The information processing system according to claim 2 ,

wherein the processor is further configured to:

for each person of the plurality of people in the first area,

receive biological information of the person in the first area, and

calculate the index of emotion of the person in the first area based on the received biological information of the person in the first area.

6. The information processing system according to claim 2 ,

wherein the processor is further configured to:

for each person of the plurality of people in the first area,

receive information on voice uttered by the person in the first area, and

calculate the index of emotion of the person in the first area based on the received information on the voice uttered by the person in the first area.

7. The information processing system according to claim 2 ,

wherein the processor is further configured to:

for each person of the plurality of people in the first area,

receive information on vibration of the person in the first area, and

calculate the index of emotion of the person in the first area based on the received information of vibration of the person in the first area.

8. The information processing system according to claim 1 ,

wherein the processor is further configured to estimate, as the emotion transmission ability, at least one of a first ability, which is an ability to give emotion to surroundings, or a second ability, which is an ability to accept emotion of surroundings.

9. The information processing system according to claim 1 ,

wherein the processor is further configured to extract a region in which the index of emotion of the plurality of people in the first area is equal to or more than a threshold value from the map data, obtain a centroid of the extracted region, and estimate the first ability of each person of the plurality of people in the first area in the extracted region.

10. The information processing system according to claim 9 ,

wherein the processor is further configured to calculate a sum of the indexes of emotion of all the plurality of people in the first area in the extracted region from the heat map, and estimate a degree of the ability of a person positioned at the centroid of the extracted region.

11. The information processing system according to claim 8 ,

wherein the processor is further configured to, based on the heat map, obtain a sum of indexes of emotion of all the plurality of people in the first area positioned within a predetermined distance from a person in the first area for each person of the plurality of people in the first area.

12. The information processing system according to claim 8 ,

wherein the processor is further configured to estimate the second ability of each person of the plurality of people in the first area based on the heat map.

13. The information processing system according to claim 12 ,

wherein the processor is further configured to obtain a propagation rate of the index of emotion from the heat map, and estimate a degree of the second ability of the person in the first area.

14. The information processing system according to claim 1 ,

wherein the processor is further configured to receive attribute information of each person of the plurality of people in the first area, and

the memory further stores the received attribute information of each person of the plurality of people in the first area.

15. The information processing system according to claim 1 ,

wherein the processor is further configured to estimate the emotion transmission ability of a person whose information is not stored in the memory, based on the estimated emotion transmission ability of each person of the plurality of people in the first area.

16. The information processing system according to claim 15 ,

wherein the processor is further configured to estimate the emotion transmission ability of the person whose information is not stored in the memory by using a discrimination model generated by machine learning.

17. The information processing system according to claim 16 ,

wherein the processor is further configured to estimate the emotion transmission ability of the person whose information is not stored in the memory by using the discrimination model generated by machine learning using the estimated emotion transmission ability of each person of the plurality of people in the first area stored in the memory.

18. The information processing system according to claim 1 ,

wherein the processor is further configured to, based on the information on the emotion transmission ability of each of the registered people placed in the second area, simulate a change of an index of emotion of the target person placed in the second area, obtain placement based on the index of emotion of the target person placed in the second area, and decide the placement of the target person in the second area, in the decision of the placement of the target person in the second area.

19. The information processing system according to claim 18 ,

wherein the processor is further configured to:

extract a person having a highest emotion transmission ability from among the plurality of registered people placed in the second area, and

decide the placement of the target person in the second area by adding the extracted person in the decision of the placement of the target person in the second area.

20. The information processing system according to claim 1 ,

wherein the processor is further configured to

receive a request for placement from the target person placed in the second area, and

decide the placement of the target person in the second area based on the request in the decision of the placement of the target person in the second area.

21. An information processing method comprising:

capturing a time series of images of each person of a plurality of people in a first area;

measuring an index of emotion of each person of the plurality of people in the first area based on the time series of images;

creating a heat map representing the measured index of emotion of each person of the plurality of people in the first area in association with a position of each person of the plurality of people in the first area;

estimating an emotion transmission ability of each person of the plurality of people in the first area based on the heat map;

registering and storing the estimated emotion transmission ability of each person of the plurality of people in the first area in a memory;

receiving information on a target person to be placed in a second area;

acquiring information on emotion transmission abilities of a plurality of registered people placed in the second area from the memory; and

deciding placement of the target person in the second area based on the information on the emotion transmission abilities of the plurality of registered people placed in the second area.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (33)