IP Library › Granted Patent US 11,551,645
Granted Patent B2
US 11,551,645 · App. 17/055,397 · Granted Jan 10, 2023

Information processing system, information processing method, and computer program

Inventors: Takashi Imamura (Tokyo, JP); Masashi Nakata (Kanagawa, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G09G5/37G06Q30/0269G06Q50/01G09G5/38G09G2340/0464G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,551,645
App. No.
17/055,397
Granted
Jan 10, 2023
Kind
B2
Abstract

A live streaming system 10 identifies, with regard to a plurality of users each wearing an HMD 100 to watch same content, types of emotions that the plurality of users are experiencing based on information associated with the plurality of users, the information being detected by a predetermined apparatus. The live streaming system 10 generates, as an image to be displayed on the HMD 100 of a certain user of the plurality of users, an image including the content and at least one of a plurality of avatars corresponding to the plurality of users. The live streaming system 10 changes display appearances of the plurality of avatars depending on the types of emotions that the plurality of users are experiencing.

Claims (32)

1. An information processing system, comprising:

an identification unit configured to identify, with regard to a plurality of users each wearing a head mounted display to watch same content, types of emotions that the plurality of users are experiencing based on information associated with the plurality of users, the information being detected by a predetermined apparatus; and

a generation unit configured to generate, as an image to be displayed on the head mounted display of a certain user of the plurality of users, an image including the content and at least one of a plurality of avatars corresponding to the plurality of users, wherein the generation unit changes display appearances of the plurality of avatars depending on the types of emotions of the plurality of users identified by the identification unit,

wherein the generation unit generates the image further including a predetermined effect in a case where a plurality of users experiencing a same type of emotion is equal to or more than a predetermined value, and

wherein the generation unit generates the image by moving and grouping together a plurality of avatars into a predetermined region if users corresponding to the plurality of avatars are experiencing the same type of emotion.

2. The information processing system according to claim 1 , wherein

the content includes an image of a predetermined event, and

the generation unit further generates, as an image to be presented to a performer of the event, an image in which the plurality of avatars corresponding to the plurality of users appear in appearances based on the emotions that the plurality of users are experiencing.

3. The information processing system according to claim 1 , further comprising:

a message acquisition unit configured to acquire a message transmitted from a certain user of the plurality of users; and

a message distribution unit configured to distribute the message acquired by the message acquisition unit to a user experiencing a certain type of emotion of the plurality of users.

4. The information processing system according to claim 1 , wherein

the generation unit generates the image further including information indicating a level of a certain type of emotion that the plurality of users are experiencing.

5. The information processing system according to claim 1 , wherein

the generation unit generates the image by moving and grouping together a second plurality of avatars into the certain region if second users corresponding to the second plurality of avatars are experiencing an second type of emotion opposite to the type of emotion.

6. An information processing system, comprising:

an identification unit configured to identify, with regard to a plurality of users each wearing a head mounted display to watch same content, types of emotions that the plurality of users are experiencing based on information associated with the plurality of users, the information being detected by a predetermined apparatus;

a detection unit configured to detect each of viewpoints of the plurality of users in the content based on a posture of the head mounted display worn by the corresponding users; and

a recording unit configured to record, with regard to each of the plurality of viewpoints in the content, information associated with the types of emotions that the users at the respective viewpoints have experienced; and

a display image generation unit for generating image data displaying statistical information regarding an amount of each of the types of the emotions that the users at the respective viewpoints have experienced,

wherein the generation unit generates the image by moving and grouping together a plurality of avatars into a predetermined region if users corresponding to the plurality of avatars are experiencing a same type of emotion.

7. An information processing method comprising, causing a computer or a plurality of computers to execute, in a distributed manner:

identifying, with regard to a plurality of users each wearing a head mounted display to watch same content, types of emotions that the plurality of users are experiencing based on information associated with the plurality of users, the information being detected by a predetermined apparatus; and

generating, as an image to be displayed on the head mounted display of a certain user of the plurality of users, an image including the content and at least one of a plurality of avatars corresponding to the plurality of users,

wherein the step of generating changes display appearances of the plurality of avatars depending on the types of emotions that the plurality of users are experiencing, wherein the step of generating further includes generating a predetermined effect in a case where a plurality of users experiencing a same type of emotion is equal to or more than a predetermined value, and

wherein the generation unit generates the image by moving and grouping together a plurality of avatars in a predetermined region if users corresponding to the plurality of avatars are experiencing the same type of emotion.

8. A non-transitory computer readable medium having stored thereon a computer program for a computer, comprising:

by an identification unit, identifying, with regard to a plurality of users each wearing a head mounted display to watch same content, types of emotions that the plurality of users are experiencing based on information associated with the plurality of users, the information being detected by a predetermined apparatus; and

by a generation unit, generating, as an image to be displayed on the head mounted display of a certain user of the plurality of users, an image including the content and at least one of a plurality of avatars corresponding to the plurality of users,

wherein the function of generating changes display appearances of the plurality of avatars depending on the types of emotions that the plurality of users are experiencing,

wherein the generation unit generates the image further including a predetermined effect in a case where a plurality of users experiencing a same type of emotion is equal to or more than a predetermined value, and

wherein the generation unit generates the image by moving and grouping together a plurality of avatars in a predetermined region if users corresponding to the plurality of avatars are experiencing the same type of emotion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2020
From: IMAMURA, TAKASHI; NAKATA, MASASHI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 054362/0729 →
Continuity (1)
Related Publication 20210158781A1 · May 27, 2021
Cited By (1)
US 12,439,097