IP Library › Granted Patent US 12,058,401
Granted Patent B2
US 12,058,401 · App. 17/791,109 · Granted Aug 6, 2024

Information processing system, information processing method, and program

Inventor: Shunichi Homma (Saitama, JP)
Assignee: SONY GROUP CORPORATION
H04N21/4312H04N21/44218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,058,401
App. No.
17/791,109
Granted
Aug 6, 2024
Kind
B2
Abstract

An information processing system includes a controller. The controller acquires viewing state information together with viewer identification information from terminals of a plurality of viewers that are reproducing content in which a performance of a performer is imaged via a network in real time, the viewing state information indicating a line of sight or a position of each viewer in a coordinate system of a space where the viewer is present, the viewer identification information identifying the viewer. Further, the controller adds an effect to the content for each of the viewers on the basis of the acquired viewing state information.

Claims (36)

1. An information processing system, comprising

a controller configured to

acquire viewing state information together with viewer identification information from terminals of a plurality of viewers that are reproducing content in which a performance of a performer is imaged via a network in real time, the viewing state information indicating a line of sight or a position of each viewer in a coordinate system of a space where the viewer is present, the viewer identification information identifying the viewer, and

add an effect to the content for one or more of the plurality viewers based on the acquired viewing state information,

wherein the controller adds the effect in response to an effect adding request including effect identification information indicating an attribute of the effect, the effect adding request being received from the terminal of at least one viewer among the plurality of viewers, and

wherein the controller is implemented via at least one processor.

2. The information processing system according to claim 1 ,

wherein the controller is further configured to acquire attribute information indicating an attribute of the viewer together with the viewing state information and changes the effect in accordance with the attribute information.

3. The information processing system according to claim 1 ,

wherein the controller is further configured to calculate, when the effect is added to a first viewer of the plurality of viewers, coordinates of an intersection between a virtual plane set in the coordinate system of the space and the line of sight of a second viewer different from the first viewer, and

wherein the controller adds the effect at a position corresponding to the coordinates of the intersection in the content.

4. The information processing system according to claim 3 ,

wherein the controller is further configured to set the virtual plane behind a viewing position of the first viewer in the coordinate system of the space.

5. The information processing system according to claim 3 ,

wherein the controller is further configured to set a lower resolution for each effect corresponding to the second viewer as the number of the second viewers increases.

6. The information processing system according to claim 3 ,

wherein the controller is further configured to change, if the coordinates of the intersection with the line of sight of the second viewer are outside of a viewing cone in the coordinate system of the first viewer, an adding position of the effect within the viewing cone.

7. The information processing system according to claim 1 ,

wherein the controller adds the effect for each of the plurality of viewers at a position corresponding to coordinates of an intersection distant from each viewer in two intersections between a region set to be centered at a position of the performer in the coordinate system of the space where the performer is present and the line of sight of each of the plurality of viewers.

8. The information processing system according to claim 1 ,

wherein the controller is further configured to set, when the attribute indicated by the effect identification information is a planar effect, a predetermined plane for each viewer behind the performer in the coordinate system of the space where the performer is present and on the line of sight of each viewer, and

wherein the controller adds the effect on the predetermined plane.

9. The information processing system according to claim 1 ,

wherein, when the effect is added to a first viewer of the plurality of viewers, the controller adds the effect only in response to the effect adding request received from a second viewer having a line of sight or a position within a predetermined distance of the line of sight or a position of the first viewer, among the effect adding requests of the plurality of viewers.

10. The information processing system according to claim 1 ,

wherein the controller is further configured to

acquire information indicating the number of terminals of the viewers, the terminals being reproducing the content, and

increase effectiveness of the added effect in accordance with the number.

11. An information processing method, comprising:

acquiring viewing state information together with viewer identification information from terminals of a plurality of viewers that are reproducing content in which a performance of a performer is imaged via a network in real time, the viewing state information indicating a line of sight or a position of each viewer in a coordinate system of a space where the viewer is present, the viewer identification information identifying the viewer; and

adding an effect to the content for one or more of the plurality viewers based on the acquired viewing state information,

wherein the effect is added in response to an effect adding request including effect identification information indicating an attribute of the effect, the effect adding request being received from the terminal of at least one viewer among the plurality of viewers.

12. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by an information processing apparatus of a computer causes the information processing apparatus to execute the steps of a method, the method comprising:

acquiring viewing state information together with viewer identification information from terminals of a plurality of viewers that are reproducing content in which a performance of a performer is imaged via a network in real time, the viewing state information indicating a line of sight or a position of each viewer in a coordinate system of a space where the viewer is present, the viewer identification information identifying the viewer; and

adding an effect to the content for one or more of the plurality viewers based on the acquired viewing state information,

wherein the effect is added in response to an effect adding request including effect identification information indicating an attribute of the effect, the effect adding request being received from the terminal of at least one viewer among the plurality of viewers.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2022
From: HOMMA, SHUNICHI
To: SONY GROUP CORPORATION
Reel/Frame 060413/0136 →
Priority Claims (1)
JP 2020-021121 · Feb 12, 2020 · national
Continuity (1)
Related Publication 20230037102A1 · Feb 2, 2023
Cited By (1)
US 12,439,097