IP Library Granted Patent US 12,671,851
Granted Patent B2
US 12,671,851 · App. 18/276,807 · Granted Jun 30, 2026

Information processing device, information processing method, and program

Inventors: Takuma Domae (Tokyo, JP); Junichi Tanaka (Tokyo, JP); Kazuharu Tanaka (Tokyo, JP); Masaaki Matsubara (Tokyo, JP); Yasunori Matsui (Tokyo, JP)
Assignees: SONY GROUP CORPORATION; Sony Interactive Entertainment Inc.
H04N21/23412G06T13/40G06T19/006G06V40/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,671,851
App. No.
18/276,807
Granted
Jun 30, 2026
Kind
B2
Abstract

An information processing device includes a control unit that performs control to output information regarding an image of a user viewpoint in a virtual space, in which the control unit performs control to switch a display corresponding to a performer included in the image between a live-action image generated based on a captured image of the performer and a character image corresponding to the performer, according to a result of detecting a state of at least one user in the virtual space or a state of the virtual space.

Claims (51)

1 . An information processing system comprising:

circuitry configured to

control to output information regarding an image generated for each user viewpoint of at least one user in a virtual space,

control to switch a display corresponding to a performer included in the image between a live-action image generated based on a captured image of the performer and a character image corresponding to the performer, according to a detection result of detecting at least one of a state of the at least one user in the virtual space or a state of the virtual space, and

control to switch the display corresponding to the performer included in the image of the user viewpoint for each individual user according to the detection result of detecting the state of each individual user.

2 . The information processing system according to claim 1 ,

wherein the state of at least one user in the virtual space is a state related to at least one user avatar participating in an event performed in the virtual space.

3 . The information processing system according to claim 1 ,

wherein the state of the virtual space is a specific state of an event performed in the virtual space.

4 . The information processing system according to claim 3 ,

wherein the specific state of the event is occurrence of a specific production or a specific time zone in a music.

5 . The information processing system according to claim 1 ,

wherein the circuitry switches the display corresponding to the performer to the live-action image or the character image in a case where at least one of the state of at least one user or the state of the virtual space satisfies a condition.

6 . The information processing system according to claim 1 ,

wherein the live-action image includes three-dimensional information of the performer, and

wherein the character image is an image of a three-dimensional character model that moves based on three-dimensional motion capture data of the performer.

7 . The information processing system according to claim 1 ,

wherein the circuitry performs control to output the information regarding the image of the user viewpoint in an event performed in real time in the virtual space or an event recorded in advance in the virtual space.

8 . The information processing system according to claim 1 ,

wherein the circuitry performs control to output the information regarding the image of the user viewpoint to a user terminal.

9 . The information processing system according to claim 1 ,

wherein the circuitry switches the display corresponding to the performer included in the image of the user viewpoint for all users in a uniform manner according to the detection result of detecting the state of the virtual space.

10 . The information processing system according to claim 1 ,

wherein the circuitry performs control to display and output the image of the user viewpoint in the virtual space on a display based on information received from a server that distributes information regarding the virtual space.

11 . The information processing system according to claim 10 ,

wherein the circuitry performs control to switch the display corresponding to the performer included in the image of the user viewpoint between the live-action image and the character image based on an operation instruction from the user.

12 . An information processing method executed by a processor, the information processing method comprising:

controlling to output information regarding an image generated for each user viewpoint of at least one user in a virtual space;

controlling to switch a display corresponding to a performer included in the image between a live-action image generated based on a captured image of the performer and a character image corresponding to the performer, according to a detection result of detecting at least one of a state of the at least one user in the virtual space or a state of the virtual space; and

controlling to switch the display corresponding to the performer included in the image of the user viewpoint for each individual user according to the detection result of detecting the state of each individual user.

13 . The information processing method according to claim 12 ,

wherein the state of at least one user in the virtual space is a state related to at least one user avatar participating in an event performed in the virtual space.

14 . The information processing method according to claim 12 ,

wherein the state of the virtual space is a specific state of an event performed in the virtual space.

15 . The information processing method according to claim 12 ,

wherein the circuitry switches the display corresponding to the performer to the live-action image or the character image in a case where at least one of the state of at least one user or the state of the virtual space satisfies a condition.

16 . The information processing method according to claim 12 ,

wherein the live-action image includes three-dimensional information of the performer, and

wherein the character image is an image of a three-dimensional character model that moves based on three-dimensional motion capture data of the performer.

17 . The information processing method according to claim 12 , further comprising:

controlling to output the information regarding the image of the user viewpoint in an event performed in real time in the virtual space or an event recorded in advance in the virtual space.

18 . The information processing method according to claim 12 , further comprising:

controlling to output the information regarding the image of the user viewpoint to a user terminal.

19 . The information processing method according to claim 12 , further comprising:

switching the display corresponding to the performer included in the image of the user viewpoint for all users in a uniform manner according to the detection result of detecting the state of the virtual space.

20 . The information processing method according to claim 12 , further comprising:

displaying and outputting the image of the user viewpoint in the virtual space on a display based on information received from a server that distributes information regarding the virtual space.

21 . A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

controlling to output information regarding an image generated for each user viewpoint of at least one user in a virtual space;

controlling to switch a display corresponding to a performer included in the image between a live-action image generated based on a captured image of the performer and a character image corresponding to the performer, according to a detection result of detecting at least one of a state of the at least one user in the virtual space or a state of the virtual space; and

controlling to switch the display corresponding to the performer included in the image of the user viewpoint for each individual user according to the detection result of detecting the state of each individual user.