IP Library Granted Patent US 12,518,458
Granted Patent B2
US 12,518,458 · App. 18/601,454 · Granted Jan 6, 2026

Information processing system, information processing method, and computer program

Inventors: Ryo Yabe (Tokyo, JP); Shuhei Asada (Tokyo, JP); Ken Watanabe (Kanagawa, JP)
Assignee: GREE HOLDINGS, INC.
G06T13/40G06T13/80H04N21/4312H04N21/4781
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,518,458
App. No.
18/601,454
Granted
Jan 6, 2026
Kind
B2
Abstract

A first video generator generates first information for displaying, as a first video, a character object of a first user and a first object. A second video generator displays the first object and a third object different from the second object. An association portion associates the character object of the first user with a fourth object associated with the third object when the character object of the first user and the third object have a predetermined relationship. The second video generator displays the fourth object in association with the character object of the first user when the fourth object is associated with the character object of the first user by the association portion.

Claims (86)

1 . An information processing system comprising:

one or more computer processors functioning as:

a transmitter that transmits, to a second user terminal of a second user, information about a video including a character object of a first user;

a movement operation receiver that accepts a movement operation of the character object of the first user in a virtual space;

a virtual camera controller that accepts an operation of a virtual camera that captures images in the virtual space; and

a video generator that, based on the movement operation and the operation of the virtual camera, generates information about a video of the character object of the first user moving within the virtual space, wherein

the virtual camera controller accepts the operation of the virtual camera from a user authorized by the first user, and

the operation of the virtual camera is a user operation different from the movement operation, and wherein

the one or more computer processors

apply a first movement operation to the character object of the first user in response to a predetermined operation with respect to a first operation UI displayed at a first user terminal of the first user,

apply a second movement operation to the character object of the first user in response to a predetermined operation with respect to a second operation UI displayed at the first user terminal,

switch a viewpoint of the virtual camera to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation with respect to a third operation UI displayed at the first user terminal, and

apply a movement operation, a rotation operation and/or a scale operation of the virtual camera in response to a predetermined operation with respect to a region where the first operation UI, the second operation UI, and the third operation UI are not displayed, at the first user terminal.

2 . The information processing system according to claim 1 , wherein

the one or more computer processors switch whether or not to display a comment on the video displayed on the first user terminal of the first user in response to a predetermined operation with respect to the first user terminal.

3 . The information processing system according to claim 1 , wherein

the one or more computer processors switch whether or not to display a comment on the video displayed on the first user terminal in response to a predetermined operation with respect to the first user terminal, and

when the one or more computer processors switch whether or not to display the comment on the video, the one or more computer processors change display positions of the first operation UI and the second operation UI, or place the first operation UI, the second operation UI and the third operation UI in a non-display state.

4 . The information processing system according to claim 1 , wherein

the first movement operation is a horizontal movement, and the second movement operation is a vertical movement.

5 . The information processing system according to claim 1 , wherein the one or more computer processors

apply a rotation operation to the virtual camera in response to a one-finger swipe operation with respect to the region,

apply a movement operation to the virtual camera in response to a two-finger swipe operation with respect to the region, and

apply a scale operation to the virtual camera in response to a two-finger pinch-in/pinch-out operation with respect to the region.

6 . The information processing system according to claim 1 , wherein

a movement of a face of the character object of the first user is generated based on a movement of a face of the first user captured by a front camera of the first user terminal of the first user, and

the video generator generates the movement of the face of the character object of the first user in an inverted state or a non-inverted state according to a positional relationship between the character object of the first user and the virtual camera.

7 . The information processing system according to claim 1 , wherein

when the character object of the first user moves beyond a movable region, the video generator causes the character object to reappear from another position in the virtual space.

8 . An information processing method by one or more computer processors, the method comprising:

transmitting, to a second user terminal of a second user, information about a video including a character object of a first user;

accepting a movement operation of the character object of the first user in a virtual space;

accepting an operation of a virtual camera that captures images in the virtual space; and

based on the movement operation and the operation of the virtual camera, generating information about a video of the character object of the first user moving within the virtual space, wherein

the operation of the virtual camera is accepted from a user authorized by the first user, and

the operation of the virtual camera is a user operation different from the movement operation, and wherein

a first movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a first operation UI displayed at a first user terminal of the first user,

a second movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a second operation UI displayed at the first user terminal,

a viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation with respect to a third operation UI displayed at the first user terminal, and

a movement operation, a rotation operation and/or a scale operation of the virtual camera is applied in response to a predetermined operation with respect to a region where the first operation UI, the second operation UI, and the third operation UI are not displayed, at the first user terminal.

9 . An information processing method by one or more computer processors, the method comprising:

transmitting, to a server, information about a video including a character object of a first user;

accepting a movement operation of the character object of the first user in a virtual space;

accepting an operation of a virtual camera that captures images in the virtual space; and

based on the movement operation and the operation of the virtual camera, generating information about a video of the character object of the first user moving within the virtual space, wherein

the operation of the virtual camera is accepted from a user authorized by the first user, and

the operation of the virtual camera is a user operation different from the movement operation, and wherein

a first movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a first operation UI displayed at a first user terminal of the first user,

a second movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a second operation UI displayed at the first user terminal,

a viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation with respect to a third operation UI displayed at the first user terminal, and

a movement operation, a rotation operation and/or a scale operation of the virtual camera is applied in response to a predetermined operation with respect to a region where the first operation UI, the second operation UI, and the third operation UI are not displayed, at the first user terminal.

10 . A nontransitory computer-readable medium storing thereon a program that causes one or more computer processors to execute:

transmitting, to a server, information about a video including a character object of a first user;

accepting a movement operation of the character object of the first user in a virtual space;

accepting an operation of a virtual camera that captures images in the virtual space; and

based on the movement operation and the operation of the virtual camera, generating information about a video of the character object of the first user moving within the virtual space, wherein

the operation of the virtual camera is accepted from a user authorized by the first user, and

the operation of the virtual camera is a user operation different from the movement operation, and wherein

a first movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a first operation UI displayed at a first user terminal of the first user,

a second movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a second operation UI displayed at the first user terminal,

a viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation with respect to a third operation UI displayed at the first user terminal, and

a movement operation, a rotation operation and/or a scale operation of the virtual camera is applied in response to a predetermined operation with respect to a region where the first operation UI, the second operation UI, and the third operation UI are not displayed, at the first user terminal.

11 . An information processing method by one or more computer processors, the method comprising:

receiving, from a server, information about a video including a character object of a first user and a character object of a second user;

accepting a movement operation of the character object of the second user in a virtual space;

accepting an operation of a virtual camera that captures images in the virtual space;

transmitting, to the server, information about the movement operation and the operation of the virtual camera; and

displaying the character object of the first user and the character object of the second user as movable within the virtual space, wherein

the operation of the virtual camera is accepted from a user authorized by the first user, and

the operation of the virtual camera is a user operation different from the movement operation, and wherein

a first movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a first operation UI displayed at a first user terminal of the first user,

a second movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a second operation UI displayed at the first user terminal,

a viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation with respect to a third operation UI displayed at the first user terminal, and

a movement operation, a rotation operation and/or a scale operation of the virtual camera is applied in response to a predetermined operation with respect to a region where the first operation UI, the second operation UI, and the third operation UI are not displayed, at the first user terminal.

12 . A nontransitory computer-readable medium storing thereon a program that causes one or more computer processors to execute:

receiving, from a server, information about a video including a character object of a first user and a character object of a second user;

accepting a movement operation of the character object of the second user in a virtual space;

accepting an operation of a virtual camera that captures images in the virtual space;

transmitting, to the server, information about the movement operation and the operation of the virtual camera; and

displaying the character object of the first user and the character object of the second user as movable within the virtual space, wherein

the operation of the virtual camera is accepted from a user authorized by the first user, and

the operation of the virtual camera is a user operation different from the movement operation, and wherein

a first movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a first operation UI displayed at a first user terminal of the first user,

a second movement operation is applied to the character object of the first user in response to a predetermined operation with respect to a second operation UI displayed at the first user terminal,

a viewpoint of the virtual camera is switched to a first-person viewpoint or a third-person viewpoint in response to a predetermined operation with respect to a third operation UI displayed at the first user terminal, and

a movement operation, a rotation operation and/or a scale operation of the virtual camera is applied in response to a predetermined operation with respect to a region where the first operation UI, the second operation UI, and the third operation UI are not displayed, at the first user terminal.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY STREET ADDRESS AND ATTORNEY DOCKET NUMBER PREVIOUSLY RECORDED AT REEL: 71308 FRAME: 765. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jun 10, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071611/0252 →
CHANGE OF NAME Recorded May 16, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071308/0765 →
Priority Claims (4)
JP 2021-177158 · Oct 29, 2021 · national
JP 2021-177159 · Oct 29, 2021 · national
JP 2021-177160 · Oct 29, 2021 · national
JP 2021-206823 · Dec 21, 2021 · national
Continuity (2)
Continuation 17893779 · Aug 23, 2022
Related Publication 20240221271A1 · Jul 4, 2024
References Cited (31)
US 20170072307A1 · Perry et al. · 2017 [cited by applicant]
US 20190255446A1 · Essiounine · 2019 [cited by examiner]
US 20190291011A1 · Benedetto · 2019 [cited by examiner]
US 20200269129A1 · Kira et al. · 2020 [cited by applicant]
US 20210203702A1 · Kurabuchi · 2021 [cited by applicant]
US 20210204014A1 · Kawakami et al. · 2021 [cited by applicant]
US 20210213357A1 · Morishita · 2021 [cited by applicant]
US 20220021949A1 · Hu · 2022 [cited by examiner]
US 20220347559A1 · Tsuchiya · 2022 [cited by applicant]
CN 110694273A · 2020 [cited by applicant]
JP 201423720A · 2014 [cited by applicant]
JP 2015184689A · 2015 [cited by applicant]
JP 2019057291A · 2019 [cited by applicant]
JP 2019133568A · 2019 [cited by applicant]
JP 2019144942A · 2019 [cited by applicant]
JP 2019186797A · 2019 [cited by applicant]
JP 2020038468A · 2020 [cited by applicant]
JP 2021007213A · 2021 [cited by applicant]
JP 202153365A · 2021 [cited by applicant]
JP 2021152785A · 2021 [cited by applicant]
JP 6941245B1 · 2021 [cited by applicant]
Super Mario 3 Battle Game (URL: https://www.youtube.com/watch?v=w7qWFa59hSU, all pages, 2015). [cited by examiner]
Dead Space, https://www.youtube.com/watch?v=CEr-oNmuvus, Jul. 14, 2020 (Year: 2020). [cited by examiner]
Feb. 27, 2023 Office Action issued in Japanese Patent Application No. 2021-177159. [cited by applicant]
Feb. 28, 2023 Office Action issued in Japanese Patent Application No. 2021-177160. [cited by applicant]
Mar. 26, 2024 Office Action issued in Japanese Patent Application No. 2023-048880. [cited by applicant]
Jun. 19, 2025 Notice of Reasons for Refusal issued in Japanese Patent Application No. 2021-206823. [cited by applicant]
YouTube, “[Eastward] Otaku love beautiful pixel art and post-apocalypse!#1[Natori Sana]” <https://www.youtube.com/watch?v=xu2F20kQILc&gt> (Sep. 17, 2021). [cited by applicant]
Twitch, “How to use Multistream! Explains how to watch multiple broadcasts at the same time! [MULTISTRE.AM]” <https://pontako.com/twitch-multistream/> (Mar. 22, 2020). [cited by applicant]
Note, “Introduction to VRM” <https://note.com/npaka/n/n59d777a49c99> (Nov. 6, 2019). [cited by applicant]
Oct. 21, 2025 Notice of Reasons for Refusal issued in Japanese Patent Application No. 2021-206823. [cited by applicant]