IP Library Granted Patent US 12,333,668
Granted Patent B2
US 12,333,668 · App. 18/090,492 · Granted Jun 17, 2025

Control program of terminal device, terminal device, method of controlling terminal device, control program of server device, server device, and method of controlling server device

Inventors: Daiki Hayata (Tokyo, JP); Motoki Uchida (Tokyo, JP); Keigo Masuzumi (Tokyo, JP)
Assignee: GREE, INC.
G06T19/20G06F3/14G06F3/16G06T7/20G06T2219/024G06T2219/2016G06T2219/2024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,668
App. No.
18/090,492
Granted
Jun 17, 2025
Kind
B2
Abstract

A control method includes displaying, at a terminal device of a first user, a first image and a second image, the first image including a first object representing the first user, and the second image including a second object representing a second user different from the first user; displaying the first image including the first object as being changed in accordance with audio data or a motion of the first user; displaying the second image including the second object as being changed in accordance with audio data or a motion of the second user; and displaying the first image including the first object as being at least partly changed in accordance with an instruction from the first user or displaying the second image including the second object as being at least partly changed in accordance with an instruction from the second user.

Claims (77)

1. A control method, comprising:

displaying, at a terminal device of a first user, a first image and a second image, the first image including a first object representing the first user, and the second image including a second object representing a second user different from the first user,

transmitting, via a network, information about display of the first image to a terminal device of the second user;

transmitting, via the network, first audio data of the first user for acquisition by the terminal device of the second user in a case that the terminal of the first user obtains the first audio data;

displaying the first image including the first object as being changed in accordance with the first audio data or a motion of the first user;

outputting second audio data of the second user, received via the network, in a case that the terminal device of the first user obtains the second audio data;

displaying the second image including the second object as being changed in accordance with the second audio data or a motion of the second user;

receiving a first instruction from the first user or a second instruction from the second user,

in response to receiving the first instruction, displaying the first image including:

the first object as being at least partly changed in accordance with the first instruction; and

a third object that corresponds to a candidate object which is selected from a selection group, including one or more candidate objects, in accordance with the second instruction, wherein

in a case that a predetermined condition is satisfied, the selection group includes a specific candidate object:

in response to receiving the second, displaying the second image including:

the second object as being at least partly changed in accordance with the second instruction; and

the third object that corresponds to the candidate object in accordance with the first instruction; and

transmitting information about display of the third object to the terminal device of the second user.

2. The control method according to claim 1 , wherein the displaying the first image including the first object as being at least partly changed includes selecting another candidate object from one or more other candidate objects that are associated with the first user in accordance with the first instruction from the first user.

3. The control method according to claim 2 , wherein

the first object is a three-dimensional object that is placed in a virtual space, and

the control method further comprises:

displaying, as the first image, an image that represents the virtual space viewed from a viewpoint in the virtual space; and

displaying the first image as being at least partly changed according to a representation of movement of the viewpoint in the virtual space.

4. The control method according to claim 3 , wherein the movement of the viewpoint is controlled such that the viewpoint approaches a changed part of the first object.

5. The control method according to claim 3 , wherein the movement of the viewpoint is controlled such that the viewpoint moves around the first object.

6. The control method according to claim 1 , wherein the predetermined condition includes a condition related to a display time of at least one of the first image and a display time of the second image.

7. The control method according to claim 1 ,

wherein the predetermined condition includes a condition related to a number of times the second candidate object is selected by the first user and/or the second user.

8. The control method according to claim 1 , further comprising:

displaying a plurality of second images, each of which represents a corresponding one of a plurality of the second users; and

displaying the plurality of the second images and the first image including the third object that corresponds to the selected candidate object, based on the candidate object that is selected in accordance with the second instruction from the second user.

9. The control method according to claim 1 , further comprising:

receiving an instruction, input from the first user, for selecting the third object; and

displaying the first image including the first object that is partly changed according to the instruction for selecting the third object.

10. The control method according to claim 1 , wherein the displaying the first image as being at least partly changed includes displaying an image that represents a progression of a game that is played by the first user and/or the second user instead of at least a part of the first image.

11. The control method according to claim 1 , further comprising displaying an image that represents a progression of a game that is played by at least one of the first user and the second user instead of at least a part of the second image in a case that the candidate object that is selected according to the second instruction from the second user corresponds to the game.

12. A terminal device of a first user, the terminal device comprising:

processing circuitry configured to:

display a first image and a second image, the first image including a first object representing the first user, and the second image including a second object representing a second user different from the first user;

transmit, via a network, information about display of the first image to a terminal device of the second user;

transmit, via the network, first audio data of the first user for acquisition by the terminal device of the second user in a case that the terminal of the first user obtains the first audio data;

display the first image including the first object as being changed in accordance with the first audio data or a motion of the first user;

output second audio data of the second user, received via the network, in a case that the terminal device of the first user obtains the second audio data;

display the second image including the second object as being changed in accordance with the second audio data or a motion of the second user;

receive a first instruction from the first user or a second instruction from the second user;

in response to receiving the first instruction, display the first image including;

the first object as being at least partly changed in accordance with the first instruction; and

a third object that corresponds to a candidate object which is selected from a selection group, including one or more candidate objects, in accordance with the second instruction, wherein

in a case that a predetermined condition is satisfied, the selection group includes a specific candidate object;

in response to receiving the second, display the second image including;

the second object as being at least partly changed in accordance with the second instruction; and

the third object that corresponds to the candidate object in accordance with the first instruction; and

transmit information about display of the third object to the terminal device of the second user.

13. The terminal device according to claim 12 , wherein the processing circuitry is configured to display the first object as being at least partly changed by selecting a-first another candidate object from one or more other candidate objects that are associated with the first user in accordance with the first instruction from the first user.

14. The terminal device according to claim 13 , wherein

the first object is a three-dimensional object that is placed in a virtual space, and

the processing circuitry is further configured to

display, as the first image, an image that represents the virtual space viewed from a viewpoint in the virtual space; and

display the first image as being at least partly changed according to a representation of movement of the viewpoint in the virtual space.

15. The terminal device according to claim 14 , wherein the movement of the viewpoint is controlled such that the viewpoint approaches a changed part of the first object.

16. A control method, comprising:

displaying, at a terminal device of a first user, a first image and a second image, the first image including a first object representing the first user, and the second image including a second object representing a second user different from the first user,

transmitting, via a network, information about display of the first image to a terminal device of the second user,

transmitting, via the network, first audio data of the first user for acquisition by the terminal device of the second user in a case that the terminal of the first user obtains the first audio data;

displaying the first image including the first object as being changed in accordance with the first audio data or a motion of the first user;

outputting second audio data of the second user, received via the network, in a case that the terminal device of the first user obtains the second audio data;

displaying the second image including the second object as being changed in accordance with the second audio data or a motion of the second user;

displaying the first image including the first object as being at least partly changed in accordance with an instruction from the first user or displaying the second image including the second object as being at least partly changed in accordance with an instruction from the second user;

displaying the first image as including a third object that corresponds to a candidate object that is selected from a selection group including one or more candidate objects depending on the instruction from the second user, wherein

the selection group includes a specific candidate object in a case that a predetermined condition related to a display time of at least one of the first image and a display time of the second image is satisfied.

17. The control method according to claim 16 , wherein the displaying the first image including the first object as being at least partly changed includes selecting another candidate object from one or more other candidate objects that are associated with the first user in accordance with the first instruction from the first user.

18. The control method according to claim 17 , wherein

the first object is a three-dimensional object that is placed in a virtual space, and

the control method further comprises:

displaying, as the first image, an image that represents the virtual space viewed from a viewpoint in the virtual space; and

displaying the first image as being at least partly changed according to a representation of movement of the viewpoint in the virtual space.

19. The control method according to claim 18 , wherein the movement of the viewpoint is controlled such that the viewpoint approaches a changed part of the first object.

20. The control method according to claim 18 , wherein the movement of the viewpoint is controlled such that the viewpoint moves around the first object.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY STREET ADDRESS AND ATTORNEY DOCKET NUMBER PREVIOUSLY RECORDED AT REEL: 71308 FRAME: 765. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jun 10, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071611/0252 →
CHANGE OF NAME Recorded May 16, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071308/0765 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2022
From: HAYATA, DAIKI; UCHIDA, MOTOKI; MASUZUMI, KEIGO
To: GREE, INC.
Reel/Frame 062233/0124 →
Priority Claims (2)
JP 2022-042722 · Mar 17, 2022 · national
JP 2022-060878 · Mar 31, 2022 · national
Continuity (1)
Related Publication 20230298294A1 · Sep 21, 2023
References Cited (12)
US 7386799B1 · Clanton · 2008 [cited by examiner]
US 11481988B2 · Van Os · 2022 [cited by examiner]
US 20180318705A1 · Moberg · 2018 [cited by examiner]
US 20220060800A1 · Kurabuchi · 2022 [cited by applicant]
JP 2009199198A · 2009 [cited by applicant]
JP 201385573A · 2013 [cited by applicant]
JP 202096269A · 2020 [cited by applicant]
JP 2020096269A · 2020 [cited by examiner]
JP 2021149407A · 2021 [cited by applicant]
JP 2021158558A · 2021 [cited by applicant]
Japanese Office Action issued May 16, 2023, in corresponding Japanese Patent Application No. 2022-060878, 4pp. [cited by applicant]
Japanese Office Action issued Apr. 25, 2023 in corresponding Japanese Patent Application No. 2022-042722 (with machine-generated English translation), 8 pages. [cited by applicant]