IP Library Granted Patent US 11,682,154
Granted Patent B2
US 11,682,154 · App. 17/016,131 · Granted Jun 20, 2023

Moving image processing method of a moving image viewed by a viewing user, a server device controlling the moving image, and a computer program thereof

Inventor: Takashi Yasukawa (Minato-ku, JP)
Assignee: GREE, INC.
G06T13/40G06T7/251G06T7/579G06T7/75G06T2210/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,682,154
App. No.
17/016,131
Granted
Jun 20, 2023
Kind
B2
Abstract

A moving image processing method includes: generating a moving image including an animation of an avatar object of a distribution user, based on a motion of the distribution user; receiving a request signal that is generated based on a manipulation of a viewing user viewing the moving image and requests that a first gift object is applied to the avatar object from a terminal device of the viewing user through a communication line; displaying the first gift object that is applied to the avatar object based on the request signal on the moving image; and a second gift object on the moving image in a case where it is determined that the avatar object executes a predetermined action with respect to one or a plurality of first gift objects displayed on the moving image, based on the motion of the distribution user.

Claims (73)

1. A moving image processing method to be executed by a processor that executes a computer-readable command, the method comprising:

generating a moving image including an animation of an avatar object of a distribution user, based on a motion of the distribution user;

receiving a request signal that is generated based on a manipulation of a viewing user viewing the moving image and requests that a first gift object is applied to the avatar object from a terminal device of the viewing user through a communication line;

displaying the first gift object that is applied to the avatar object based on the request signal on the moving image; and

displaying a second gift object different from the first gift object subjected to a predetermined action on the moving image in a case where it is determined that the avatar object executes the predetermined action with respect to one or a plurality of first gift objects displayed on the moving image, based on the motion of the distribution user.

2. The moving image processing method according to claim 1 ,

wherein the predetermined action is an action that the avatar object moves the first gift object to a specific position, based on the motion of the distribution user.

3. The moving image processing method according to claim 2 ,

wherein the first gift object includes a plurality of first gift objects, and a first collision region is set in each of the plurality of first gift objects,

a second collision region is set in a hand of the avatar object,

in a case where it is determined that the first collision region and the second collision region overlap with each other in at least a part of the moving image and in a case where it is determined that fingers of the avatar object are bent, based on the motion of the distribution user, it is recognized that the first gift object is gripped by the avatar object, and

in a case where a gripped state of the first gift object by the avatar object is started in a first position of the moving image, and the gripped state is maintained up to a second position of the moving image that is different from the first position, it is recognized that the action for moving the first gift object to the specific position is executed.

4. The moving image processing method according to claim 3 ,

wherein the determination of whether or not the first collision region and the second collision region overlap with each other in at least a part of the moving image is executed based on a position coordinate of the first collision region and a position coordinate of the second collision region, based on an X axis that is a horizontal direction, a Y axis that is a depth direction, and a Z axis that is a vertical direction in the moving image.

5. The moving image processing method according to claim 2 ,

wherein the second gift object is determined based on the specific position, a type of the first gift object, and the number of applications for each type of the first gift objects, and is displayed on the moving image.

6. The moving image processing method according to claim 1 ,

wherein the first gift object includes a plurality of first gift objects, and the predetermined action is an action that the avatar object brings at least one first gift object of the plurality of first gift objects into contact with another first gift object of the plurality of first gift objects, based on the motion of the distribution user.

7. The moving image processing method according to claim 6 ,

wherein a first collision region is set in each of the plurality of first gift objects, and

in a case where it is determined that at least two first collision regions overlap with each other in at least a part of the moving image, it is recognized that at least two first gift objects of the plurality of first gift objects are in contact with each other.

8. The moving image processing method according to claim 7 ,

wherein the determination of whether or not at least two first collision regions overlap with each other in at least a part of the moving image is executed based on a position coordinate of each of the first collision regions, based on an X axis that is a horizontal direction, a Y axis that is a depth direction, and a Z axis that is a vertical direction in the moving image.

9. The moving image processing method according to claim 6 ,

wherein the second gift object is determined based on a type of the first gift object and a number of applications for each type of the first gift object, and is displayed on the moving image.

10. The moving image processing method according to claim 9 ,

wherein the second gift object is further determined based on a contact time between the first gift object, and is displayed on the moving image.

11. The moving image processing method according to claim 9 ,

wherein the first gift object includes a plurality of first gift objects, and the second gift object is further determined based on a collision rate when the plurality of first gift objects are in contact with each other, and the collision rate is displayed on the moving image.

12. The moving image processing method according to claim 1 ,

wherein when displaying the second gift object, in a case where it is determined that the avatar object executes the predetermined action, the first gift object subjected to the predetermined action is deleted from the moving image.

13. The moving image processing method according to claim 12 ,

wherein the second gift object is displayed in a position different from a position in which the first gift object has existed in the moving image, before being deleted from the moving image or before being changed to the second gift object.

14. The moving image processing method according to claim 1 ,

wherein when displaying the second gift object, in a case where it is determined that the avatar object executes the predetermined action, the first gift object subjected to the predetermined action is changed to the second gift object, and the second gift object is displayed on the moving image.

15. The moving image processing method according to claim 1 ,

wherein the first gift object includes a plurality of first gift objects, and when displaying the second gift object, in a case where it is determined that the avatar object executes the predetermined action, at least one first gift object of the plurality of first gift objects subjected to the predetermined action is deleted from the moving image, and at least one other first gift object is changed to the second gift object.

16. The moving image processing method according to claim 1 ,

wherein displaying the second gift object includes displaying an effect object indicating a state in which the avatar object starts the predetermined action and the second gift object is being displayed on the moving image.

17. The moving image processing method according to claim 1 ,

wherein generating the moving image, displaying the first gift object, and displaying the second gift object are executed by a terminal device of the distribution user.

18. The moving image processing method according to claim 17 ,

wherein receiving the request signal is executed by a server device that is connected to the terminal device of the viewing user or the terminal device of the distribution user through the communication line, and

it is determined that the avatar object executes the predetermined action with respect to the first gift object displayed on the moving image, by the terminal device of the distribution user.

19. The moving image processing method according to claim 1 ,

wherein generating the moving image, receiving the request signal, displaying the first gift object, and displaying the second gift object are executed by a server device that is connected to the terminal device of the viewing user or a terminal device of the distribution user through the communication line.

20. The moving image processing method according to claim 19 ,

wherein it is determined that the avatar object executes the predetermined action with respect to the first gift object displayed on the moving image, by the terminal device of the distribution user.

21. The moving image processing method according to claim 1 ,

wherein generating the moving image, displaying the first gift object, and displaying the second gift object are executed by the terminal device of the viewing user.

22. The moving image processing method according to claim 21 ,

wherein receiving the request signal is executed by a server device that is connected to the terminal device of the viewing user or a terminal device of the distribution user through the communication line, and

it is determined that the avatar object executes the predetermined action with respect to the first gift object displayed on the moving image, by the terminal device of the distribution user.

23. The moving image processing method according to claim 1 ,

wherein the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU).

24. The moving image processing method according to claim 1 ,

wherein the communication line includes the internet.

25. A non-transitory computer readable medium storing a computer program to be executed by a processor such that the processor functions to:

generate a moving image including an animation of an avatar object of a distribution user, based on a motion of the distribution user;

receive a request signal that is generated based on a manipulation of a viewing user viewing the moving image and requests that a first gift object is applied to the avatar object from a server device or a terminal device of the viewing user through a communication line;

display the first gift object that is applied to the avatar object based on the request signal on the moving image; and

display a second gift object different from the first gift object subjected to a predetermined action on the moving image in a case where it is determined that the avatar object executes the predetermined action with respect to one or a plurality of first gift objects displayed on the moving image, based on the motion of the distribution user.

26. The non-transitory computer readable medium according to claim 25 ,

wherein the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU).

27. The non-transitory computer readable medium according to claim 25 ,

wherein the communication line includes the internet.

28. The non-transitory computer readable medium of claim 25 , wherein the processor includes a plurality of processors.

29. A non-transitory computer readable medium comprising instructions that, when executed by a processor, cause the processor to function to:

transmit information for generating a moving image including an animation of an avatar object of a distribution user, based on a motion of the distribution user, to a server device generating the moving image or a terminal device of a viewing user;

receive a request signal that is generated based on a manipulation of the viewing user viewing the moving image and requests that a first gift object is applied to the avatar object from the server device or the terminal device of the viewing user through a communication line;

transmit information relevant to the first gift object that is applied to the avatar object based on the request signal to the server device displaying the first gift object on the moving image or the terminal device of the viewing user; and

transmit information relevant to a second gift object different from the first gift object subjected to a predetermined action to the server device displaying the second gift object on the moving image or the terminal device of the viewing user in a case where it is determined that the avatar object executes the predetermined action with respect to one or a plurality of first gift objects displayed on the moving image, based on the motion of the distribution user.

30. The non-transitory computer readable medium of claim 29 , wherein the processor includes a plurality of processors.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY STREET ADDRESS AND ATTORNEY DOCKET NUMBER PREVIOUSLY RECORDED AT REEL: 71308 FRAME: 765. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jun 10, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071611/0252 →
CHANGE OF NAME Recorded May 16, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071308/0765 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2020
From: YASUKAWA, TAKASHI
To: GREE, INC.
Reel/Frame 053728/0078 →
Priority Claims (2)
JP JP2019-198441 · Oct 31, 2019 · national
JP JP2020-136660 · Aug 13, 2020 · national
Continuity (1)
Related Publication 20210134041A1 · May 6, 2021