IP Library Granted Patent US 12,289,354
Granted Patent B2
US 12,289,354 · App. 18/386,842 · Granted Apr 29, 2025

Information processing system, information processing method, and computer program

Inventor: Aya Kurabuchi (Tokyo, JP)
Assignee: GREE, INC.
H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,289,354
App. No.
18/386,842
Granted
Apr 29, 2025
Kind
B2
Abstract

One or more computer processors include (i) a distribution portion that distributes, to a viewing user terminal, information about a video including an animation of a character object of a distribution user, (ii) a receiver that receives a display request for a specified gift transmitted from the viewing user terminal, (iii) an object display device that displays a specified gift object corresponding to the specified gift in the video, based on the display request received by the receiver, (iv) a determination portion that determines whether behavior information of the distribution user or another gift object satisfies a predetermined condition associated with the specified gift object, and (v) an expression portion that changes at least one of a movement and a shape of the specified gift object when the determination portion determines that the predetermined condition is satisfied.

Claims (48)

1. An information processing system that distributes a video including an animation of a character object generated based on a movement of a first user, and comprises:

one or more computer processors programmed to:

distribute, to a second user terminal, information about the video including the animation of the character object of the first user;

receive a display request for a specified gift transmitted from the second user terminal;

attach a specified gift object, corresponding to the specified gift, to the character object without displaying the specified gift object in the video, based on the display request or based on a display instruction for the specified gift;

determine whether behavior information of the first user or another gift object displayed in the video satisfies a predetermined condition associated with the specified gift object; and

display the specified gift object in the video in response to determining that the predetermined condition is satisfied.

2. The information processing system according to claim 1 , wherein

the one or more computer processors attach the specified gift object to the character object based on object information including position information indicating a display position of the specified gift object.

3. The information processing system according to claim 1 , wherein

the predetermined condition is that the first user or the other gift object has performed a predetermined behavior a predetermined number of times.

4. The information processing system according to claim 1 , wherein

the one or more computer processors further change at least one of a movement and a shape of the specified gift object in response to determining that the predetermined condition is satisfied.

5. The information processing system according to claim 4 , wherein

the one or more computer processors change the at least one of the movement and the shape of the specified gift object by displaying an animation set for the specified gift object based on the behavior information of the first user or the other gift object.

6. The information processing system according to claim 1 , wherein

the behavior information of the first user includes at least one of information about eye behavior of the first user, information about mouth behavior of the first user, information about body behavior of the first user, and information about voice behavior of the first user.

7. The information processing system according to claim 1 , wherein

the behavior information of the other gift object is information specified based on an appearance position or a display position of the other gift object.

8. The information processing system according to claim 1 , wherein

the other gift object is a gift object associated with the specified gift object.

9. The information processing system according to claim 1 , wherein

the one or more computer processors end the display of the specified gift object based on the behavior information of the first user or the other gift object.

10. The information processing system according to claim 1 , wherein

the specified gift is an attaching gift to decorate eyes or mouth of the character object.

11. The information processing system according to claim 1 , wherein

the one or more computer processors

display the specified gift object based on the display request, the other gift object being associated with the specified gift object,

determine whether a position condition is satisfied, the position condition being that an appearance position or a display position of the other gift object is within a predetermined distance from a display position of the specified gift object, and

change at least one of a movement and a shape of the specified gift object in response to determining that the position condition is satisfied.

12. The information processing system according to claim 1 , wherein

the video, about which the information is distributed to the second user terminal, includes at least the animation of the character object of the first user and animation of another character object of a third user,

the specified gift object is attached to the character object or is attached to both the character object and the other character object, without displaying the specified gift object in the video, and

the one or more computer processors further determine whether both the behavior information of the first user and behavior information of the third user satisfy the predetermined condition, and display the specified gift object in the video in response to determining that the predetermined condition is satisfied.

13. An information processing method by an information processing system that distributes a video including an animation of a character object generated based on a movement of a first user, the method causing one or more computer processors included in the information processing system to execute:

distributing, to a second user terminal, information about the video including the animation of the character object of the first user;

receiving a display request for a specified gift transmitted from the second user terminal;

attaching a specified gift object, corresponding to the specified gift, to the character object without displaying the specified gift object in the video, based on the display request or based on a display instruction for the specified gift;

determining whether behavior information of the first user or another gift object displayed in the video satisfies a predetermined condition associated with the specified gift object; and

displaying the specified gift object in the video in response to determining that the predetermined condition is satisfied.

14. An information processing device that displays a video including an animation of a character object generated based on a movement of a first user, and comprises:

a computer processor programmed to:

receive information about the video including the animation of the character object of the first user;

display the video based on the received information; and

transmit a display request for a specified gift, wherein

based on the display request or based on a display instruction for the specified gift, the computer processor

attaches a specified gift object, corresponding to the specified gift, to the character object without displaying the specified gift object in the video, and

displays the specified gift object in the video in response to a determination being made that a predetermined condition associated with the specified gift object is satisfied by behavior information of the first user or another gift object displayed in the video.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY STREET ADDRESS AND ATTORNEY DOCKET NUMBER PREVIOUSLY RECORDED AT REEL: 71308 FRAME: 765. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jun 10, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071611/0252 →
CHANGE OF NAME Recorded May 16, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071308/0765 →
Priority Claims (1)
JP 2019-238429 · Dec 27, 2019 · national
Continuity (2)
Continuation 17135151 · Dec 28, 2020
Related Publication 20240155011A1 · May 9, 2024
References Cited (28)
US 8223144B2 · Ishiwata et al. · 2012 [cited by applicant]
US 20100240451A1 · Suzuki · 2010 [cited by examiner]
US 20170243239A1 · El-Eid et al. · 2017 [cited by applicant]
US 20170309051A1 · Yamasaki et al. · 2017 [cited by applicant]
US 20180095635A1 · Valdivia et al. · 2018 [cited by applicant]
US 20180247443A1 · Briggs et al. · 2018 [cited by applicant]
US 20180302499A1 · Kada · 2018 [cited by examiner]
US 20180357817A1 · Ikekita · 2018 [cited by applicant]
US 20190095918A1 · Stewart et al. · 2019 [cited by applicant]
US 20190349636A1 · Watanabe et al. · 2019 [cited by applicant]
US 20220060800A1 · Kurabuchi · 2022 [cited by applicant]
US 20220070513A1 · Shirai et al. · 2022 [cited by applicant]
JP 2015184689A · 2015 [cited by applicant]
JP 6431233B1 · 2018 [cited by applicant]
JP 6526898B1 · 2019 [cited by applicant]
JP 6543403B1 · 2019 [cited by applicant]
JP 6783919B1 · 2020 [cited by applicant]
WO 2019216249A1 · 2019 [cited by applicant]
May 12, 2020 Office Action issued in Japanese Patent Application No. 2019-238429. [cited by applicant]
Sep. 16, 2022 Office Action issued in Japanese Patent Application No. 2020-177123. [cited by applicant]
Josh Constine, “Facebook animates photo-realistic avatars to mimic VR users' faces”, May 2, 2018, Tech Crunch, pp. 1-3 (Year: 2019). [cited by applicant]
Josh Constine, “Facebook announces Horizon, a VR massive-multiplayer world”, Sep. 25, 2019, Tech Crunch, pp. 1-5 (Year: 2019). [cited by applicant]
Steven Hickson et al., “Eyemotion: Classifying facial expressions in VR using eye-tracking cameras”, 2019, IEEE, pp. 1626-1635 (Year: 2019). [cited by applicant]
Micahel Irving, “VR headset that relays facial expressions to the virtual world”, News Atlas, Jul. 25, 2016, pp. 1-5 (Year: 2016). [cited by applicant]
Dec. 20, 2022 Office Action issued in Japanese Patent Application No. 2021-214002. [cited by applicant]
Dec. 27, 2022 Office Action issued in Japanese Patent Application No. 2021-214000. [cited by applicant]
Jun. 6, 2023 Office Action in Japanese Patent Application 2021-214000. [cited by applicant]
Apr. 9, 2024 Office Action issued in Japanese Patent Application No. 2023-096248. [cited by applicant]