IP Library Granted Patent US 12,243,141
Granted Patent B2
US 12,243,141 · App. 17/956,873 · Granted Mar 4, 2025

Generating avatar information relating to an avatar expression or pose

Inventor: Masashi Watanabe (Tokyo, JP)
Assignee: GREE, INC.
G06T13/40G06T7/70G06T19/20G06V10/761G06V40/176H04N21/2187H04N21/4312G06T2207/30201G06T2219/2012G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,141
App. No.
17/956,873
Granted
Mar 4, 2025
Kind
B2
Abstract

A non-transitory computer readable medium storing computer executable instructions which, when executed by one or more processors, cause the one or more processors to perform a process including generating avatar information relating to an avatar expression or pose based on streamer data indicating a facial expression or pose of a streamer; acquiring gift information concerned with a gift of an object that is provided from a viewer to the streamer; determining whether the gift information satisfies a predetermined condition; in a case that the gift information is determined to satisfy the predetermined condition, rendering an avatar facial expression or pose using a predetermined facial expression or pose corresponding to the predetermined condition; and in a case that the gift information is determined to not satisfy the predetermined condition, rendering the avatar facial expression or pose using the avatar information generated based on the streamer data.

Claims (35)

1. A non-transitory computer readable medium storing computer executable instructions which, when executed by one or more processors, cause the one or more processors to perform a process comprising:

generating avatar information relating to an avatar expression or pose based on streamer data indicating a facial expression or pose of a streamer;

acquiring gift information concerned with a gift of an object that is provided from a viewer to the streamer, wherein the gift is to be used by the avatar;

determining whether the gift information satisfies a predetermined condition, wherein the predetermined condition includes a condition that is satisfied when the avatar puts on the gift;

in a case that the gift information is determined to satisfy the predetermined condition, rendering an avatar facial expression or pose using a predetermined facial expression or pose corresponding to the predetermined condition; and

in a case that the gift information is determined to not satisfy the predetermined condition, rendering the avatar facial expression or pose using the avatar information generated based on the streamer data.

2. The non-transitory computer readable medium according to claim 1 , wherein the predetermined condition includes a condition that a position concerned with the avatar and a position concerned with the gift fall within a predetermined distance range.

3. The non-transitory computer readable medium according to claim 2 , wherein the position concerned with the avatar is any one of a position of the avatar in a virtual space, an area in which the predetermined facial expression or pose activates, a predetermined area of the avatar, and a collider of the avatar.

4. The non-transitory computer readable medium according to claim 1 , wherein the predetermined condition uses a priority concerned with the gift.

5. The non-transitory computer readable medium according to claim 4 , wherein the priority concerned with the gift is generated by using a price of the gift, a display size of the gift, a level of the gift, and/or information concerned with a provider of the gift.

6. The non-transitory computer readable medium according to claim 1 , wherein the gift information includes information on a start of display of the gift, information on a change of display of the gift, attribute information of the gift, and/or information on an end of display of the gift.

7. The non-transitory computer readable medium according to claim 1 , wherein

the gift information includes information concerned with a first gift and information concerned with a second gift, and

the predetermined condition uses a combination of the information concerned with the first gift and the information concerned with the second gift, an order in which the information concerned with the first gift and the information concerned with the second gift, is acquired, and/or a first time at which the information concerned with the first gift is acquired and a second time at which the information concerned with the second gift is acquired.

8. The non-transitory computer readable medium according to claim 1 , wherein the one or more processors are provided in one or some or all of a server, a viewer terminal, and a streamer terminal.

9. The non-transitory computer readable medium according to claim 1 , wherein in the case that the gift information is determined to satisfy the predetermined condition, the rendering the avatar facial expression or pose includes changing the avatar information with predetermined avatar information corresponding with the predetermined facial expression or pose.

10. The non-transitory computer readable medium according to claim 1 , wherein in the case that the gift information is determined to satisfy the predetermined condition, the rendering the avatar facial expression or pose includes changing a parameter of at least part of the streamer data.

11. The non-transitory computer readable medium according to claim 10 , wherein the changing the parameter includes changing a position data of the at least part of the streamer data from indicating a first position to a second position.

12. The non-transitory computer readable medium according to claim 1 , wherein the rendering the avatar facial expression or pose includes replacing at least part of an avatar corresponding to the streamer with a predetermined image.

13. The non-transitory computer readable medium according to claim 1 , wherein the rendering the avatar facial expression or pose includes changing a color or size of at least part of an avatar corresponding to the streamer.

14. A server, comprising:

processing circuitry configured to

generate avatar information relating to an avatar expression or pose based on streamer data indicating a facial expression or pose of a streamer;

acquire gift information concerned with a gift of an object that is provided from a viewer to the streamer, wherein the gift is to be used by the avatar;

determine whether the gift information satisfies a predetermined condition, wherein the predetermined condition includes a condition that is satisfied when the avatar puts on the gift;

in a case that the gift information is determined to satisfy the predetermined condition, render an avatar facial expression or pose using a predetermined facial expression or pose corresponding to the predetermined condition; and

in a case that the gift information is determined to not satisfy the predetermined condition, render the avatar facial expression or pose using the avatar information generated based on the streamer data.

15. The server according to claim 14 , wherein in the case that the gift information is determined to satisfy the predetermined condition, the processing circuitry is configured to render the avatar facial expression or pose by changing the avatar information with predetermined avatar information corresponding with the predetermined facial expression or pose.

16. The server according to claim 14 , wherein in the case that the gift information is determined to satisfy the predetermined condition, the processing circuitry is configured to render the avatar facial expression or pose by changing a parameter of a part of the streamer.

17. A method, comprising:

generating avatar information relating to an avatar expression or pose based on streamer data indicating a facial expression or pose of a streamer;

acquiring gift information concerned with a gift of an object that is provided from a viewer to the streamer, wherein the gift is to be used by the avatar;

determining whether the gift information satisfies a predetermined condition, wherein the predetermined condition includes a condition that is satisfied when the avatar puts on the gift;

in a case that the gift information is determined to satisfy the predetermined condition, rendering an avatar facial expression or pose using a predetermined facial expression or pose corresponding to the predetermined condition; and

in a case that the gift information is determined to not satisfy the predetermined condition, rendering the avatar facial expression or pose using the avatar information generated based on the streamer data.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY STREET ADDRESS AND ATTORNEY DOCKET NUMBER PREVIOUSLY RECORDED AT REEL: 71308 FRAME: 765. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jun 10, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071611/0252 →
CHANGE OF NAME Recorded May 16, 2025
From: GREE, INC.
To: GREE HOLDINGS, INC.
Reel/Frame 071308/0765 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2023
From: WATANABE, MASASHI
To: GREE, INC.
Reel/Frame 064878/0792 →
Priority Claims (3)
JP 2020-072287 · Apr 14, 2020 · national
JP 2020-078079 · Apr 27, 2020 · national
JP 2020-093438 · May 28, 2020 · national
Continuity (2)
Continuation PCTJP2021015347 · Apr 13, 2021
Related Publication 20230023653A1 · Jan 26, 2023
References Cited (50)
US 9245177B2 · Perez · 2016 [cited by applicant]
US 10546407B2 · Inomata et al. · 2020 [cited by applicant]
US 10748342B2 · Joyce et al. · 2020 [cited by applicant]
US 10796489B1 · Cordes et al. · 2020 [cited by applicant]
US 11367260B2 · Kawakami et al. · 2022 [cited by applicant]
US 11500456B2 · Iwaki · 2022 [cited by applicant]
US 20070260984A1 · Marks et al. · 2007 [cited by applicant]
US 20100153868A1 · Allen · 2010 [cited by examiner]
US 20100303289A1 · Polzin et al. · 2010 [cited by applicant]
US 20150024840A1 · Poon · 2015 [cited by examiner]
US 20150325029A1 · Li et al. · 2015 [cited by applicant]
US 20150375111A1 · Moriyama · 2015 [cited by examiner]
US 20170003784A1 · Garg · 2017 [cited by examiner]
US 20170006322A1 · Dury · 2017 [cited by examiner]
US 20180350144A1 · Rathod · 2018 [cited by examiner]
US 20190138267A1 · Mailey · 2019 [cited by applicant]
US 20220083126A1 · Iwaki · 2022 [cited by examiner]
US 20230049410A1 · Saito · 2023 [cited by applicant]
CN 108140383A · 2018 [cited by applicant]
CN 108986192A · 2018 [cited by applicant]
JP 7230559A · 1995 [cited by applicant]
JP 200367780A · 2003 [cited by applicant]
JP 201814575A · 2018 [cited by applicant]
JP 2018128966A · 2018 [cited by applicant]
JP 6559871B1 · 2019 [cited by applicant]
JP 202017244A · 2020 [cited by applicant]
JP 2020017244A · 2020 [cited by applicant]
JP 6644928B1 · 2020 [cited by applicant]
JP 2020038601A · 2020 [cited by applicant]
JP 2020057207A · 2020 [cited by applicant]
JP 6840876B1 · 2021 [cited by applicant]
JP 2021064253A · 2021 [cited by applicant]
KR 20040014123A · 2004 [cited by applicant]
KR 1020180030767A1 · 2018 [cited by applicant]
WO 2020068878A1 · 2020 [cited by applicant]
Wohn et al., “Live Streaming, Playing, and Money Spending Behaviors in eSports”, Jul. 2019, Sage Publications, vol. 15, No. 1, pp. 73-88 (Year: 2019). [cited by examiner]
International Search Report and Written Opinion mailed on Jul. 6, 2021, received for PCT Application PCT/JP2021/015347, filed on Apr. 13, 2021, 9 pages including English Translation. [cited by applicant]
“Custom Cast”, Available Online at: https://customcast.jp, Retrieved from Online On: Dec. 6, 2021, 17 pages Including English Translation. [cited by applicant]
Japanese Office Action issued Feb. 14, 2023, in corresponding Japanese Patent Application 2021-106393, 4pp. [cited by applicant]
Office Action issued Mar. 5, 2024 in Japanese Patent Application No. 2021-208605. [cited by applicant]
Office Action issued on Jun. 20, 2023, in corresponding Japanese patent Application No. 2020-072287, 6 pages. [cited by applicant]
Office Action issued Jul. 11, 2023 in Japanese Patent Application No. 2020-093438, 5 pages. [cited by applicant]
Office Action issued on Jan. 17, 2023, in corresponding Japanese patent Application No. 2020-072287, 7 pages. [cited by applicant]
Office Action issued on Jan. 17, 2023, in corresponding Japanese patent Application No. 2020-093438, 6 pages. [cited by applicant]
Office Action issued on Jan. 17, 2023, in corresponding Japanese patent Application No. 2020-078079, 6 pages. [cited by applicant]
Masatoshi Tokuoka, “[CEDEC 2019] “VTuber avatar that moves on its own when receiving a gift” session report. Two VTubers shake hands, grab shoulders, and hug each other, Experience acting support system using physics en… [cited by applicant]
Japanese Office Action issued Dec. 5, 2023, in corresponding Japanese Patent Application No. 2020-093438, 5 pages. [cited by applicant]
US Office Action issued Dec. 21, 2023, in corresponding U.S. Appl. No. 17/851,140, 87 pages. [cited by applicant]
Japanese Office Action issued Feb. 13, 2024, in corresponding Japanese Patent Application No. 2021-208607, 8 pages. [cited by applicant]
Japanese Office Action issued Jul. 23, 2024 in corresponding Japanese Patent Application No. 2021-208605, 6 pages. [cited by applicant]