IP Library Granted Patent US 12,231,716
Granted Patent B2
US 12,231,716 · App. 17/921,519 · Granted Feb 18, 2025

Video distribution in which display of comments posted during distribution is controlled

Inventor: Ko Kikuchi (Tokyo, JP)
Assignee: Rakuten Group, Inc.
H04N21/4316H04N21/2187H04N21/4318H04N21/4788G10L15/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,716
App. No.
17/921,519
Granted
Feb 18, 2025
Kind
B2
Abstract

A distribution controller ( 141 ) distributes a live video provided from a streamer to a viewer terminal having a comment area, the comment area allowing a predetermined number of comments to be displayed. A receiver ( 120 ) receives a comment posted from the viewer terminal during distribution of the live video. A sender ( 110 ) sends a comment that the receiver ( 120 ) received to the viewer terminal to cause the comment to be added to the comment area in a last-in-first-out manner. An identifier ( 144 ) identifies a comment to which the streamer reacted in the live video being distributed by, every time the streamer speaks, comparing a speech text, the speech text being acquired by subjecting speech of the streamer to speech recognition, with respective comments currently being displayed in the comment area. A display controller ( 145 ) controls display of the identified comment.

Claims (35)

1. A server device, comprising:

one or more processors, wherein

at least one of the one or more processors executes processing of:

distributing a live video provided from a streamer to a viewer terminal having a comment area, the comment area allowing a predetermined number of comments to be displayed;

receiving a comment posted from the viewer terminal during distribution of the live video;

sending the received comment to the viewer terminal to cause the comment to be added to the comment area in a last-in-first-out manner, wherein the comment is associated with a display flag having (i) a first value indicating the comment is displayed in the comment area or (ii) a second value indicating the comment is not displayed in the comment area;

receiving audio data corresponding to speech of the streamer;

converting, using speech recognition, the audio data to speech text;

comparing the speech text to each comment from the plurality of comments having the display flag with the first value;

identifying, based on the comparing, a comment from the plurality comments to which the streamer reacted in the live video being distributed, the identified comment associated with a reaction flag having (i) a first value indicating the speaker reacted to the comment or (ii) a second value indicating the speaker did not react to the comment; and

controlling display of the identified comment.

2. The server device according to claim 1 , wherein the control of display is control to cause a display form of the identified comment to be changed in such a manner as to be differentiated from a display form of another comment having a reaction flag set to the second value.

3. The server device according to claim 1 , wherein the control of display is control to cause the identified comment to be displayed in the comment area for a longer period of time than a standard period.

4. The server device according to claim 1 , wherein the identifying further comprises:

identifying one or more keywords in the identified comment that are coincident with one or more keywords in the speech text.

5. A display control, comprising:

a memory storing a program; and

a processor coupled to the memory, wherein when the processor executes the program, the processor is configured to:

distribute a live video provided from a streamer to a viewer terminal having a comment area, the comment area allowing a predetermined number of comments to be displayed;

receive a comment posted from the viewer terminal during distribution of the live video;

send the received comment to the viewer terminal to cause the comment to be added to the comment area in a last-in-first-out manner, wherein the comment is associated with a display flag having (i) a first value indicating the comment is displayed in the comment area or (ii) a second value indicating the comment is not displayed in the comment area;

receive audio data corresponding to speech of the streamer;

convert, using speech recognition, the audio data to speech text;

compare the speech text to each comment from the plurality of comments having the display flag with the first value;

identify, based on the comparing, a comment from the plurality of comments to which the streamer reacted in the live video being distributed, the identified comment associated with a reaction flag having (i) a first value indicating the speaker reacted to the comment or (ii) a second value indicating the speaker did not react to the comment; and

controlling of display of the identified comment.

6. A non-transitory computer-readable recording medium storing a program, the program causing a computer to execute a method comprising:

distributing a live video provided from a streamer to a viewer terminal having a comment area, the comment area allowing a predetermined number of comments to be displayed;

receiving a comment posted from the viewer terminal during distribution of the live video;

sending the received comment to the viewer terminal to cause the comment to be added to the comment area in a last-in-first-out manner, wherein the comment is associated with a display flag having (i) a first value indicating the comment is displayed in the comment area or (ii) a second value indicating the comment is not displayed in the comment area;

receiving audio data corresponding to speech of the streamer;

converting, using speech recognition, the audio data to speech text;

comparing the speech text to each comment from the plurality of comments having the display flag with the first value;

identifying, based on the comparing, a comment from the plurality of comments to which the streamer reacted in the live video being distributed, the identified comment associated with a reaction flag having (i) a first value indicating the speaker reacted to the comment or (ii) a second value indicating the speaker did not react to the comment; and

controlling display of the identified comment.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2024
From: RAKUTEN MOBILE, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 067685/0007 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2022
From: KIKUCHI, KO
To: RAKUTEN MOBILE, INC.
Reel/Frame 061547/0349 →
Continuity (1)
Related Publication 20240223842A1 · Jul 4, 2024
References Cited (9)
US 10498794B1 · Keighran · 2019 [cited by examiner]
US 20150094106A1 · Grossman · 2015 [cited by examiner]
US 20180359530A1 · Marlow · 2018 [cited by examiner]
US 20230274487A1 · Yamaga · 2023 [cited by examiner]
US 20230370686A1 · Cai · 2023 [cited by examiner]
JP 2021124809A · 2021 [cited by applicant]
JP 2022024982A · 2022 [cited by applicant]
WO 2019216249A1 · 2019 [cited by applicant]
International Search Report of PCT/JP2022/025649 dated Sep. 6, 2022 [PCT/ISA/210]. [cited by applicant]