IP Library Granted Patent US 11,184,582
Granted Patent B2
US 11,184,582 · App. 17/036,915 · Granted Nov 23, 2021

Terminal and operating method thereof

Inventors: Sang Il Ahn (Chungcheongbuk-do, KR); Oh Sung Kang (Seoul, KR)
Assignee: Hyperconnect, Inc.
H04N7/141
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,184,582
App. No.
17/036,915
Granted
Nov 23, 2021
Kind
B2
Abstract

An operating method of a terminal may include establishing a video call session between the terminal and a counterpart terminal; acquiring a first video that is captured by the terminal and includes a plurality of frames; censoring the first video based on a censorship algorithm for determining whether or not at least one object preset as an inappropriate element is included in a frame within a predetermined video; and displaying the first video instead of a second video received from a counterpart terminal when it is determined that the at least one object is included in at least one of the plurality of frames as a result of censoring the first video.

Claims (62)

1. An operating method of a terminal, the method comprising:

establishing a video call session between the terminal and a counterpart terminal;

acquiring a first video that is captured by the terminal and includes a plurality of frames;

displaying a second video that is captured by the counterpart terminal in a display of the terminal;

censoring the first video based on a censorship algorithm for determining whether or not at least one object preset as an inappropriate element is included in a frame within a video; and

displaying the first video on the display instead of the second video received from the counterpart terminal when it is determined that the at least one object is included in at least one of the plurality of frames of the first video as a result of censoring the first video.

2. The operating method of the terminal of claim 1 , wherein the second video is displayed in a region of the display and displaying of the first video on the display instead of the second video comprises:

displaying the first video in the region where the second video received from the counterpart terminal is intended to be displayed according to the establishing of the video call session; and

controlling the at least one frame not to be transmitted to the counterpart terminal.

3. The operating method of the terminal of claim 1 further comprising displaying the first video in a first region of the display, wherein the second video is displayed in a second region of the display, wherein the displaying of the first video instead of the second video comprises:

removing the second region where the second video received from the counterpart terminal is intended to be displayed according to the establishing of the video call session

displaying the first video by enlarging the first region where the first video captured by the terminal is displayed; and

displaying the at least one frame in the first region during a preset time.

4. The operating method of the terminal of claim 1 , further comprising:

preparing the censorship algorithm in which an algorithm for detecting a frame including the at least one object is learned, based on a plurality of reference frames and information indicating whether or not the at least one object preset as the inappropriate element is included in each of the plurality of reference frames.

5. The operating method of the terminal of claim 4 , wherein the preparing of the censorship algorithm comprises:

learning the plurality of reference frames based on information for determining an inappropriate reference frame including the at least one object and a normal reference frame without including the at least one object, through an artificial neural network; and

learning the censorship algorithm for detecting a frame including the at least one object based on results of learning the plurality of reference frames.

6. The operating method of the terminal of claim 4 , wherein the preparing of the censorship algorithm includes updating the censorship algorithm stored in the terminal, and

wherein the updating of the censorship algorithm includes at least one of:

updating the censorship algorithm based on results of learning a first frame detected from the censorship algorithm or a second frame reported as an inappropriate frame from an external terminal, and

receiving an updated censorship algorithm from a server.

7. The operating method of the terminal of claim 5 , wherein the learning of the plurality of reference frames includes learning the plurality of reference frames based on at least one of a configuration of the at least one object, a color of the at least one object, and an arrangement between the at least one object and a surrounding object within the inappropriate reference frame.

8. The operating method of the terminal of claim 1 , wherein the censoring of the first video based on the censorship algorithm comprises:

calculating a probability that the at least one object is in the plurality of frames, or a similarity between a reference frame set as an inappropriate frame and the plurality of frames, based on a criterion for determining whether or not at least one object preset as an inappropriate element is included in a frame within the video; and

detecting a frame including the at least one object from among the plurality of frames based on the calculated probability or similarity.

9. The operating method of the terminal of claim 1 , wherein the censoring of the first video based on the censorship algorithm comprises censoring the plurality of frames based on the censorship algorithm before the first video acquired by the terminal according to the video call session is transmitted to the counterpart terminal.

10. The operating method of the terminal of claim 1 , wherein the censoring of the first video based on the censorship algorithm comprises:

censoring a randomly sampled frame among the plurality of frames based on the censorship algorithm; and

censoring a frame that is not randomly sampled among the plurality of frames based on the censorship algorithm after the first video is transmitted to the counterpart terminal according to results of censoring the randomly sampled frame.

11. The operating method of the terminal of claim 1 , further comprising:

censoring a video captured by the terminal based on the censorship algorithm before the video call session is established; and

determining whether or not to establish the video call session based on results of censoring the video.

12. The operating method of the terminal of claim 1 , further comprising:

controlling a second frame next to a first frame and subsequent frames not to be transmitted to the counterpart terminal, when it is determined that the at least one object is included in the first frame among the plurality of frames as results of censoring the first video.

13. The operating method of the terminal of claim 1 , further comprising at least one of:

controlling the at least one frame not to be transmitted to the counterpart terminal when it is determined that the at least one object is included in at least one of the plurality of frames as results of censoring the first video; and

performing video processing for a target region where the at least one object is displayed so that the at least one object is not displayed in the at least one frame, and transmitting at least one frame in which the target region is video-processed to the counterpart terminal.

14. A server comprising:

a communication interface that communicates with a plurality of terminals;

a storage;

a processor; and

a memory that stores commands executed by the processor,

wherein the processor executes the commands to

learn a censorship algorithm for detecting a frame including the at least one object based on a plurality of reference frames and information indicating whether or not the at least one object preset as an inappropriate element is included in each of the plurality of reference frames,

check establishment of a video call session between a first terminal and a second terminal,

receive, from the first terminal, a first video that is captured by the first terminal and includes a plurality of frames,

receive, from the second terminal, a second video that is captured by the second terminal;

control an operation of the first terminal so that the second video is displayed in a display of the first terminal;

censor the first video based on the censorship algorithm, and

control an operation of the first terminal so that the first video is displayed on the display of the first terminal instead of the second video received from the second terminal when it is determined that the at least one object is included in at least one of the plurality of frames of the first video as a result of censoring the first video.

15. A terminal comprising:

a communication interface that communicates with an external device;

an input/output interface that includes a display;

a processor; and

a memory that stores commands capable of being executed by the processor, wherein the processor executes the commands to:

establish a video call session between the terminal and a counterpart terminal,

acquire a first video including a plurality of frames imaged by the terminal,

display a second video that is captured by the counterpart terminal on the display of the terminal;

censor the first video based on a censorship algorithm for determining whether or not at least one object preset as an inappropriate element is included in a frame of a video, and

display the first video on the display instead of a second video received from the counterpart terminal when it is determined that the at least one object is included in at least one of the plurality of frames of the first video as a result of censoring the first video.

16. The operating method of the terminal of claim 1 further comprising displaying the first video in a first region of the display, wherein the second video is displayed in a second region of the display, wherein displaying the first video instead of the second video comprises displaying the first video in the second region of the display.

Assignments (3)
CONFIRMATION OF ASSIGNMENT Recorded Nov 30, 2022
From: AHN, SANG IL
To: HYPERCONNECT INC.
Reel/Frame 062026/0401 →
CONFIRMATION OF ASSIGNMENT Recorded Nov 29, 2022
From: KANG, OH SUNG
To: HYPERCONNECT INC.
Reel/Frame 062018/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2020
From: AHN, SANG IL; KANG, OH SUNG
To: HYPERCONNECT, INC.
Reel/Frame 053993/0319 →