IP Library Granted Patent US 10,560,659
Granted Patent B2
US 10,560,659 · App. 16/223,770 · Granted Feb 11, 2020

Terminal for providing video call service

Inventors: Sang Il Ahn (Chungcheongbuk-do, KR); Hee Min Choi (Seoul, KR)
Assignee: HYPERCONNECT, INC.
H04N7/141G06F3/04817G06K9/00302H04N5/445
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,560,659
App. No.
16/223,770
Granted
Feb 11, 2020
Kind
B2
Abstract

Provided is an application stored in a computer-readable storage medium to perform a method of providing a video call service using icon information corresponding to a facial expression of a user.

Claims (45)

1. An application stored in a computer-readable storage medium to perform a method of providing a video call service, the method comprising:

in a first terminal,

establishing a video call session between the first terminal of a first user and a second terminal of a second user;

detecting a facial expression of the first user from a first video stream that captures the first user;

generating icon information corresponding to the detected facial expression of the first user; and

transmitting the generated icon information to the second terminal,

wherein the detecting of the facial expression of the first user comprises recognizing intensity of the facial expression by comparing a threshold value with a value corresponding to a distance difference between feature points corresponding to each other in no facial expression of the first user and the detected facial expression of the first user.

2. The application of claim 1 , wherein the method further comprises:

receiving, from the second terminal, icon information corresponding to a facial expression of the second user detected from a second video stream that captures the second user; and

receiving, from a server, virtual property information usable for the video call service, as a response to the transmission of the icon information of the first user including the received icon information to the server for providing the video call service.

3. The application of claim 1 , wherein the method further comprises receiving, from a server, virtual property information usable for the video call service, as a response to the transmission of the icon information of the first user including the transmitted icon information to the server for providing the video call service.

4. The application of claim 1 , wherein the method further comprises:

receiving, from the second terminal, icon information corresponding to a facial expression of the second user detected from a second video stream that captures the second user; and

when the received icon information and the transmitted icon information are the same, updating the icon information of the first user.

5. The application of claim 1 , wherein the method further comprises detecting a facial expression of the second user from a second video stream that captures the second user and is received from the second terminal, and

wherein, in the generating of the icon information, when the detected facial expression of the first user and the detected facial expression of the second user are the same, icon information corresponding to the detected facial expression of the first user is generated.

6. The application of claim 1 , wherein the method further comprises:

detecting predetermined voice from voice of the first user; and

when the detected facial expression of the first user and the detected predetermined voice are matched with each other, updating the icon information of the first user.

7. The application of claim 1 ,

wherein the generating of the icon information comprises updating icon information corresponding to the detected facial expression of the first user based on the recognized intensity of the facial expression.

8. The application of claim 1 , wherein the method further comprises:

displaying mission icon information on a screen of the first terminal; and

when the generated icon information and displayed mission icon information are the same, updating the icon information of the first user.

9. An application stored in a computer-readable storage medium to perform a method of providing a video call service, the method comprising:

in a first terminal,

establishing a video call session between the first terminal of a first user and a second terminal of a second user who is a counterpart in a video call;

detecting a facial expression of the second user from a second video stream that captures the second user and is received from the second terminal;

generating icon information corresponding to the detected facial expression of the second user; and

displaying the generated icon information on a screen of the first terminal,

wherein the detecting of the facial expression of the second user comprises recognizing intensity of the facial expression by comparing a threshold value with a value corresponding to a distance difference between feature points corresponding to each other in no facial expression of the second user and the detected facial expression of the second user.

10. The application of claim 9 , wherein the method further comprises receiving, from a server, virtual property information usable for the video call service, as a response to the transmission of the icon information of the first user including the displayed icon information to the server for providing the video call service.

11. The application of claim 9 , wherein the method further comprises detecting a facial expression of the first user from a first video stream that captures the first user, and

wherein, in the generating of the icon information, when the detected facial expression of the second user and the detected facial expression of the first user are the same, icon information corresponding to the detected facial expression of the second user is generated.

12. The application of claim 9 , wherein the method further comprises:

detecting predetermined voice from voice of the first user; and

when the detected facial expression of the second user and the detected predetermined voice are matched with each other, updating the icon information of the first user.

13. The application of claim 9 ,

wherein the generating of the icon information comprises updating icon information corresponding to the detected facial expression of the second user based on the recognized intensity of the facial expression.

14. A non-transitory computer-readable storage medium storing instructions that are executable by a processor, the instructions comprising:

instructions to establish a video call session between the first terminal of a first user and a second terminal of a second user;

instructions to detect a facial expression of the first user from a first video stream that captures the first user;

instructions to generate icon information corresponding to the detected facial expression of the first user; and

instructions to transmit the generated icon information to the second terminal,

wherein the instructions to detect the facial expression of the first user comprises recognizing intensity of the facial expression by comparing a threshold value with a value corresponding to a distance difference between feature points corresponding to each other in no facial expression of the first user and the detected facial expression of the first user.

Assignments (3)
CONFIRMATION OF ASSIGNMENT Recorded Nov 30, 2022
From: AHN, SANG IL
To: HYPERCONNECT INC.
Reel/Frame 062026/0401 →
CONFIRMATION OF ASSIGNMENT Recorded Nov 18, 2022
From: CHOI, HEE MIN
To: HYPERCONNECT INC.
Reel/Frame 061966/0029 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2018
From: AHN, SANG IL; CHOI, HEE MIN
To: HYPERCONNECT, INC.
Reel/Frame 047807/0132 →