IP Library › Granted Patent US 10,750,102
Granted Patent B2
US 10,750,102 · App. 16/196,442 · Granted Aug 18, 2020

Method of providing interactable visual object during video call and system performing method

Inventor: Sangil Ahn (Seoul, KR)
Assignee: Hyperconnect, Inc.
H04N5/272G06K9/00302H04N5/4403H04N7/141H04N7/147G06F3/017G06F3/0488G06F3/167G06T7/20G06T2207/30196H04N5/44591H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,750,102
App. No.
16/196,442
Filed
Nov 20, 2018
Granted
Aug 18, 2020
Kind
B2
Examiner
ANWAH, OLISA
Art Unit
2655
USPC
348/14.03
Abstract

A method of providing an interactable visual object capable of being manipulated in terminals on both sides during a video call and a system performing the same.

Claims (66)

1. A method of providing an interactable visual object, comprising:

establishing, by a first terminal and a second terminal, a video call session;

displaying, by the first terminal, a first video photographed by the second terminal and provided to the first terminal;

displaying, by the second terminal, a second video photographed by the first terminal and provided to the second terminal;

displaying, by the first terminal, a first appearance of an interactable visual object by overlaying the first appearance on the first video;

displaying, by the second terminal, the first appearance of the visual object by overlaying the first appearance on the second video;

displaying, by the first terminal, a second appearance of the visual object different from the first appearance of the visual object by overlaying the second appearance on the first video when a first user action caused by a user of the first terminal or a user of the second terminal is detected while the first appearance of the visual object is displayed or after the first appearance is displayed; and

displaying, by the second terminal, the second appearance of the visual object by overlaying the second appearance on the second video when the first user action caused by the user of the first terminal or the user of the second terminal is detected,

wherein:

the first and second appearances of the visual object are separate and distinct from each other and occur at different times;

the second appearance of the visual object is any one of predefined two or more different selectable appearances;

the first user action is any one of previously designated two or more different user actions; and

each of the two or more user actions corresponds to any one of the two or more different selectable appearances.

2. The method of claim 1 , wherein the second appearance of the visual object displayed by the first terminal and the second terminal when the first user action caused by the user of the first terminal is detected and the second appearance of the visual object displayed by the first terminal and the second terminal when the first user action caused by the user of the second terminal is detected are identical.

3. The method of claim 1 , wherein:

the step of displaying, by the first terminal, a second appearance of the visual object different from the first appearance of the visual object by overlaying the second appearance on the first video comprises a step of displaying, by the first terminal, a selectable appearance corresponding to the first user action by overlaying the selectable appearance on the first video; and

the step of displaying, by the second terminal, the second appearance of the visual object by overlaying the second appearance on the second video comprises a step of displaying, by the second terminal, the selectable appearance corresponding to the first user action by overlaying the selectable appearance on the second video.

4. The method of claim 1 , further comprising:

when a second user action caused by the user of the second terminal is detected while the second appearance of the visual object is displayed or after the second appearance is displayed,

displaying, by the second terminal, a third appearance of the visual object different from the second appearance of the visual object by overlaying the third appearance on the second video; and

displaying, by the first terminal, the third appearance of the visual object by overlaying the third appearance on the first video.

5. The method of claim 1 , further comprising sensing, by the first terminal, the first user action based on a user input received through an input interface or transmitting information about the user input received through the input interface to a given external system,

wherein the external system detects the first user action based on the information about the received user input.

6. The method of claim 5 , wherein the input interface comprises at least one of a touch sensor receiving a touch input, a microphone receiving a sound input, a sensor measuring motion information of the first terminal, and a camera module capturing an image.

7. The method of claim 1 , further comprising:

performing, by the first terminal, expression recognition or motion recognition by analyzing an image photographed by the first terminal comprising a camera module; and

detecting, by the first terminal, the first user action based on a result of the executed expression recognition or motion recognition.

8. The method of claim 1 , further comprising:

transmitting, by the first terminal, an image photographed by the first terminal comprising a camera module to a given external system;

performing, by the external system, expression recognition or motion recognition by analyzing the image photographed by the first terminal; and

detecting, by the external system, the first user action based on a result of the executed expression recognition or motion recognition.

9. A method of providing an interactable visual object, comprising:

selecting, by a visual object provision system, any one of a plurality of interactable visual objects;

providing, by the visual object provision system, a first appearance of the selected visual object to a first terminal and a second terminal performing a video call with the first terminal; and

providing, by the visual object provision system, a second appearance of the visual object different from the first appearance of the visual object to the first terminal and the second terminal when a first user action caused by a user of the first terminal or a user of the second terminal is detected while the first appearance of the visual object is displayed or after the first appearance is displayed,

wherein:

the first and second appearances of the visual object are separate and distinct from each other and occur at different times;

the second appearance of the visual object is any one of predefined two or more different selectable appearances;

the first user action is any one of previously designated two or more different user actions; and

each of the two or more user actions corresponds to any one of the two or more different selectable appearances.

10. A method of providing an interactable visual object, comprising:

selecting, by a visual object provision system, any one of a plurality of interactable visual objects; and

providing, by the visual object provision system, package information corresponding to the selected visual object to a first terminal and a second terminal performing a video call with the first terminal,

wherein:

the package information comprises information about a first appearance of the visual object and information about a second appearance of the visual object different from the first appearance of the visual object;

the first terminal displays a first video photographed by the second terminal and provided to the first terminal and displays the first appearance of the visual object based on the provided package information by overlaying the first appearance on the first video;

the second terminal displays a second video photographed by the first terminal and provided to the second terminal and displays the first appearance of the visual object based on the provided package information by overlaying the first appearance on the second video;

when a first user action caused by a user of the first terminal or a user of the second terminal is detected while the first appearance of the visual object is displayed or after the first appearance is displayed, the first terminal displays the second appearance of the visual object based on the provided package information by overlaying the second appearance on the first video;

the second terminal displays the second appearance of the visual object based on the provided package information by overlaying the second appearance on the second video;

the first and second appearances of the visual object are separate and distinct from each other and occur at different times;

the second appearance of the visual object is any one of predefined two or more different selectable appearances;

the first user action is any one of previously designated two or more different user actions; and

each of the two or more user actions corresponds to any one of the two or more different selectable appearances.

11. The method of claim 9 , wherein the step of selecting, by a visual object provision system, any one of a plurality of interactable visual objects, comprises a step of selecting, by the visual object provision system, the visual object based on at least one of information of a first user corresponding to the first terminal and comprising at least one of date of birth, an age, sex, nationality, an address, an access place, and an area of interest, information of a second user corresponding to the second terminal as a result of analysis of an image photographed the first terminal and comprising at least one of date of birth, an age, sex, nationality, an address, an access place, and an area of interest, and a time when a determination is made as a result of analysis of an image photographed by the second terminal.

12. A computer-readable recording medium in which a computer program for performing a method according to claim 1 is stored.

13. A visual object provision system, comprising:

a processor; and

a memory storing a computer program,

wherein the computer program enables the visual object provision system to perform a method according to claim 9 when the computer program is executed by the processor.

14. The method of claim 10 , wherein the step of selecting, by a visual object provision system, any one of a plurality of interactable visual objects, comprises a step of selecting, by the visual object provision system, the visual object based on at least one of information of a first user corresponding to the first terminal and comprising at least one of date of birth, an age, sex, nationality, an address, an access place, and an area of interest, information of a second user corresponding to the second terminal as a result of analysis of an image photographed the first terminal and comprising at least one of date of birth, an age, sex, nationality, an address, an access place, and an area of interest, and a time when a determination is made as a result of analysis of an image photographed by the second terminal.

15. A computer-readable recording medium in which a computer program for performing a method according to claim 9 is stored.

16. A computer-readable recording medium in which a computer program for performing a method according to claim 10 is stored.

17. A visual object provision system, comprising:

a processor; and

a memory storing a computer program,

wherein the computer program enables the visual object provision system to perform a method according to claim 10 when the computer program is executed by the processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2018
From: AHN, SANGIL
To: HYPERCONNECT, INC.
Reel/Frame 047554/0608 →
Priority Claims (1)
KR 10-2017-0155288 · Nov 21, 2017 · national
Continuity (1)
Related Publication 20190222775A1 · Jul 18, 2019
Cited By (2)
US 12,315,293 US 12,505,500