IP Library Granted Patent US 10,182,095
Granted Patent B2
US 10,182,095 · App. 15/722,304 · Granted Jan 15, 2019

Method and system for video call using two-way communication of visual or auditory effect

Inventor: Keum Ryong Kim (Seongnam-si, KR)
Assignee: Line Corporation
H04L65/605G06F17/30781H04L65/1083H04L65/4015H04L65/80H04N7/147H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,182,095
App. No.
15/722,304
Granted
Jan 15, 2019
Kind
B2
Abstract

A video call method and system may use a two-way transmission of a visual effect or an auditory effect. A server may manage and store content that includes visual information or auditory information as an effect to apply to a video call in association with an effect identifier. A server may receive, during the video call, an effect identifier and may transmit the visual information or audio information associated with the effect identifier to a reception-side electronic device together with a data packet for the video call.

Claims (39)

1. A video call method implemented by a computer comprising:

managing contents including visual information or auditory information;

determining contents for applying to a video call among the managed contents;

changing at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call and the determined contents; and

transmitting the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call, wherein

the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call according to the changed parameter

wherein the transmission type is one of a first transmission type for synthesizing the visual information with the video included in the data packet and a second transmission type for transmitting the visual information separate from the video included the data packet to be overlaid on the video included the data packet, and

wherein the changing at least one parameter of the transmission type changes the transmission type in accordance with the network traffic to one of the first transmission type and the second transmission type.

2. The method of claim 1 , wherein the determining contents determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the data packet, and determines contents based on the determined information.

3. The method of claim 1 , wherein the determining contents determines contents by using user facial feature information acquired by analyzing a video included in the data packet.

4. The method of claim 1 , wherein the determining contents determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

5. The method of claim 1 , wherein the determining contents determines contents by using user body information measured at and transmitted from a sensor.

6. The method of claim 1 , wherein the determining contents determines contents by using at least one of state information set to a conversation application and a conversation log stored in the conversation application.

7. The method of claim 1 , wherein the transmitting in association with the data packet transmits the determined contents at the determined data transmission rate in order to synchronize an application time of the auditory information with respect to a voice signal included in the data packet.

8. A non-transitory computer-readable recording medium storing computer readable instructions that, when executed by at least one processor in a computer, causes the at least one processor to perform a video call method, the call method comprising:

managing contents including visual information or auditory information;

determining contents for applying to a video call among the managed contents;

changing at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call and the determined contents; and

transmitting the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call, wherein

the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call according to the changed parameter

wherein the transmission type is one of a first transmission type for synthesizing the visual information with the video included in the data packet and a second transmission type for transmitting the visual information separate from the video included the data packet to be overlaid on the video included the data packet, and

wherein the changing at least one parameter of the transmission type changes the transmission type in accordance with the network traffic to one of the first transmission type and the second transmission type.

9. The non-transitory computer-readable recording medium of claim 8 , wherein the determining contents determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the data packet, and determines contents based on the determined information.

10. The non-transitory computer-readable recording medium of claim 8 , wherein the determining contents determines contents by using user facial feature information acquired by analyzing a video included in the data packet.

11. The non-transitory computer-readable recording medium of claim 8 , wherein the determining contents determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

12. The non-transitory computer-readable recording medium of claim 8 , wherein the determining contents determines contents by using user body information measured at and transmitted from a sensor.

13. The non-transitory computer-readable recording medium of claim 8 , the determining contents determines contents by using at least one of state information set to a conversation application and a conversation log stored in the conversation application.

14. A video call system implemented by a computer comprises:

at least one processor configured to execute computer-readable instructions on the computer,

wherein the at least one processor manages contents including visual information or auditory information,

determines contents for applying to a video call among the managed contents,

changes at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call and the determined contents; and

transmits the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call, wherein

the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call according to the changed parameter

wherein the transmission type is one of a first transmission type for synthesizing the visual information with the video included in the data packet and a second transmission type for transmitting the visual information separate from the video included the data packet to be overlaid on the video included the data packet, and

wherein the changing at least one parameter of the transmission type changes the transmission type in accordance with the network traffic to one of the first transmission type and the second transmission type.

15. The system of claim 14 , wherein the at least one processor, for determining the contents, determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the date packet, and determines contents based on the determined information.

16. The system of claim 14 , wherein the at least one processor, for determining the contents, determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

17. The system of claim 14 , wherein the at least one processor, for determining the contents, determines contents by using at least one of user body information measured at and transmitted from a sensor, facial feature information acquired by analyzing a video included in the data packet, state information set to a conversation application, and a conversation log stored in the conversation application.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067096/0431 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
Priority Claims (1)
KR 10-2015-0179248 · Dec 15, 2015 · national
Continuity (2)
Continuation 15378860 · Dec 14, 2016
Related Publication 20180027042A1 · Jan 25, 2018