IP Library Granted Patent US 10,911,717
Granted Patent B2
US 10,911,717 · App. 16/734,805 · Granted Feb 2, 2021

Method and system for providing video stream of video conference

Inventor: Jung nam Gwock (Seongnam-si, KR)
Assignee: LINE CORPORATION
H04N7/152H04L65/403H04L65/605H04L65/607H04N5/343H04N5/23245H04N7/147H04N7/148
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,911,717
App. No.
16/734,805
Granted
Feb 2, 2021
Kind
B2
Abstract

Provided is a method and system for providing a video stream for a video conference. A video stream providing method may include managing class information in which a resolution range for the video conference is classified into a plurality of classes; determining at least two classes in which a resolution providable from a source providing client that participates in the video conference is included among the plurality of classes, based on the class information; encoding a video stream for the video conference as a plurality of layers using a resolution set for each of the determined at least two classes; and controlling an electronic device of the source providing client to transmit the video stream encoded as the plurality of layers to a server for the video conference over a network.

Claims (68)

1. A source providing client device for providing a video stream for a video conference over a network, the device comprising:

a memory having computer readable instructions stored thereon; and

at least one processor configured to execute the computer readable instructions to,

record video associated with a video conference based on hardware characteristics of the source providing client device;

generate video resolution available information including at least one layer of a plurality of layers associated with a video stream of the video conference, the video resolution available information indicating a video resolution available for the source providing client to encode or decode the video stream;

encode the recorded video as the video stream using the video resolution selected for the at least one layer of the plurality of layers, the selected video resolution being included within a video resolution range of the corresponding at least one layer; and

transmit the encoded video stream and the video resolution available information to a server associated with the video conference over a network,

wherein the least one layer of the plurality of layers includes:

a layer corresponding to a video resolution of the encoded video stream, and

at least one higher layer of the plurality of layers corresponding to a higher video resolution than the resolution of the encoded video stream;

wherein the at least one higher layer includes additional information over the encoded video stream for constructing a video stream of the recorded video encoded using the higher video resolution; and

wherein at least one higher layer including the additional information and the layer corresponding to the video resolution of the encoded video stream are used for constructing the video stream encoded using the higher video resolution.

2. The source providing client device of claim 1 , wherein the at least one processor is further configured to:

select the video resolution of are reference layer among the plurality of layers based on a video resolution of the recorded video; and

select the video resolution of each of the other layers among the plurality of layers based on the video resolution of the reference layer.

3. The source providing client device of claim 1 , wherein the at least one processor is further configured to:

generate the plurality of layers based on a reference layer, the plurality of layers including at least a first layer and a second layer, the second layer having a higher resolution range than the first layer, wherein

a video resolution of the reference layer is based on a video resolution of the originally recorded video.

4. The source providing client device of claim 3 , wherein the at least one processor is further configured to:

generate the first layer and the second layer using different encoding formats.

5. The source providing client device of claim 3 , wherein the at least one processor is further configured to:

generate the first layer by downscaling the reference layer and encoding the downscaled reference layer.

6. The source providing client device of claim 3 , wherein the at least one processor is further configured to:

generate the second layer based on the reference layer and metadata associated with inter-layer prediction.

7. A non-transitory computer readable medium including computer readable instructions, which when executed by at least one processor of a source providing client device for providing a video stream of a video conference, causes the at least one processor to:

record video associated with a video conference based on hardware characteristics of the source providing client device;

generate video resolution available information including at least one layer of a plurality of layers associated with a video stream of the video conference, the video resolution available information indicating a video resolution available for the source providing client to encode or decode the video stream;

encode the recorded video as the video stream using the video resolution selected for the at least one layer of the plurality of layers, the selected video resolution being included within a video resolution range of the corresponding at least one layer; and

transmit the encoded video stream and the video resolution available information to a server associated with the video conference over a network,

wherein the at least one layer of the plurality of layers includes:

a layer corresponding to a video resolution of the encoded video stream, and

at least one higher layer of the plurality of layers corresponding to a higher video resolution than the resolution of the encoded video stream;

wherein the at least one higher layer includes additional information over the encoded video stream for constructing a video stream of the recorded video encoded using the higher video resolution; and

wherein the at least one higher layer including the additional information and the layer corresponding to the video resolution of the encoded video stream are used for constructing the video stream encoded using the higher video resolution.

8. The non-transitory computer readable medium of claim 7 , wherein the at least one processor is further caused to:

select the video resolution of a reference layer among the plurality of layers based on a video resolution of the recorded video; and

select the video resolution of each of the other layers among the plurality of layers based on the video resolution of the reference layer.

9. The non-transitory computer readable medium of claim 7 , wherein the at least one processor is further caused to:

generate the plurality of layers based on a reference layer, the plurality of layers including at least a first layer and a second layer, the second layer having a higher resolution range than the first layer, wherein

a video resolution of the reference layer is based on a video resolution of the originally recorded video.

10. The non-transitory computer readable medium of claim 9 , wherein the at least one processor is further caused to:

generate the first layer and the second layer using different encoding formats.

11. The non-transitory computer readable medium of claim 9 , wherein the at least one processor is further caused to:

generate the first layer by downscaling the reference layer and encoding the downscaled reference layer.

12. The non-transitory computer readable medium of claim 9 , wherein the at least one processor is further caused to:

generate the second layer based on the reference layer and metadata associated with inter-layer prediction.

13. A video stream providing method for a video conference using a source providing client device comprising:

recording video associated with a video conference based on hardware characteristics of the source providing client device;

generating video resolution available information including at least one layer of a plurality of layers associated with a video stream of the video conference, each of the at least one layer of the plurality of layers associated with a video resolution range, the video resolution available information indicating a video resolution available for the source providing client to encode or decode the video stream;

encoding the recorded video as the video stream using the video resolution selected for the at least one layer of the plurality of layers, the selected video resolution being included within the video resolution range of the corresponding at least one layer; and

transmitting the encoded video stream and the video resolution available information to a server associated with the video conference over a network,

wherein the at least one layer of the plurality of layers includes:

a layer corresponding to a video resolution of the encoded video stream; and

at least one higher layer of the plurality of layers corresponding to a higher video resolution than the resolution of the encoded video stream;

wherein the at least one higher layer includes additional information over the encoded video stream for constructing a video stream of the recorded video encoded using the higher video resolution; and

wherein the at least one higher layer including the additional information and the layer corresponding to the video resolution of the encoded video stream are used for constructing the video stream encoded using the higher video resolution.

14. The method of claim 13 , further comprising:

selecting the video resolution of a reference layer among the plurality of layers based on a video resolution of the recorded video; and

selecting the video resolution of each of the other layers among the plurality of layers based on the video resolution of the reference layer.

15. The method of claim 13 , further comprising:

generating the plurality of layers based on a reference layer, the plurality of layers including at least a first layer and a second layer, the second layer having a higher resolution range than the first layer, wherein

a video resolution of the reference layer is based on a video resolution of the originally recorded video.

16. The method of claim 15 , further comprising:

generating the first layer and the second layer using different encoding formats.

17. The method of claim 15 , further comprising:

generating the first layer by downscaling the reference layer and encoding the downscaled reference layer.

18. The method of claim 15 , further comprising:

generating the second layer based on the reference layer and metadata associated with inter-layer prediction.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067096/0431 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
Priority Claims (1)
KR 10-2016-0103738 · Aug 16, 2016 · national
Continuity (3)
Division 16356298 · Mar 18, 2019
Continuation 15673854 · Aug 10, 2017
Related Publication 20200145614A1 · May 7, 2020