IP Library Granted Patent US 10,129,504
Granted Patent B2
US 10,129,504 · App. 15/674,595 · Granted Nov 13, 2018

Method and system for measuring quality of video call

Inventor: Jung nam Gwock (Seongnam-si, KR)
Assignee: Line Corporation
H04N7/147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,129,504
App. No.
15/674,595
Granted
Nov 13, 2018
Kind
B2
Abstract

Provided is a quality-of-video call measuring method and system. The quality-of-video call measuring method may include capturing a display screen of a second electronic device that performs video call with a first electronic device over network. The captured display screen may include a frame image associated with first electronic device and a frame image associated with second electronic device. The frame image associated with first electronic device may include a first time value. The frame image associated with second electronic device may include a second time value. The quality-of-video call measuring method may include analyzing the captured display screen, and extracting the first time value included in the frame image associated with first electronic device and the second time value included in the frame image associated with second electronic device; and calculating at least one parameter indicating a quality of video call using the extracted first and second time values.

Claims (52)

1. A quality-of-video call measuring method of a quality-of-video call measuring apparatus, the method comprising:

capturing, using at least one processor, a display screen of a second electronic device that performs a first video call with a first electronic device over a network, the captured display screen comprising at least one first frame image associated with the first electronic device and at least one second frame image associated with the second electronic device, and the first frame image comprising a first time value and the second frame image comprising a second time value, the first video call including,

a test video call, the test video call including the first electronic device and the second electronic device both transmitting a first source video to a counter party of the test video call, and

a plurality of frames included in the first source video sequentially including consecutive time values at desired time intervals;

analyzing, using the at least one processor, the captured display screen, and extracting the first time value included in the first frame image and the second time value included in the second frame image; and

calculating, using the at least one processor, at least one parameter indicating a quality of the first video call based on the extracted first time value and the extracted second time value.

2. The method of claim 1 , wherein the first frame image is at least one first frame among the plurality of frames included in the first source video that is transmitted from the first electronic device to the second electronic device for the test video call and is displayed on at least a portion of a screen of the second electronic device with the first time value corresponding to the first frame; and

the second frame image is at least one second frame among the plurality frames included in the first source video that is to be transmitted from the second electronic device to the first electronic device for the test video call and is displayed on at least a portion of the screen of the second electronic device with the second time value corresponding to the second frame.

3. The method of claim 1 , wherein the calculating of the at least one parameter comprises calculating a difference value between the first time value and the second time value as a parameter for an end-to-end network delay between the first electronic device and the second electronic device.

4. The method of claim 1 , wherein

the capturing comprises sequentially capturing a plurality of display screens; and

the calculating of the at least one parameter comprises calculating a difference value between first time values corresponding to consecutive frames of the first source video based on a plurality of first time values extracted from the plurality of display screens, and calculating an inverse number of a minimum value of the calculated difference values as a parameter for a frames per second (FPS) value of the first video call.

5. The method of claim 4 , wherein the calculating of the at least one parameter comprises calculating at least one of a moving average and a cumulative distribution with respect to a frame interval between frames of the first source video based on the calculated difference value as the frame interval.

6. The method of claim 1 , the method further comprising:

determining a frame corresponding to the first frame image among a plurality of frames included in the first video call; and

calculating a peak signal-to-noise ratio (PSNR) between the first frame image and the determined frame.

7. The method of claim 1 , wherein the capturing comprises creating an image input in response to photographing the display screen of the second electronic device through a camera included in the quality-of-video call measuring apparatus as the captured display screen.

8. An apparatus for measuring a quality of video call, the apparatus comprising:

at least one processor configured to execute computer-readable instructions included in a memory to,

capture a display screen of a second electronic device that performs a first video call with a first electronic device over a network, the captured display screen comprising a first frame image associated with the first electronic device and a second frame image associated with the second electronic device, and the first frame image comprising a first time value and the second frame image comprising a second time value, the first video call including,

a test video call, the test video call including the first electronic device and the second electronic device both transmitting a first source video to a counter party of the test video call, and

a plurality of frames included in the first source video sequentially including consecutive time values at desired time intervals,

analyze the captured display screen, and extract the first time value included in the first frame image and the second time value included in the second frame image, and

calculate at least one parameter indicating a quality of the first video call based on the extracted first time value and the extracted second time value.

9. The apparatus of claim 8 , wherein the first frame image is at least one first frame among the plurality of frames included in the first source video that is transmitted from the first electronic device to the second electronic device for the test video call and is displayed on at least a portion of a screen of the second electronic device with the first time value corresponding to the first frame, and

the first frame image associated with the second electronic device is at least one second frame among the plurality of frames included in the first source video that is to be transmitted from the second electronic device to the first electronic device for the test video call and is displayed on at least a portion of the screen of the second electronic device with the second time value corresponding to the second frame.

10. The apparatus of claim 8 , wherein the at least one processor is further configured to calculate a difference value between the first time value and the second time value as a parameter for an end-to-end network delay between the first electronic device and the second electronic device.

11. The apparatus of claim 8 , wherein

the at least one processor is further configured to,

sequentially capture a plurality of display screens, and

calculate difference values between first time values corresponding to consecutive frames of the first source video based on a plurality of first time values extracted from the plurality of display screens, respectively, and to calculate an inverse number of a minimum value of the calculated difference values as a parameter for a-frames per second (FPS).

12. The apparatus of claim 11 , wherein the at least one processor is further configured to calculate at least one of a moving average and a cumulative distribution with respect to a frame interval between frames of the first source video based on the calculated difference value as the frame interval.

13. The apparatus of claim 8 , wherein the at least one processor is further configured to:

determine a first frame corresponding to the first frame image among a plurality of frames included in the first video call; and

calculate a peak signal-to-noise ratio (PSNR) between the first frame image associated with the first electronic device and the determined frame.

14. The apparatus of claim 8 , further comprising:

a camera configured to photograph the display screen of the second electronic device,

wherein the at least one processor is further configured to create an image input through the camera as the captured display screen.

15. A non-transitory computer-readable storage medium storing computer readable instructions that, when executed by at least one processor, cause the at least one processor to:

capture a display screen of a second electronic device that performs a first video call with a first electronic device over a network, the captured display screen comprising a first frame image associated with the first electronic device and a second frame image associated with the second electronic device, and the first frame image comprising a first time value and the second frame image comprising a second time value, the first video call including,

a test video call, the test video call including the first electronic device and the second electronic device both transmitting a first source video to a counter party of the test video call, and

a plurality of frames included in the first source video sequentially including consecutive time values at desired time intervals;

analyze the captured display screen, and extracting the first time value included in the first frame image and the second time value included in the second frame image; and

calculate at least one parameter indicating a quality of the first video call based on the extracted first time value and the extracted second time value.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the first frame image is a first frame among the plurality of frames included in the first source video that is transmitted from the first electronic device to the second electronic device for the test video call and is displayed on at least a portion of a screen of the second electronic device with the first time value corresponding to the first frame, and

the second frame image associated with the second electronic device is a second frame among the plurality of frames included in the first source video that is to be transmitted from the second electronic device to the first electronic device for the test video call and is displayed on at least a portion of the screen of the second electronic device with the second time value corresponding to the second frame.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the calculating of the at least one parameter comprises calculating a difference value between the first time value and the second time value as a parameter for an end-to-end network delay between the first electronic device and the second electronic device.

18. The method of claim 1 , the method further comprising:

calculating, using the at least one processor, the at least one parameter indicating the quality of the first video call based on image resolution values of the first frame image and the second frame image.

19. The apparatus of claim 8 , wherein the at least one processor is further configured to calculate the at least one parameter indicating the quality of the first video call based on image resolution values of the first frame image and the second frame image.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the method further comprises:

calculating the at least one parameter indicating the quality of the first video call based on image resolution values of the first frame image and the second frame image.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067096/0431 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2017
From: GWOCK, JUNG NAM
To: LINE CORPORATION
Reel/Frame 043266/0907 →
Priority Claims (1)
KR 10-2016-0102938 · Aug 12, 2016 · national
Continuity (1)
Related Publication 20180048860A1 · Feb 15, 2018