IP Library Granted Patent US 11,022,999
Granted Patent B2
US 11,022,999 · App. 16/335,507 · Granted Jun 1, 2021

Client device and local clock skew compensation method thereof

Inventors: Bum Jae You (Seoul, KR); Joong Jae Lee (Seoul, KR); Eun Mi Lee (Seoul, KR); Tae Young Lee (Seoul, KR)
Assignee: Center of Human-Centered Interaction for Coexistence
G06F1/10G06F1/12H04L29/06496H04W56/0065G06F1/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,022,999
App. No.
16/335,507
Granted
Jun 1, 2021
Kind
B2
Abstract

A local watch skew compensation device of the present invention is a client device which is synchronized with the other client device to provide a time-aware service including: a local time providing unit which supplies first local time data and second local time data in accordance with a local clock; a media scheduling unit which receives first media data and second media data from the other client device, schedules first playout time of the first media data using the first local time data, and schedules second playout time of the second media data using the second local time data; and a skew monitoring unit which requests global time data to a global time server when a difference between the first playout time and the second playout time exceeds a skew threshold value, and the first media data and the second media data are different types of media data.

Claims (26)

1. A client device which is synchronized with an other client device to provide a time-aware service, the client device comprising:

a local time providing unit which supplies first local time data and second local time data in accordance with a local clock;

a media scheduling unit which receives first media data and second media data from the other client device, schedules a first playout time of the first media data using the first local time data, and schedules a second playout time of the second media data using the second local time data; and

a skew monitoring unit which requests global time data to a global time server when a skew amount corresponding to a difference between the first playout time and the second playout time exceeds a skew threshold value,

wherein the first media data and the second media data are different types of media data, and the skew threshold value in accordance with types of the first media data and the second media data is stored in a database.

2. The client device of claim 1 , wherein the skew monitoring unit includes:

a skew amount calculating unit which calculates the skew amount between the first media data and the second media data using the first playout time and the second playout time;

a skew amount comparing unit which compares the skew threshold value and the skew amount; and

a global time requesting unit which requests the global time data to the global time server when the skew amount exceeds the skew threshold value.

3. The client device of claim 2 , wherein the skew amount comparing unit compares a value obtained by multiplying a weight value and the skew amount with the skew threshold value.

4. The client device of claim 1 , further comprising:

a local clock compensation unit which receives the global time data to compensate the local clock.

5. The client device of claim 1 , further comprising:

a rendering unit which renders the first media data and the second media data in accordance with the first playout time and the second playout time.

6. The client device of claim 1 , wherein the skew threshold value is a maximum skew value at which a user does not perceive asynchronous rendering of the first media data and the second media data.

7. The client device of claim 1 , wherein the types of the first media data and second media data are one of video and audio type, haptic and video type, and haptic and audio type.

8. The client device of claim 1 , wherein the first media data and the second media data are media data captured from a corresponding sensor of the other client device.

9. A local clock skew compensation method which is performed in a client device which is synchronized with an other client device to provide a time-aware service, the local clock skew compensation method comprising:

receiving first media data and second media data captured by a sensor of the other client device;

scheduling a first playout time of the first media data using a first local time data, and scheduling a second playout time of the second media data using a second local time data; and

compensating a local clock by requesting global time data to a global time server when a skew amount corresponding to a difference between the first playout time and the second playout time exceeds a skew threshold value,

wherein the first media data and the second media data are different types of media data, and the skew threshold value in accordance with types of the first media data and the second media data is stored in a database.

10. The local clock skew compensation method of claim 9 , further comprising:

compensating the local clock of the client device by requesting the global time data to the global time server at a beginning of the time-aware service.

11. The local clock skew compensation method of claim 9 , wherein the skew threshold value is a maximum skew value at which a user does not perceive asynchronous rendering of the first media data and the second media data.

12. The local clock skew compensation method of claim 9 , wherein the types of the first media data and second media data are one of video and audio type, haptic and video type, and haptic and audio type.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2021
From: CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCE INTERNATIONAL COOPERATION
To: KOREA INSTITUTE OF SCIENCE AND TECHNOLOGY
Reel/Frame 057942/0460 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2019
From: YOU, BUM JAE; LEE, JOONG JAE; LEE, EUN MI; LEE, TAE YOUNG
To: CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCE
Reel/Frame 048662/0740 →
Priority Claims (1)
KR 10-2016-0122221 · Sep 23, 2016 · national
Continuity (1)
Related Publication 20200019208A1 · Jan 16, 2020
Cited By (1)
US 12,537,617