IP Library › Granted Patent US 11,895,349
Granted Patent B2
US 11,895,349 · App. 17/611,353 · Granted Feb 6, 2024

Synchronous control device, synchronous control method, and synchronous control program

Inventors: Masato Ono (Musashino, JP); Takahide Hoshide (Musashino, JP); Yasushi Matsubara (Musashino, JP); Shinji Fukatsu (Musashino, JP); Kenichi Minami (Musashino, JP)
Assignee: Nippon Telegraph and Telephone Corporation
H04N21/242H04N21/2343H04N21/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,895,349
App. No.
17/611,353
Granted
Feb 6, 2024
Kind
B2
Abstract

A synchronous shift of video/audio data between a plurality of display system devices is suppressed. A synchronous control device includes a coded-data adjustment unit 312 or a video and audio data adjustment unit 314 configured to perform frame adjustment based on a predetermined frame adjustment instruction by inserting predetermined frame data into a plurality of pieces of frame data in a chronological order or deleting a piece of frame data from the plurality of pieces of frame data, a video and audio data output unit 315 configured to sequentially output each piece of frame data subjected to the frame adjustment, and a video and audio data output time-point adjustment unit 316 configured to compare a reference time point for outputting each piece of the frame data with an output time point at which each piece of the frame data is output. In the synchronous control device, the video and audio data output time-point adjustment unit 316 issues the frame adjustment instruction to insert predetermined frame data if the output time point precedes the reference time point by a threshold value or longer, and alternatively issues the frame adjustment instruction to delete a piece of frame data if the output time point is delayed from the reference time point by a threshold value or longer.

Claims (36)

1. A synchronous control device for synchronizing a plurality of data output from a decoding device, the plurality of data comprising video data, audio data, or video and audio data, the synchronous control device comprise:

a frame data acquisition unit, including one or more processors, configured to acquire a plurality of frame data from the plurality of data in a chronological order;

a first data adjustment unit, including one or more processors, configured to perform frame adjustment based on a predetermined frame adjustment instruction before decoding the plurality of frame data by inserting predetermined frame data into non-decoded plurality of frame data or deleting a piece of frame data from the non-decoded plurality of of frame data;

a second data adjustment unit, including one or more processors, configured to perform frame adjustment based on a predetermined frame adjustment instruction after decoding the plurality of frame data by inserting predetermined frame data into the decoded plurality of frame data or deleting a piece of frame data from the decoded plurality of frame data;

a data output unit, including one or more processors, configured to sequentially output from the decoding device each of the frame data subjected to the frame adjustment by one or both of the first data adjustment unit and the second data adjustment unit; and

a data output time-point adjustment unit, including one or more processors, configured to compare a reference time point for outputting each of the frame data with an output time point at which each of the frame data is output,

wherein the data output time-point adjustment unit is configured to:

issue the predetermined frame adjustment instruction to one or both of the first data adjustment unit and the second data adjustment unit based on user's settings,

issue the predetermined frame adjustment instruction for inserting the predetermined frame data, if the output time point precedes the reference time point by a threshold value or longer, and

issue the predetermined frame adjustment instruction for deleting the piece of the frame data, if the output time point is delayed from the reference time point.

2. The synchronous control device according to claim 1 ,

wherein, and the first data adjustment unit is configured to:

determine a type of each of the non-decoded frame data,

insert a full-frame if the predetermined frame adjustment instruction is an instruction to insert frame data, and

delete a difference frame preceding the full-frame by one frame if the predetermined frame adjustment instruction is an instruction to delete the frame data.

3. The synchronous control device of claim 1 , wherein the data output time-point adjustment unit is configured to issue the predetermined frame adjustment instruction to both of the first data adjustment unit and the second data adjustment unit.

4. A synchronous control method performed by a synchronous control device that synchronizes a plurality of data output from a decoding device, the plurality of data comprising video data, audio data, or video and audio data, the synchronous control method comprising:

acquiring, by a frame data acquisition unit, a plurality of frame data from the plurality of data in a chronological order;

performing, by a first data adjustment unit, frame adjustment based on a predetermined frame adjustment instruction before decoding the plurality of frame data by inserting predetermined frame data into non-decoded plurality of frame data or deleting a piece of frame data from the non-decoded plurality of frame data;

performing, by a second data adjustment unit, frame adjustment based on a predetermined frame adjustment instruction after decoding the plurality of frame data by inserting predetermined frame data into the decoded plurality of frame data or deleting a piece of frame data from the decoded plurality of frame data;

sequentially outputting, by a data output unit and from the decoding device, each of the frame data subjected to the frame adjustment by one or both of the first data adjustment unit and the second data adjustment unit; and

comparing, by a data output time-point adjustment unit, a reference time point for outputting each of the frame data with an output time point at which each of the frame data is output,

wherein, in the comparing,

issuing the predetermined frame adjustment instruction to one or both of the first data adjustment unit and the second data adjustment unit based on user's settings,

issuing the predetermined frame adjustment instruction for inserting the predetermined frame data, if the output time point precedes the reference time point by a threshold value or longer, and

issuing the predetermined frame adjustment instruction for deleting the piece of the frame data, if the output time point is delayed from the reference time point by a threshold value or longer.

5. A non-transitory recording medium storing a synchronous control program for causing a computer to execute a synchronous control method performed by a synchronous control device that synchronizes a plurality of data output from a decoding device, the plurality of data comprising video data, audio data, or video and audio data, wherein executing of the synchronous control program causes one or more computers to perform operations comprise:

acquiring, by a frame data acquisition unit, a plurality of frame data from the plurality of data in a chronological order;

performing, by a first data adjustment unit, frame adjustment based on a predetermined frame adjustment instruction before decoding the plurality of frame data by inserting predetermined frame data into non-decoded plurality of frame data or deleting a piece of frame data from the non-decoded plurality of frame data;

performing, by a second data adjustment unit, frame adjustment based on a predetermined frame adjustment instruction after decoding the plurality of frame data by inserting predetermined frame data into the decoded plurality of frame data or deleting a piece of frame data from the decoded plurality of frame data;

sequentially outputting, by a data output unit and from the decoding device, each of the frame data subjected to the frame adjustment by one or both of the first data adjustment unit and the second data adjustment unit; and

comparing, by a data output time-point adjustment unit, a reference time point for outputting each of the frame data with an output time point at which each of the frame data is output,

wherein, in the comparing,

issuing the predetermined frame adjustment instruction to one or both of the first data adjustment unit and the second data adjustment unit based on user's settings,

issuing the predetermined frame adjustment instruction for inserting the predetermined frame data, if the output time point precedes the reference time point by a threshold value or longer, and

issuing the predetermined frame adjustment instruction for deleting the piece of the frame data, if the output time point is delayed from the reference time point by a threshold value or longer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2021
From: ONO, MASATO; HOSHIDE, TAKAHIDE; MATSUBARA, YASUSHI; FUKATSU, SHINJI; MINAMI, KENICHI
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Reel/Frame 058126/0983 →
Priority Claims (1)
JP 2019-102909 · May 31, 2019 · national
Continuity (1)
Related Publication 20220224957A1 · Jul 14, 2022