IP Library Granted Patent US 10,979,785
Granted Patent B2
US 10,979,785 · App. 15/833,235 · Granted Apr 13, 2021

Media playback apparatus and method for synchronously reproducing video and audio on a web browser

Inventors: Sweung Won Cheung (Changwon-si, KR); Jong Chan Park (Changwon-si, KR)
Assignee: Hanwha Techwin Co., Ltd.
H04N21/8586G06F16/40G06F16/957G06F16/958H04L65/608H04N21/43H04N21/4302H04N21/434H04N21/4307H04N21/4341H04N21/4343H04N21/4346H04N21/4782H04N21/8543H04N21/8547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,979,785
App. No.
15/833,235
Granted
Apr 13, 2021
Kind
B2
Abstract

A media playback apparatus and a method for synchronously reproducing video and audio on a web browser are provided. In the media playback apparatus, audio is buffered to be outputted at a time point at which video is outputted, thereby synchronizing the outputs of video and audio. The media playback apparatus may output the video in synchronization with the audio even when video and audio are decoded by different decoders. Therefore, it is possible to implement a decoder separately from a decoder embedded in a web browser in a non-plug-in environment, thereby reducing the dependency on the codec format of the media.

Claims (43)

1. A media playback apparatus for synchronously reproducing video and audio on a web browser, the media playback apparatus comprising at least one processor to implement:

a receiver configured to receive media data generated in a media service apparatus using a communication protocol which supports web services;

a data separator configured to separate the received media data into video data and audio data;

a container configured to package frames constituting the video data together with a unit number representing a number of frames and convert the frames into chunk data wherein the chunk data is obtained by packaging video frames with the unit number or packaging video frames and audio with the unit number;

a media restorer configured to restore video by decoding the chunk data by a decoder embedded in the web browser, and provide time information on a time point at which the restored video is outputted on a chunk data basis when the restored video is outputted; and

an audio synchronizer configured to output the audio data in synchronization with the restored video based on the time information provided on the chunk data basis.

2. The media playback apparatus of claim 1 , wherein the container variably adjusts the unit number according to frames per second (FPS) of the video data.

3. The media playback apparatus of claim 1 , wherein the media restorer includes a renderer renders the restored video before the restored video is outputted, and the time information comprises a time point at which the chunk data is rendered in the renderer.

4. The media playback apparatus of claim 3 , wherein the time point at which the chunk data is rendered by the render corresponds to a start portion of the chunk data.

5. The media playback apparatus of claim 1 , wherein the audio synchronizer decodes the separated audio data to restore audio, and outputs the restored audio in synchronization with the restored video based on the time information provided on the chunk data basis.

6. The media playback apparatus of claim 5 , wherein the audio synchronizer comprises:

an audio decoder configured to decode the separated audio data based on a script which is configured to be parsed by the web browser;

a buffer controller configured to provide the decoded audio data to an audio renderer in synchronization with the chunk data; and

the audio renderer configured to render the decoded audio data.

7. The media playback apparatus of claim 6 , wherein the chunk data is compressed data before being decoded and the audio data synchronized with the chunk data is decoded and decompressed data.

8. The media playback apparatus of claim 6 , wherein the audio renderer is implemented by an audio application program interface (API) supported by the web browser.

9. The media playback apparatus of claim 1 , wherein the audio synchronizer buffers the separated audio data in synchronization with the restored video based on the time information provided on the chunk data basis, and decodes the buffered audio data to restore and output audio.

10. The media playback apparatus of claim 9 , wherein the audio synchronizer comprises:

a buffer controller configured to buffer the separated audio data in synchronization with the chunk data;

an audio decoder configured to decode the buffered audio data based on a script which is configured to be parsed by the web browser; and

an audio renderer configured to render the decoded audio data.

11. The media playback apparatus of claim 10 , wherein the chunk data is compressed data before being decoded and the audio data synchronized with the chunk data is data before being decoded by the audio decoder.

12. The media playback apparatus of claim 1 , wherein the decoder embedded in the web browser is a video tag player supported by a language for presenting content on world wide web, and the receiver, the container and the audio synchronizer are implemented by a programming language of world wide web.

13. The media playback apparatus of claim 12 , wherein the programming language of world wide web is downloaded from the media service apparatus to the media playback apparatus.

14. A media service apparatus for transmitting media data to a media playback apparatus, the media service apparatus comprising:

a module storage configured to store a script converter to reproduce the media data on a web browser of the media playback apparatus; and

at least one processor configured to implement:

a module transmitter configured to transmit the script converter to the media playback apparatus in response to a connection between the media service apparatus and the media playback apparatus being established;

a packetizer configured to packetize the media data to generate a transmission packet; and

a web server configured to establish the connection and transmit the transmission packet to the media playback apparatus in response to a request from the media playback apparatus,

wherein the script converter is configured to receive the transmission packet through the connection, package video frames included in the transmission packet together with a unit number representing a number of frames and convert the frames into chunk data wherein the chunk data is obtained by packaging video frames with the unit number or packaging video frames and audio with the unit number, and output audio data included in the transmission packet in synchronization with the chunk data based on time information on a time point at which the chunk data is decoded and outputted by a media restorer installed in the media playback apparatus.

15. The media service apparatus of claim 14 , wherein the script converter is code written in a programming language of world wide web which is configured to be parsed by the web browser.

16. The media service apparatus of claim 14 , wherein the time point at which the chunk data is rendered by a renderer in the media playback apparatus corresponds to a start portion of the chunk data.

17. The media service apparatus of claim 14 , wherein the script converter is configured to output the audio data in synchronization by decoding the audio data included in the communication packet to restore audio, and outputting the restored audio in synchronization with the chuck data based on the time information provided on the chunk data basis.

18. The media service apparatus of claim 14 , wherein the script converter is configured to output the audio data in synchronization by buffering the separated audio data in synchronization with the chunk data, decoding the buffered audio data based on a script which is configured to be parsed by the web browser, and

rendering the decoded audio data.

19. The media service apparatus of claim 14 , wherein the chunk data is compressed data before being decoded and the audio data synchronized with the chunk data is data which is decoded in the media playback apparatus and decompressed.

20. A media playback apparatus for synchronously reproducing video and audio on a web browser, the media playback apparatus comprising at least one processor to implement:

a receiver configured to receive media data generated in a media service apparatus using a communication protocol which supports web services;

a data separator configured to separate the received media data into first media data and second media data;

a container configured to package frames constituting the first media data together with a unit number representing a number of frames and convert the frames into chunk data wherein the chunk data is obtained by packaging video frames with the unit number or packaging video frames and audio with the unit number;

a media restorer configured to restore first media by decoding the chunk data by a decoder embedded in the web browser, and provide time information on a time point at which the restored first media is outputted on a chunk data basis when the restored first media is outputted; and

a synchronizer configured to output the second media data in synchronization with the restored first media based on the time information provided on the chunk data basis.

Assignments (5)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2017
From: CHEUNG, SWEUNG WON; PARK, JONG CHAN
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 044315/0014 →