IP Library Granted Patent US 6,959,040
Granted Patent B2
US 6,959,040 · App. 10/156,015 · Granted Oct 25, 2005

Method and apparatus for coding and decoding image data with synchronized sound data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 6,959,040
App. No.
10/156,015
Granted
Oct 25, 2005
Kind
B2
Abstract

An image processing system including an image coding apparatus and an image decoding apparatus. The image coding apparatus includes an image input unit for acquiring key frames, a matching processor for generating correspondence information between the key frames, a sound input unit for acquiring sound data to be synchronized with the key frames and correspondence information, and a stream generator for generating a coded data stream which includes the sound data, the correspondence information, and the key frames. The image decoding apparatus includes a stream input unit for acquiring the added data stream, a stream separator for separating the key frames, correspondence information and sound data from the coded data stream; an intermediate frame generator for generating intermediate frames from the key frames and correspondence information, and an output controller for outputting the key frames and intermediate frames in synchronization with the sound data.

Claims (28)

1. An image decoding method comprising:

acquiring a coded data stream comprising key frames, corresponding point data for the key frames, and sound data related to the key frames;

separating the key frames, corresponding point data, and sound data from the coded data stream;

reproducing a motion picture based on the key frames and the corresponding point data by outputting the key frames and intermediate frames generated by interpolation of the key frames using the corresponding point data; and

outputting the sound data based on the number of intermediate frames synchronously with the motion picture.

2. An image decoding method according to claim 1 , wherein the corresponding point data are acquired based on critical points of the key frames.

3. An image decoding method according to claim 1 , wherein the corresponding point data are described by the correspondence of pixels between key frames.

4. An image decoding apparatus comprising:

a first function block for acquiring a coded data stream of a motion picture;

a second function block for acquiring key frames, corresponding point data between key frames, and sound data from the coded data stream;

a third function block for generating intermediate frames based on the key frames and the corresponding point data;

a fourth function block for outputting the key frames and the intermediate frames as a motion picture; and

a fifth function block for outputting the sound data at an output timing based on the number of intermediate frames to provide synchronization with the motion picture.

5. An image decoding apparatus according to claim 4 , wherein the corresponding point data are acquired based on critical points of the key frames.

6. An image decoding apparatus according to claim 4 , wherein the corresponding point data are represented by corresponding pixels between the key frames.

7. An image decoding apparatus according to claim 4 , wherein the third function block is also for receiving an instruction regarding the number of intermediate frames to be generated from an external source.

8. An image decoding apparatus according to claim 4 , wherein the corresponding point data and the sound data are stored collectively as a correspondence information file and wherein the second function block acquires the corresponding point data and the sound data from the correspondence information file.

9. An image decoding method comprising:

acquiring a coded data stream comprising key frames, corresponding point data for the key frames, and sound data;

separating the key frames, corresponding point data, and sound data from the coded data stream;

generating a predetermined number of intermediate frames between key frames based on the key frames and the corresponding point data;

outputting the key frames and intermediate frames to a display device at a predetermined rate;

outputting the sound data to a speaker based on the number of intermediate frames such that said sound data is output synchronously with the output frames.

10. An image decoding method according to claim 9 , wherein the generating of intermediate frames is by interpolation of the key frames using the corresponding point data.

11. An image decoding method according to claim 9 , wherein the predetermined number of intermediate frames generated is set by user input.

12. An image decoding method according to claim 11 , wherein user input comprises a user selection of one of play, fast forward or slow motion.

13. An image decoding method according to claim 9 , wherein the outputting the sound data based on the number of intermediate frames comprises varying the frequency of the sound data based on the number of intermediate frames.

14. An image decoding method according to claim 9 , wherein the predetermined rate is between approximately 1 and 120 frames per second.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2008
From: MONOLITH CO., LTD
To: JBF PARTNERS, INC.
Reel/Frame 021064/0279 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2002
From: AKIYOSHI, KOZO; AKIYOSHI, NOBUO
To: MONOLITH CO., LTD.
Reel/Frame 013196/0497 →