IP Library Granted Patent US 10,951,915
Granted Patent B2
US 10,951,915 · App. 15/750,300 · Granted Mar 16, 2021

Transmission device, transmission method, reception device and reception method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SONY CORPORATION
H04N19/587H04N7/01H04N19/132H04N19/187H04N19/31H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,951,915
App. No.
15/750,300
Granted
Mar 16, 2021
Kind
B2
Abstract

High frame rate moving image data is satisfactorily transmitted. Mixing processing is performed in units of two temporally consecutive pictures in predetermined frame rate image data, and base frame rate image data is obtained. Image data of one picture in units of the two temporally consecutive pictures is extracted, and high frame rate enhanced frame image data is obtained. Prediction encoding processing of base frame rate image data is performed to the base frame rate image data, and a base stream is obtained. Prediction encoding processing with respect to the base frame rate image data is performed to the high frame rate enhanced frame image data, and an enhanced stream is obtained. A predetermined format container is transmitted including the base stream and the enhanced stream.

Claims (34)

1. A transmission device comprising:

processing circuitry configured to:

perform mixing processing in units of two temporally consecutive pictures in predetermined frame rate image data to obtain base frame rate image data such that each frame in the base frame rate image data has a length of two temporally consecutive pictures of the predetermined frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the predetermined frame rate image data,

extract image data of one picture in units of the two temporally consecutive pictures to obtain high frame rate enhanced frame image data such that each frame in the high frame rate enhanced frame image data has a length of two temporally consecutive pictures of the predetermined frame rate image data, the high frame rate enhanced frame image data having a number of frames that is half of the number of frames of the predetermined frame rate image data,

perform prediction encoding processing of the base frame rate image data to the base frame rate image data to obtain a base stream, and

perform prediction encoding processing with respect to the base frame rate image data to the high frame rate enhanced frame image data to obtain an enhanced stream; and

a transceiver that transmits a predetermined format container including the base stream and the enhanced stream.

2. The transmission device according to claim 1 , wherein the processing circuitry is further configured to multiply the base frame rate image data by a prediction coefficient for reducing a prediction residue when prediction encoding processing with respect to the base frame rate image data is perfoll ied to the high frame rate enhanced frame image data and the enhanced stream is obtained.

3. The transmission device according to claim 2 , wherein the processing circuitry is further configured to define the prediction coefficient in a layer of the enhanced stream.

4. The transmission device according to claim 2 , wherein the processing circuitry is further configured to define the prediction coefficient in a layer of the predetermined format container.

5. A reception device comprising:

processing circuitry configured to:

receive a predetermined format container including a base stream and an enhanced stream, wherein:

the base stream is obtained by performing prediction encoding processing of base frame rate image data to the base frame rate image data in which each frame in the base frame rate image data has a length of two temporally consecutive pictures of predetermined frame rate image data, the base frame rate image data obtained by performing mixing processing in units of two temporally consecutive pictures in the predetermined frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the predetermined frame rate image data, and

the enhanced stream is obtained by performing prediction encoding processing with respect to the base frame rate image data to high frame rate enhanced frame image data in which each frame in the high frame rate enhanced frame image data has a length of two temporally consecutive pictures of the predetermined frame rate image data, the high frame rate enhanced frame image data obtained by extracting image data of one picture in units of the two temporally consecutive pictures, the high frame rate enhanced frame image data having a number of frames that is half of the number of frames of the predetermined frame rate image data, and

process only the base stream to obtain the base frame rate image data, or process both the base stream and the enhanced stream to obtain the predetermined frame rate image data.

6. The reception device according to claim 5 , wherein a prediction coefficient for reducing a prediction residue is defined in a layer of the enhanced stream and/or a layer of the predetermined format container, and

the processing circuitry is further configured to, when the high frame rate enhanced frame image data is obtained, multiply the base frame rate image data obtained by processing the base stream, by the defined prediction coefficient, to make reference image data.

7. A transmission device comprising:

processing circuitry configured to:

perform mixing processing in units of two temporally consecutive pictures in predetermined frame rate image data to obtain base frame rate image data such that each frame in the base frame rate image data has a length of two temporally consecutive pictures of the predetermined frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the predetermined frame rate image data

extract image data of one picture in units of the two temporally consecutive pictures to obtain high frame rate enhanced frame image data such that each frame in the high frame rate enhanced frame image data has a length of two temporally consecutive pictures of the predetermined frame rate image data, the high frame rate enhanced frame image data having a number of frames that is half of the number of frames of the predetermined frame rate image data,

perform encoding processing to the base frame rate image data to obtain a base stream, and

perform encoding processing to the high frame rate enhanced frame image data to obtain an enhanced stream; and

a transceiver that transmits a predetermined format container including the base stream and the enhanced stream.

8. A reception device comprising

a receiver that receives a predetermined format container including a base stream and an enhanced stream, wherein:

the base stream is obtained by performing encoding processing to base frame rate image data in which each frame in the base frame rate image data has a length of two temporally consecutive pictures of predetermined frame rate image data, the base frame rate image data obtained by performing mixing processing in units of two temporally consecutive pictures in the predetermined frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the predetermined frame rate image data, and

the enhanced stream is obtained by performing encoding processing to high frame rate enhanced frame image data in which each frame in the high frame rate enhanced frame image data has a length of two temporally consecutive pictures of the predetermined frame rate image data, the high frame rate enhanced frame image data obtained by extracting image data of one picture in units of the two temporally consecutive pictures, the high frame rate enhanced frame image data having a number of frames that is half of the number of frames of the predetermined frame rate image data, and

processing circuitry configured to process only the base stream to obtain the base frame rate image data, or process both the base stream and the enhanced stream to obtain the predetermined frame rate image data.

9. The reception device according to claim 8 , wherein in a case where both the base stream and the enhanced stream are processed and the predetermined frame rate image data is obtained, the processing circuitry is further configured to:

perform decoding processing to the base stream to obtain the base frame rate image data, and perform decoding processing to the enhanced stream to obtain image data of one picture in units of the two temporally consecutive pictures that are the high frame rate enhanced frame image data,

perform, to the base frame rate image data, inverse processing of the mixing processing using the high frame rate enhanced frame image data, to obtain image data of another picture in units of the two temporally consecutive pictures, and

synthesize the image data of the one picture in units of the two temporally consecutive pictures and the image data of the other picture in units of the two temporally consecutive pictures to obtain the predetermined frame rate image data.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2023
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 062366/0447 →
CHANGE OF NAME Recorded Dec 16, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062149/0062 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2018
From: TSUKAGOSHI, IKUO
To: SONY CORPORATION
Reel/Frame 045248/0676 →
Priority Claims (1)
JP JP2015-161966 · Aug 19, 2015 · national
Continuity (1)
Related Publication 20180227596A1 · Aug 9, 2018