IP Library Granted Patent US 11,412,254
Granted Patent B2
US 11,412,254 · App. 17/161,164 · Granted Aug 9, 2022

Transmission device, transmission method, reception device and reception method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SONY CORPORATION
H04N19/587H04N7/01H04N19/132H04N19/187H04N19/31H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,412,254
App. No.
17/161,164
Granted
Aug 9, 2022
Kind
B2
Abstract

High frame rate moving image data is satisfactorily transmitted. Mixing processing is performed in units of two temporally consecutive pictures in predetermined frame rate image data, and base frame rate image data is obtained. Image data of one picture in units of the two temporally consecutive pictures is extracted, and high frame rate enhanced frame image data is obtained. Prediction encoding processing of base frame rate image data is performed to the base frame rate image data, and a base stream is obtained. Prediction encoding processing with respect to the base frame rate image data is performed to the high frame rate enhanced frame image data, and an enhanced stream is obtained. A predetermined format container is transmitted including the base stream and the enhanced stream.

Claims (40)

1. A transmission device comprising:

processing circuitry configured to:

perform mixing processing in units of two temporally consecutive pictures in high frame rate image data to obtain base frame rate image data such that each frame in the base frame rate image data has a length of two temporally consecutive pictures of the high frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the high frame rate image data,

extract image data of one picture in units of the two temporally consecutive pictures to obtain enhanced frame image data such that each frame in the enhanced frame image data has a length of two temporally consecutive pictures of the high frame rate image data, the enhanced frame image data having a number of frames that is half of the number of frames of the high frame rate image data,

perform encoding processing to the base frame rate image data to obtain a base stream, and

perform encoding processing to the enhanced frame image data to obtain an enhanced stream; and

a transceiver configured to transmit the base stream and the enhanced stream.

2. The transmission device according to claim 1 , wherein the processing circuitry is further configured to multiply the base frame rate image data based on a coefficient for reducing a prediction residue when encoding processing with respect to the base frame rate image data is performed to the enhanced frame image data and the enhanced stream is obtained.

3. The transmission device according to claim 2 , wherein the processing circuitry is further configured to include the coefficient in a layer of the enhanced stream.

4. The transmission device according to claim 2 , wherein the processing circuitry is further configured to transmit a descriptor in which the coefficient is defined.

5. A reception device comprising

a receiver configured to receive a base stream and an enhanced stream, wherein:

the base stream includes base frame rate image data in which each frame in the base frame rate image data has a length of two temporally consecutive pictures of high frame rate image data, the base frame rate image data obtained by performing mixing processing in units of two temporally consecutive pictures in the high frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the high frame rate image data, and

the enhanced stream includes enhanced frame image data in which each frame in the enhanced frame image data has a length of two temporally consecutive pictures of the high frame rate image data, the enhanced frame image data obtained by extracting image data of one picture in units of the two temporally consecutive pictures in the high frame rate image data, the enhanced frame image data having a number of frames that is half of the number of frames of the high frame rate image data, and

processing circuitry configured to process the base stream and the enhanced stream to obtain the high frame rate image data.

6. The reception device according to claim 5 , the processing circuitry is further configured to:

perform decoding processing to the base stream to obtain the base frame rate image data, and perform decoding processing to the enhanced stream to obtain the enhanced frame image data, and

process the base frame rate image data and the enhanced frame image data based on a coefficient for reducing a prediction residue, to obtain the high frame rate image data.

7. The reception device according to claim 6 , wherein the processing circuitry is further configured to obtain the coefficient that is defined in a layer of the enhanced stream.

8. The reception device according to claim 6 , the processing circuitry is configured to receive a descriptor in which the coefficient is defined.

9. The reception device according to claim 5 , the processing circuitry is further configured to:

perform, to the base frame rate image data, inverse processing of the mixing processing using the enhanced frame image data to obtain the high frame rate image data.

10. A reception method performed in a reception device, the reception method comprising:

receiving, by a receiver of the reception device, a base stream and an enhanced stream, wherein:

the base stream includes base frame rate image data in which each frame in the base frame rate image data has a length of two temporally consecutive pictures of high frame rate image data, the base frame rate image data obtained by performing mixing processing in units of two temporally consecutive pictures in the high frame rate image data, the base frame rate image data having a number of frames that is half of a number of frames of the high frame rate image data, and

the enhanced stream includes enhanced frame image data in which each frame in the enhanced frame image data has a length of two temporally consecutive pictures of the high frame rate image data, the enhanced frame image data obtained by extracting image data of one picture in units of the two temporally consecutive pictures in the high frame rate image data, the enhanced frame image data having a number of frames that is half of the number of frames of the high frame rate image data, and

processing by processing circuitry of the reception device, the base stream and the enhanced stream to obtain the high frame rate image data.

11. The reception method according to claim 10 , further comprising:

perform, by the processing circuitry of the reception device, decoding processing to the base stream to obtain the base frame rate image data;

performing, by the processing circuitry of the reception device, decoding processing to the enhanced stream to obtain the enhanced frame image data; and

processing, by the processing circuitry of the reception device, the base frame rate image data and the enhanced frame image data based on a coefficient for reducing a prediction residue, to obtain the high frame rate image data.

12. The reception method according to claim 11 , further comprising:

obtaining, by the processing circuitry of the reception device, the coefficient that is defined in a layer of the enhanced stream.

13. The reception method according to claim 11 , further comprising:

receiving, by the processing circuitry of the reception device, a descriptor in which the coefficient is defined.

14. The reception method according to claim 10 , further comprising:

performing, by the processing circuitry of the reception device, to the base frame rate image data, inverse processing of the mixing processing using the enhanced frame image data to obtain the high frame rate image data.

15. The reception device according to claim 5 , wherein the processing circuitry is further configured to perform interpolation processing to the high frame rate image data to obtain image data having a higher frame rate than the high frame rate image data.

16. The reception method according to claim 10 , further comprising:

performing, by the processing circuitry of the reception device, interpolation processing to the high frame rate image data to obtain image data having a higher frame rate than the high frame rate image data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2023
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 062366/0447 →
CHANGE OF NAME Recorded Dec 16, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062149/0062 →
Priority Claims (1)
JP JP2015-161966 · Aug 19, 2015 · national
Continuity (2)
Continuation 15750300
Related Publication 20210152847A1 · May 20, 2021