Transmission device, transmission method, reception device, and reception method
To preferably transmit normal-frame-rate and high-frame-rate image data. A first ratio mixing processing is performed on two temporally-consecutive pictures in high-frame-rate image data to obtain basic-frame-rate image data, and a second ratio mixing processing is performed on the two temporally-consecutive pictures to obtain high-frame-rate image data of an extended frame. An encoding processing is performed on the reference-frame-rate image data to obtain a basic stream and an encoding processing is performed on the high-frame-rate image data of the extended frame to obtain an extended stream. A container including the basic stream and the extended stream in a predetermined format is transmitted.
1. A transmission device, comprising circuitry configured to:
perform a first mixing process with a first mixing ratio on two temporally-consecutive first pictures in high-frame-rate image data to obtain basic image data, the first mixing ratio being p to q, p and q being numbers, p and q being mixing coefficients of the first mixing ratio, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and a second mixing process with a second mixing ratio on two temporally-consecutive second pictures in the high-frame-rate image data to obtain extended image data, the second mixing ratio being r to s, r and s being numbers, r and s being mixing coefficients of the second mixing ratio, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1, the first mixing ratio being different from the second mixing ratio, the two temporally-consecutive first pictures including at least one of the two temporally-consecutive second pictures;
perform an encoding process to encode the basic image data to obtain basic encoded image data, and to encode the extended image data to obtain extended encoded image data; and
transmit the basic encoded image data and the extended encoded image data.
2. The transmission device according to claim 1 , wherein the two temporally-consecutive first pictures in the high-frame-rate image data are the same two pictures of the two temporally-consecutive second pictures in the high-frame-rate image data.
3. The transmission device according to claim 1 , wherein the two temporally-consecutive second pictures in the high-frame-rate image data includes a later one of the two temporally-consecutive first pictures in the high-frame-rate image data and a picture following the later one of the two temporally-consecutive first pictures in the high-frame-rate image data.
4. The transmission device according to claim 1 , wherein the circuitry is further configured to:
supply for the encoding process the basic image data and the extended image data each associated with a flag for identifying the basic image data and the extended image data.
5. The transmission device according to claim 1 , wherein the circuitry is further configured to:
transmit one or both of mixing ratio information indicating the first mixing ratio and mixing ratio information indicating the second mixing ratio.
6. The transmission device according to claim 5 , wherein the mixing ratio information indicating the first mixing ratio is included in a supplemental enhancement information (SEI) network abstraction layer (NAL) unit of the basic encoded image data, and
the mixing ratio information indicating the second mixing ratio is included in a SEI NAL unit of the extended encoded image data.
7. The transmission device according to claim 1 , wherein the circuitry is further configured to:
transmit identification information indicating that image data included in the basic encoded image data is obtained by performing the first mixing process.
8. A transmission method, comprising:
performing, by circuitry of a transmission device, a first mixing process with a first mixing ratio on two temporally-consecutive first pictures in high-frame-rate image data to obtain basic image data, the first mixing ratio being p to q, p and q being numbers, p and q being mixing coefficients of the first mixing ratio, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and a second mixing process with a second mixing ratio on two temporally-consecutive second pictures in the high-frame-rate image data to obtain extended image data, the second mixing ratio being r to s, r and s being numbers, r and s being mixing coefficients of the second mixing ratio, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1, the first mixing ratio being different from the second mixing ratio, the two temporally-consecutive first pictures including at least one of the two temporally-consecutive second pictures;
performing an encoding process to encode the basic image data to obtain basic encoded image data, and to encode the extended image data to obtain extended encoded image data; and
transmitting the basic encoded image data and the extended encoded image data.
9. The transmission method according to claim 8 , further comprising:
transmitting one or both of mixing ratio information indicating the first mixing ratio and mixing ratio information indicating the second mixing ratio.
10. The transmission method according to claim 9 , wherein the mixing ratio information indicating the first mixing ratio is included in a supplemental enhancement information (SEI) network abstraction layer (NAL) unit of the basic encoded image data, and
the mixing ratio information indicating the second mixing ratio is included in a SEI NAL unit of the extended encoded image data.
11. The transmission method according to claim 8 , further comprising:
transmitting identification information indicating that image data included in the basic encoded image data is obtained by performing the first mixing processing.
12. A reception device, comprising circuitry configured to:
receive basic encoded image data associated with a first mixing ratio and extended encoded image data associated with a second mixing ratio;
decode the basic encoded image data to obtain basic image data;
decode the extended encoded image data to obtain extended image data; and
perform an inverse mixing process with the basic image data, the extended image data, the first mixing ratio, and the second mixing ratio to obtain image data of two temporally-consecutive pictures, wherein the inverse mixing process is performed according to:
[
A
B
]
=
[
C
D
]
*
1
p
*
s
-
q
*
r
[
s
-
r
-
q
p
]
,
where A and B represent the image data of the two temporally-consecutive pictures, respectively, C and D represent the basic image data and the extended image data, respectively, p and q are mixing coefficients corresponding to the first mixing ratio, and r and s are mixing coefficients corresponding to the second mixing ratio.
13. The reception device according to claim 12 , wherein the circuitry is further configured to:
receive mixing ratio information indicating the first mixing ratio and mixing ratio information indicating the second mixing ratio.
14. The reception device according to claim 13 , wherein the mixing ratio information indicating the first mixing ratio is included in a supplemental enhancement information (SEI) network abstraction layer (NAL) unit of the basic encoded image data, and
the mixing ratio information indicating the second mixing ratio is carried in a SEI NAL unit of the extended encoded image data.
15. The reception device according to claim 12 , wherein the circuitry is further configured to:
receive identification information indicating that image data included in the basic encoded image data is obtained by mixing two temporally-consecutive pictures having the high frame rate with the first mixing ratio.
16. A reception method, comprising:
receiving, by circuitry of a reception device, basic encoded image data associated with a first mixing ratio and extended encoded image data associated with a second mixing ratio;
decoding the basic encoded image data to obtain basic image data;
decoding the extended encoded image data to obtain extended image data; and
performing an inverse mixing process with the basic image data, the extended image data, the first mixing ratio, and the second mixing ratio to obtain image data of two temporally-consecutive pictures, wherein the inverse mixing process is performed according to:
[
A
B
]
=
[
C
D
]
*
1
p
*
s
-
q
*
r
[
s
-
r
-
q
p
]
,
where A and B represent the image data of the two temporally-consecutive pictures, respectively, C and D represent the basic image data and the extended image data, respectively, p and q are mixing coefficients corresponding to the first mixing ratio, and r and s are mixing coefficients corresponding to the second mixing ratio.
17. The reception method according to claim 16 , further comprising:
receiving mixing ratio information indicating the first mixing ratio and mixing ratio information indicating the second mixing ratio.
18. The reception method according to claim 17 , wherein the mixing ratio information indicating the first mixing ratio is included in a supplemental enhancement information (SEI) network abstraction layer (NAL) unit of the basic encoded image data, and
the mixing ratio information indicating the second mixing ratio is included in a SEI NAL unit of the extended encoded image data.
19. The reception method according to claim 16 , further comprising:
receiving identification information indicating that image data included in the basic encoded image data is obtained by mixing two temporally-consecutive pictures having the high frame rate with the first mixing ratio.