IP Library Granted Patent US 11,418,838
Granted Patent B2
US 11,418,838 · App. 16/980,770 · Granted Aug 16, 2022

Reception device, reception method, transmission device, and transmission method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SATURN LICENSING LLC
H04N21/4385H04N21/435H04N21/4402
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,418,838
App. No.
16/980,770
Granted
Aug 16, 2022
Kind
B2
Abstract

High frame rate image data having backward compatibility is favorably transmitted. Image data of each picture of a base layer included in a base stream sent from a transmission side has been subjected to a mixing process in a linear space or a non-linear space. On a reception side, the inverse mixing process can be performed appropriately by performing in a corresponding space on the basis of processing space information indicating whether or not the mixing process is performed in the linear space or the non-linear space.

Claims (52)

1. A reception device comprising:

circuitry configured to:

receive a container including a base stream and an enhanced stream,

wherein:

the base stream is obtained by obtaining image data of each picture of a base layer by performing a mixing process in units of two temporally consecutive pictures in image data at a predetermined frame rate, and encoding the image data of each picture of the base layer, the mixing process having been performed in a linear space before opto-electronic conversion, or a non-linear space after opto-electronic conversion,

the enhanced stream is obtained by obtaining image data of each picture of an enhanced layer by extracting image data of one picture in the units of two temporally consecutive pictures, and encoding the image data of each picture of the enhanced layer,

the circuitry is configured to:

decode the base stream to obtain the image data of each picture of the base layer,

decode the enhanced stream to obtain image data of one picture in the units of two temporally consecutive pictures of the image data at the predetermined frame rate, which is the image data of each picture of the enhanced layer,

perform an inverse mixing process, which is an inverse process of the mixing process, on the image data of each picture of the base layer by using the image data of the one picture to obtain image data of the other picture in the units of two temporally consecutive pictures, and

combine the image data of the one picture and the image data of the other picture to obtain image data at the predetermined frame rate, and

the circuitry is configured to perform the inverse mixing process in a corresponding space on a basis of processing space information indicating whether the mixing process is performed in the linear space or performed in the non-linear space.

2. The reception device according to claim 1 , wherein the processing space information is inserted in a layer of the base stream or a layer of the enhanced stream.

3. The reception device according to claim 2 , wherein the base stream and the enhanced stream have a NAL unit structure, and the base stream or the enhanced stream includes a NAL unit including the processing space information.

4. The reception device according to claim 1 , wherein the processing space information is inserted in a layer of the container.

5. The reception device according to claim 1 , wherein

mixing process information is inserted in a layer of the base stream, the enhanced stream, or a layer of the container, and

the circuitry is configured to perform the inverse mixing process on a basis of the mixing process information.

6. The reception device according to claim 5 , wherein the mixing process information includes information on a mixing ratio in the mixing process.

7. The reception device according to claim 5 , wherein the mixing process information includes information indicating a temporal relative positional relationship between the one picture and the other picture in the units of two temporally consecutive pictures.

8. The reception device according to claim 1 , further comprising a display configured to display an image by the image data of the predetermined frame rate obtained by the circuitry.

9. The reception device according to claim 1 , wherein the circuitry is configured to receive the container via a broadcast transmission path.

10. A reception method comprising

receiving a container including a base stream and an enhanced stream,

wherein:

the base stream is obtained by obtaining image data of each picture of a base layer by performing a mixing process in units of two temporally consecutive pictures in image data at a predetermined frame rate, and encoding the image data of each picture of the base layer, the mixing process having been performed in a linear space before opto-electronic conversion, or a non-linear space after opto-electronic conversion,

the enhanced stream is obtained by obtaining image data of each picture of an enhanced layer by extracting image data of one picture in the units of two temporally consecutive pictures, and encoding the image data of each picture of the enhanced layer,

the reception method further comprises:

decoding the base stream to obtain the image data of each picture of the base layer,

decoding the enhanced stream to obtain image data of one picture in the units of two temporally consecutive pictures of the image data at the predetermined frame rate, which is the image data of each picture of the enhanced layer,

performing an inverse mixing process, which is an inverse process of the mixing process, on the image data of each picture of the base layer by using the image data of the one picture to obtain image data of the other picture in the units of two temporally consecutive pictures, and

combining the image data of the one picture and the image data of the other picture to obtain image data at the predetermined frame rate, and

the inverse mixing process is performed in a corresponding space on a basis of processing space information indicating whether the mixing process is performed in the linear space or performed in the non-linear space.

11. The reception method according to claim 10 , wherein the processing space information is inserted in a layer of the base stream or a layer of the enhanced stream.

12. The reception method according to claim 11 , wherein the base stream and the enhanced stream have a NAL unit structure, and the base stream or the enhanced stream includes a NAL unit including the processing space information.

13. The reception method according to claim 10 , wherein the processing space information is inserted in a layer of the container.

14. The reception method according to claim 10 , wherein

mixing process information is inserted in a layer of the base stream, the enhanced stream, or a layer of the container, and

the inverse mixing process is performed on a basis of the mixing process information.

15. The reception method according to claim 14 , wherein the mixing process information includes information on a mixing ratio in the mixing process.

16. The reception method according to claim 14 , wherein the mixing process information includes information indicating a temporal relative positional relationship between the one picture and the other picture in the units of two temporally consecutive pictures.

17. The reception method according to claim 10 , wherein the image data of the predetermined frame rate is supplied to a display that displays an image by the image data.

18. The reception method according to claim 10 , wherein the container is received via a broadcast transmission path.

19. A transmission device comprising:

processing circuitry configured to:

obtain a base stream by obtaining image data of each picture of a base layer by performing a mixing process in units of two temporally consecutive pictures in image data at a predetermined frame rate, and encoding the image data of each picture of the base layer, wherein the mixing process is performed in a linear space before opto-electronic conversion or a non-linear space after opto-electronic conversion,

obtain an enhanced stream by obtaining the image data of each picture of an enhanced layer by extracting image data of one picture in the units of two temporally consecutive pictures, and encoding the image data of each picture of the enhanced layer, and

transmit the base stream, the enhanced stream, and processing space information, wherein the processing space information indicates whether the mixing process in the units of two temporally consecutive pictures is performed in the linear space or the non-linear space.

20. A transmission method comprising:

obtaining a base stream by obtaining image data of each picture of a base layer by performing a mixing process in units of two temporally consecutive pictures in image data at a predetermined frame rate, and encoding the image data of each picture of the base layer, wherein the mixing process is performed in a linear space before opto-electronic conversion or a non-linear space after opto-electronic conversion;

obtaining an enhanced stream by obtaining the image data of each picture of an enhanced layer by extracting image data of one picture in the units of two temporally consecutive pictures, and encoding the image data of each picture of the enhanced layer; and

transmitting the base stream, the enhanced stream, and processing space information, wherein the processing space information indicates whether the mixing process in the units of two temporally consecutive pictures is performed in the linear space or the non-linear space.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2021
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 058442/0365 →
CHANGE OF NAME Recorded Dec 21, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 058552/0391 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2020
From: TSUKAGOSHI, IKUO
To: SONY CORPORATION
Reel/Frame 054492/0146 →