IP Library Granted Patent US 11,606,586
Granted Patent B2
US 11,606,586 · App. 17/328,568 · Granted Mar 14, 2023

Transmission apparatus, transmission method, reception apparatus, and reception method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N21/2343H03M7/30H04N21/2356H04N21/23614H04N21/234327H04N21/234363H04N21/234381H04N21/266H04N21/2662H04N21/26258H04N21/462H04N21/4621H04N21/816H04N21/8456H04N21/85406H03M7/4018
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,606,586
App. No.
17/328,568
Granted
Mar 14, 2023
Kind
B2
Abstract

Image data having ultra-high definition at a high frame rate is processed to obtain image data, having a basic format, from which an image having high definition at a basic frame rate is to be obtained, image rate, having a first enhancement format, from which an image having high definition at a high frame rate is to be obtained, image data, having a second enhancement format, from which an image having ultra-high definition at a basic frame rate is to be obtained, and image data, having a third enhancement format, from which an image having ultra-high definition at a high frame rate is to be obtained. A basic video stream containing an encoded image data of the image data having the basic format, and a predetermined number of enhancement video streams containing the encoded image data of the image data having the first, second, and third enhancement formats are produced.

Claims (44)

1. A transmission apparatus, comprising:

processing circuitry configured to:

obtain image data, having a basic format, from which an image having a high definition at a basic frame rate is to be obtained, the image data having the basic format obtained by mixing processing at a first ratio in units of two temporally consecutive pictures in image data at a high frame rate to obtain first image data as image data at the basic frame rate,

obtain image data, having a first enhancement format, from which an image having the high definition at the high frame rate is to be obtained,

obtain, based on at least the image data having the basic format, image data, having a second enhancement format, from which an image at the basic frame rate is to be obtained, and

obtain, based on at least the image data having the first enhancement format, image data, having a third enhancement format, from which an image at the high frame rate is to be obtained,

producing a basic video stream containing encoded image data of the image data having the basic format, and one or more enhancement video streams containing encoded image data of the image data having the first to third enhancement formats; and

transmission circuitry configured to transmit a container containing the basic video stream and the one or more enhancement video streams,

wherein the image data having the first enhancement format obtained by mixing processing at a second ratio in units of two temporally consecutive pictures in image data at the high frame rate to obtain second image data as image data having an enhancement frame at the high frame rate,

wherein the processing circuitry is further configured to insert spatial scalability information into the encoded image data of the image data having the second and the third enhancement formats, or a container position corresponding to the encoded image data, and insert temporal scalability information into the encoded image data of the image data having the first and the third enhancement formats, or the container position corresponding to the encoded image data.

2. The transmission apparatus according to claim 1 , wherein the processing circuitry is further configured to produce the basic video stream containing encoded image data of the image data having the basic format, three enhancement video streams containing each pieces of encoded image data of the image data having the first to third enhancement formats or one enhancement video stream containing an entirety of the encoded image data of the image data having the first to third enhancement formats.

3. The transmission apparatus according to claim 1 , wherein the processing circuitry further inserts identification information indicating that the image data having the basic format is image data obtained by executing the mixing processing into the encoded image data of the image data having the first enhancement formats or a layer of the container.

4. The transmission apparatus according to claim 1 , wherein the processing circuitry is further configured to insert information associated with the first ratio into the encoded image data of the image data having the first enhancement formats, or into a layer of the container.

5. The transmission apparatus according to claim 1 , wherein the processing circuitry is further configured to transmit a metafile having meta information used to cause a reception apparatus to acquire the basic video stream and the one or more enhancement video streams,

wherein scalability information is inserted into the metafile.

6. The transmission apparatus according to claim 1 , wherein the processing circuitry is further configured to insert information associated with the second ratio into the encoded image data of the image data having the first enhancement formats.

7. A reception apparatus, comprising:

receiving circuitry configured to receive a container, containing a basic video stream, having encoded image data of image data, having a basic format, from which an image having a high definition at a basic frame rate is to be obtained, and one or more enhancement video streams containing encoded image data of: (i) image data, having a first enhancement format, from which image having the high definition at a high frame rate is to be obtained, (ii) image data, having a second enhancement format obtained based on at least the image data having the basic format, from which an image at the basic frame rate is to be obtained, and (iii) image data, having a third enhancement format obtained based on at least the image data having the first enhancement format, from which an image having at the high frame rate is to be obtained; and

processing circuitry configured to process only the basic video stream to obtain image data having the high definition at the basic frame rate, or process a part of or a whole of the one or more enhancement video streams to obtain image data having the high definition at the high frame rate or image data having the basic frame rate,

wherein image data having the basic format is obtained by mixing processing at a first ratio in units of two temporally consecutive pictures in image data having the high frame rate to obtain first image data as image data at the basic frame rate,

wherein the image data having the first enhancement format obtained by mixing processing at a second ratio in units of two temporally consecutive pictures in image data at the high frame rate to obtain second image data as image data having an enhancement frame at the high frame rate,

wherein the spatial scalability information is inserted into the encoded image data of the image data having the second and the third enhancement formats, or a container position corresponding to the encoded image data, and temporal scalability information is inserted into the encoded image data of the image data having the first and the third enhancement formats, or the container position corresponding to the encoded image data.

8. The reception apparatus according to claim 7 , wherein the image data having the first enhancement format obtained by mixing processing at a second ratio in units of two temporally consecutive pictures in image data at the high frame rate to obtain second image data as image data having an enhancement frame at the high frame rate.

9. The reception apparatus according to claim 7 , wherein identification information indicating that the image data having the basic format is image data obtained by the mixing processing into the encoded image data of the image data having the first enhancement formats or a layer of the container.

10. The reception apparatus according to claim 7 , wherein information at the first ratio is inserted into the encoded image data of the image data having the first enhancement formats, or a layer of the container, and

when the processing circuitry obtains the image data having the high definition at the high frame rate, the processing circuitry is configured to use the inserted information at the first ratio.

11. The reception apparatus according to claim 7 , wherein the receiving circuitry is further configured to receive a metafile having meta information including scalability information, and

the processing circuitry is configured to process the basic video stream and the one or more enhancement video streams based on the scalability information.

12. The reception apparatus according to claim 7 , wherein information at the second ratio is inserted into the encoded image data of the image data having the first enhancement formats, and

when the processing circuitry obtains the image data having the high definition at the high frame rate, the processing circuitry is configured to use the inserted information at the second ratio.

13. A reception method, comprising:

receiving, by receiving circuitry of a reception apparatus, a container containing a basic video stream, having encoded image data of image data, having a basic format, from which an image having a high definition at a basic frame rate is to be obtained, and one or more enhancement video streams containing encoded image data of (i) image data, having a first enhancement format, from which image having the high definition at a high frame rate is to be obtained, (ii) image data, having a second enhancement format obtained based on at least the image data having the basic format, from which an image having an ultra-high definition at the basic frame rate is to be obtained, and (iii) image data, having a third enhancement format obtained based on at least the image data having the first enhancement format, from which an image having the ultra-high definition at the high frame rate is to be obtained; and

processing, by processing circuitry of the reception apparatus, only the basic video stream to obtain image data having the high definition deformation at the basic frame rate, or processing a part of or a whole of the one or more enhancement video streams to obtain image data having the high definition at the high frame rate or image data having the basic frame rate,

wherein the image data having the basic format is obtained by mixing processing at a first ratio in units of two temporally consecutive pictures in image data having the high frame rate to obtain first image data as image data at the basic frame rate,

wherein the image data having the first enhancement format obtained by mixing processing at a second ratio in units of two temporally consecutive pictures in image data at the high frame rate to obtain second image data as image data having an enhancement frame at the high frame rate,

wherein the spatial scalability information is inserted into the encoded image data of the image data having the second and the third enhancement formats, or a container position corresponding to the encoded image data, and temporal scalability information is inserted into the encoded image data of the image data having the first and the third enhancement formats, or the container position corresponding to the encoded image data.

14. The reception method according to claim 13 , wherein the image data having the first enhancement format obtained by mixing processing at a second ratio in units of two temporally consecutive pictures in image data at the high frame rate to obtain second image data as image data having an enhancement frame at the high frame rate.

15. The reception method according to claim 13 , wherein identification information indicating that the image data having the basic format is image data obtained by the mixing processing into the encoded image data of the image data having the first enhancement formats or a layer of the container.

16. The reception method according to claim 13 , wherein information at the first ratio is inserted into the encoded image data of the image data having the first enhancement formats, or a layer of the container, and

when the processing circuitry obtains the image data having the high definition at the high frame rate, the processing circuitry is configured to use the inserted information at the first ratio.

17. The reception method according to claim 13 , wherein the receiving circuitry is further configured to receive a metafile having meta information including scalability information, and

the processing circuitry is configured to process the basic video stream and the one or more enhancement video streams based on the scalability information.

18. The reception method according to claim 13 , wherein information at the second ratio is inserted into the encoded image data of the image data having the first enhancement formats, and

when the processing circuitry obtains the image data having the high definition at the high frame rate, the processing circuitry is configured to use the inserted information at the second ratio.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2024
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 066446/0902 →
CHANGE OF NAME Recorded Oct 18, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 061702/0429 →
Priority Claims (1)
JP JP2015-202464 · Oct 13, 2015 · national
Continuity (2)
Continuation 15765898
Related Publication 20210281889A1 · Sep 9, 2021