IP Library Granted Patent US 10,250,901
Granted Patent B2
US 10,250,901 · App. 14/399,282 · Granted Apr 2, 2019

Transmitting/receiving device, method, and coding/decoding device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,250,901
App. No.
14/399,282
Granted
Apr 2, 2019
Kind
B2
Abstract

Provided is a transmitting device including a hierarchical classification section that classifies image data of each picture constituting moving image data into a plurality of layers, an image coding section that codes the classified image data of each layer, and generates a video stream holding the coded image data of each layer, and a transmitting section that transmits a container in a prescribed format that includes the generated video stream. The image coding section performs coding so that a referenced picture belongs to a layer of referencing image data and/or a layer lower than the layer of the referencing image data.

Claims (90)

1. A transmitting device comprising:

circuitry configured to:

classify image data of pictures constituting moving image data into a plurality of layers arranged in a hierarchical order, each picture belonging to any particular layer that is not a lowest layer of the plurality of layers having a temporal position in a temporal center between two temporally adjacent pictures belonging to a combination of any of the plurality of layers that are lower than the particular layer;

code the classified image data of each layer, including coding a picture of a layer using a referenced picture that belongs to the same layer or a lower layer;

generate a video stream holding the coded image data of each layer;

generate a container layer descriptor that includes

frame frequency information of pictures in the lowest layer,

layer number information indicating

a number of layers in the plurality of layers, and

for each layer higher than the lowest layer, a respective multiplication factor, a frame frequency corresponding to the layer being a frame frequency of the lowest layer multiplied by the respective multiplication factor;

generate a container in a prescribed format that includes the generated video stream and the generated container layer descriptor; and

transmit the generated container.

2. The transmitting device according to claim 1 , wherein the circuitry is configured to:

generate a single video stream holding the coded image data of each layer, and

add, for each picture, layer identification information for identifying the layer containing the picture to the coded image data of each layer.

3. The transmitting device according to claim 1 , wherein the circuitry is configured to generate a plurality of video streams holding the coded image data for each of the plurality of layers.

4. The transmitting device according to claim 3 , wherein the circuitry is configured to insert stream identification information for identifying the video stream of each layer into the container layer descriptor.

5. A transmitting method comprising:

classifying image data of pictures constituting moving image data into a plurality of layers arranged in a hierarchical order, each picture belonging to any particular layer that is not a lowest layer of the plurality of layers having a temporal position in a temporal center between two temporally adjacent pictures belonging to a combination of any of the plurality of layers that are lower than the particular layer;

coding the classified image data of each layer, including coding a picture of a layer using a referenced picture that belongs to the same layer or a lower layer;

generating a video stream holding the coded image data of each layer;

generating a container layer descriptor that includes

frame frequency information of pictures in the lowest layer,

layer number information indicating a number of layers in the plurality of layers, and

for each layer higher than the lowest layer, a respective multiplication factor, a frame frequency corresponding to the layer being a frame frequency of the lowest layer multiplied by the respective multiplication factor;

generating a container in a prescribed format that includes the generated video stream and the generated container layer descriptor; and

transmitting the generated container.

6. A transmitting device comprising:

circuitry configured to:

classify image data of pictures constituting moving image data into a plurality of layers arranged in a hierarchical order, each picture belonging to any particular layer that is not a lowest layer of the plurality of layers having a temporal position in a temporal center between two temporally adjacent pictures belonging to a combination of any of the plurality of layers that are lower than the particular layer;

code the classified image data of each layer;

generate a single video stream holding the coded image data of each layer;

add, for each picture, layer identification information for identifying the layer containing the picture to the coded image data of each layer;

generate a container layer descriptor that includes

frame frequency information of pictures in the lowest layer,

layer number information indicating a number of layers in the plurality of layers, and

for each layer higher than the lowest layer, a respective multiplication factor, a frame frequency corresponding to the layer being a frame frequency of the lowest layer multiplied by the respective multiplication factor;

generate a container in a prescribed format that includes the generated video stream and the generated container layer descriptor; and

transmit the generated container.

7. A coding device comprising:

circuitry configured to:

classify image data of pictures constituting moving image data into a plurality of layers arranged in a hierarchical order, each picture belonging to any particular layer that is not a lowest layer of the plurality of layers having a temporal position in a temporal center between two temporally adjacent pictures belonging to a combination of any of the plurality of layers that are lower than the particular layer;

code the classified image data of each layer, including coding a picture of a layer using a referenced picture that belongs to the same layer or a lower layer;

generate a video stream holding the coded image data of each layer;

generate a transport stream layer descriptor that includes

frame frequency information of pictures in the lowest layer,

layer number information indicating a number of layers in the plurality of layers, and

for each layer higher than the lowest layer, a respective multiplication factor, a frame frequency corresponding to the layer being a frame frequency of the lowest layer multiplied by the respective multiplication factor; and

generate a transport stream in a prescribed format that includes the generated video stream and the generated transport stream layer descriptor.

8. The coding device according to claim 7 , wherein the circuitry is further configured to:

generate a single video stream holding the coded image data of each layer, and

add, for each picture, layer identification information for identifying the layer containing the picture to the coded image data of each layer.

9. A receiving device comprising:

circuitry configured to:

receive a container in a prescribed format that includes a container layer descriptor and a video stream holding image data of pictures constituting moving image data, the image data being classified into a plurality of layers arranged in a hierarchical order and coded so that a picture of a layer is coded using a referenced picture that belongs to the same layer or a lower layer, and each picture belonging to any particular layer that is not a lowest layer of the plurality layers having a temporal position in a temporal center between two temporally adjacent pictures belonging to a combination of any of the plurality of layers that are lower than the particular layer;

retrieve, from the container layer descriptor,

frame frequency information of pictures in the lowest layer,

layer number information indicating a number of layers in the plurality of layers, and

for each layer higher than the lowest layer, a respective multiplication factor, a frame frequency corresponding to the layer being a frame frequency of the lowest layer multiplied by the respective multiplication factor;

retrieve and decode coded image data of a selected layer, or the selected layer and any of the plurality of layers that are lower than the selected layer when the selected layer is not the lowest layer, from the video stream included in the received container to obtain decoded image data of pictures associated with the selected layer; and

adjust a speed of image playback of the decoded image data according to a frame frequency associated with the selected layer that is determined based on the retrieved frame frequency information and a corresponding multiplication factor.

10. The receiving device according to claim 9 , wherein the circuitry is configured to:

determine the selected layer on the basis of the frame frequency associated with the selected layer and decoding performance of the receiving device.

11. The receiving device according to claim 9 , wherein

a single video stream holding the coded image data of each layer is included in the container,

for each picture, layer identification information for identifying the layer containing the picture is added to the coded image data of each layer, and

the circuitry is configured to retrieve and decode the coded image data of the selected layer, or the selected layer and any of the plurality of layers that are lower than the selected layer when the selected layer is not the lowest layer, from the single video stream on the basis of the layer identification information.

12. The receiving device according to claim 9 , wherein

a plurality of video streams holding the coded image data for each of the plurality of layers is included in the container,

stream identification information for identifying the video stream of each layer is inserted into the container layer descriptor, and

the circuitry is configured to retrieve and decode the coded image data of the selected layer, or the selected layer and any of the plurality of layers that are lower than the selected layer when the selected layer is not the lowest layer, from the video streams on the basis of the stream identification information.

13. A receiving method comprising:

receiving a container in a prescribed format that includes a container layer descriptor and a video stream holding image data of pictures constituting moving image data, the image data being classified into a plurality of layers arranged in a hierarchical order and coded so that a picture of a layer is coded using a referenced picture that belongs to the same layer or a lower layer, and each picture belonging to any particular layer that is not a lowest layer of the plurality of layers having a temporal position in a temporal center between two temporally adjacent pictures belonging to a combination of any of the plurality of layers that are lower than the particular layer;

retrieving, from the container layer descriptor,

frame frequency information of pictures in the lowest layer,

layer number information indicating a number of layers in the plurality of layers, and

for each layer higher than the lowest layer, a respective multiplication factor, a frame frequency corresponding to the layer being a frame frequency of the lowest layer multiplied by the respective multiplication factor;

retrieving and decoding coded image data of a selected layer, or the selected layer and any of the plurality of layers that are lower than the selected layer when the selected layer is not the lowest layer, from the video stream included in the received container to obtain decoded image data of pictures associated with the selected layer; and

adjusting a speed of image playback of the decoded image data according to a frame frequency associated with the selected layer that is determined based on the retrieved frame frequency information and a corresponding multiplication factor.

14. A decoding device comprising:

circuitry configured to:

retrieve and decode coded image data of a selected layer of a plurality of layers, or the selected layer and any of the plurality of layers that are lower than the selected layer when the selected layer is not a lowest layer of the plurality of layers, from a video stream of a container to obtain decoded image data of pictures associated with the selected layer, the video stream holding image data of pictures constituting moving image data, the image data being classified into the plurality of layers arranged in a hierarchical order and coded so that a picture of a layer is coded using a referenced picture that belongs to the same layer or a lower layer, and each picture belonging to any particular layer that is not the lowest layer of the plurality of layers having a temporal position in a temporal center between two temporally adjacent pictures belonging to a combination of any of the plurality of layers that are lower than the particular layer;

retrieve, from a container layer descriptor of the container,

frame frequency information of pictures in the lowest layer,

layer number information indicating a number of layers in the plurality of layers, and

for each layer higher than the lowest layer, a respective multiplication factor, a frame frequency corresponding to the layer being a frame frequency of the lowest layer multiplied by the respective multiplication factor; and

adjust a speed of image playback of the decoded image data according to a frame frequency associated with the selected layer that is determined based on the retrieved frame frequency information and a corresponding multiplication factor.

15. The receiving method according to claim 13 , further comprising:

retrieving, from the container layer descriptor, stream identification information for identifying the video stream of each layer,

wherein the retrieving and decoding the coded image data of the selected layer is performed on the basis of the stream identification information.

Assignments (2)
ASSIGNMENT OF THE ENTIRE INTEREST SUBJECT TO AN AGREEMENT RECITED IN THE DOCUMENT Recorded Jan 18, 2017
From: SONY CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 041391/0037 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2014
From: YUZAWA, KEIJI; SUZUKI, TERUHIKO
To: SONY CORPORATION
Reel/Frame 034179/0471 →