IP Library Granted Patent US 11,412,176
Granted Patent B2
US 11,412,176 · App. 17/215,961 · Granted Aug 9, 2022

Transmission device, transmission method, reception device, and reception method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SONY CORPORATION
H04N7/0127H04N7/01H04N19/31H04N19/587H04N19/70H04N19/85H04N21/234381H04N21/438H04N19/132H04N21/2662
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,412,176
App. No.
17/215,961
Granted
Aug 9, 2022
Kind
B2
Abstract

To preferably transmit normal-frame-rate and high-frame-rate image data. A first ratio mixing processing is performed on two temporally-consecutive pictures in high-frame-rate image data to obtain basic-frame-rate image data, and a second ratio mixing processing is performed on the two temporally-consecutive pictures to obtain high-frame-rate image data of an extended frame. An encoding processing is performed on the reference-frame-rate image data to obtain a basic stream and an encoding processing is performed on the high-frame-rate image data of the extended frame to obtain an extended stream. A container including the basic stream and the extended stream in a predetermined format is transmitted.

Claims (87)

1. A transmission device, comprising circuitry configured to:

perform a first mixing process on two temporally-consecutive first pictures in high-frame-rate image data to obtain basic image data, a first mixing ratio of the first mixing process being p to q, p and q being numbers, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and a second mixing process on two temporally-consecutive second pictures in the high-frame-rate image data to obtain extended image data, a second mixing ratio of the second mixing process being r to s, r and s being numbers, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1;

perform an encoding process to encode the basic image data to obtain basic encoded image data, and to encode the extended image data to obtain extended encoded image data; and

transmit a container including the basic encoded image data and the extended encoded image data, wherein identification information indicating the basic image data is obtained by performing the first mixing process is inserted into a layer of the container.

2. The transmission device according to claim 1 , wherein the first mixing ratio is different from the second mixing ratio.

3. The transmission device according to claim 1 , wherein the two temporally-consecutive first pictures include at least one of the two temporally-consecutive second pictures.

4. The transmission device according to claim 1 , wherein the two temporally-consecutive first pictures are the same two pictures of the two temporally-consecutive second pictures.

5. The transmission device according to claim 1 , wherein the identification information includes mixing ratio information indicating the first mixing ratio.

6. The transmission device according to claim 1 , wherein the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF).

7. A reception device, comprising circuitry configured to:

receive a container including basic encoded image data which is obtained by encoding basic image data, and extended encoded image data which is obtained by encoding extended image data, wherein the basic image data is obtained by performing a first mixing process on two temporally-consecutive first pictures in high-frame-rate image data, a first mixing ratio of the first mixing process being p to q, p and q being numbers, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and the extended image data is obtained by performing a second mixing process on two temporally-consecutive second pictures in the high-frame-rate image data, a second mixing ratio of the second mixing process being r to s, r and s being numbers, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1;

extract identification information indicating the basic image data is obtained by performing the first mixing process from a layer of the container;

decode the basic encoded image data to obtain decoded basic image data;

decode the extended encoded image data to obtain decoded extended image data; and

perform a reverse mixing process with the decoded basic image data, the decoded extended image data, and the identification information to obtain image data of two temporally-consecutive pictures.

8. The reception device according to claim 7 , wherein the reverse mixing process is performed according to:

[

A

B

]

=

[

C

D

]

*

1

p

*

s

-

q

*

r

[

s

-

r

-

q

p

]

,

where A and B represent the image data of the two temporally-consecutive pictures, respectively, C and D represent the decoded basic image data and the decoded extended image data, respectively.

9. The reception device according to claim 7 , wherein the two temporally-consecutive first pictures in the high-frame-rate image data are the same two pictures of the two temporally-consecutive second pictures in the high-frame-rate image data.

10. The reception device according to claim 7 , wherein the identification information includes mixing ratio information indicating the first mixing ratio.

11. The reception device according to claim 7 , wherein the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF).

12. A reception method, comprising:

receiving, by circuitry of a reception device, a container including basic encoded image data which is obtained by encoding basic image data, and extended encoded image data which is obtained by encoding extended image data, wherein the basic image data is obtained by performing a first mixing process on two temporally-consecutive first pictures in high-frame-rate image data, a first mixing ratio of the first mixing process being p to q, p and q being numbers, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and the extended image data is obtained by performing a second mixing process on two temporally-consecutive second pictures in the high-frame-rate image data, a second mixing ratio of the second mixing process being r to s, r and s being numbers, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1;

extracting identification information indicating the basic image data is obtained by performing the first mixing process from a layer of the container;

decoding the basic encoded image data to obtain decoded basic image data;

decoding the extended encoded image data to obtain decoded extended image data; and

performing a reverse mixing process with the decoded basic image data, the decoded extended image data, and the identification information to obtain image data of two temporally-consecutive pictures.

13. The reception method according to claim 12 , wherein the reverse mixing process is performed according to:

[

A

B

]

=

[

C

D

]

*

1

p

*

s

-

q

*

r

[

s

-

r

-

q

p

]

,

where A and B represent the image data of the two temporally-consecutive pictures, respectively, C and D represent the decoded basic image data and the decoded extended image data, respectively.

14. The reception method according to claim 12 , wherein the two temporally-consecutive first pictures in the high-frame-rate image data are the same two pictures of the two temporally-consecutive second pictures in the high-frame-rate image data.

15. The reception method according to claim 12 , wherein the identification information includes mixing ratio information indicating the first mixing ratio.

16. The reception method according to claim 12 , wherein the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF).

Assignments (3)
CHANGE OF NAME Recorded Dec 22, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 074020/0054 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2025
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 074027/0759 →
CHANGE OF NAME Recorded Dec 15, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062136/0310 →
Priority Claims (1)
JP 2015-178976 · Sep 10, 2015 · national
Continuity (2)
Continuation 15756212
Related Publication 20210218930A1 · Jul 15, 2021