IP Library Granted Patent US 11,722,636
Granted Patent B2
US 11,722,636 · App. 17/847,774 · Granted Aug 8, 2023

Transmission device, transmission method, reception device, and reception method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N7/0127H04N7/01H04N19/31H04N19/587H04N19/70H04N19/85H04N21/234381H04N21/438H04N19/132H04N21/2662
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,722,636
App. No.
17/847,774
Granted
Aug 8, 2023
Kind
B2
Abstract

To preferably transmit normal-frame-rate and high-frame-rate image data. A first ratio mixing processing is performed on two temporally-consecutive pictures in high-frame-rate image data to obtain basic-frame-rate image data, and a second ratio mixing processing is performed on the two temporally-consecutive pictures to obtain high-frame-rate image data of an extended frame. An encoding processing is performed on the reference-frame-rate image data to obtain a basic stream and an encoding processing is performed on the high-frame-rate image data of the extended frame to obtain an extended stream. A container including the basic stream and the extended stream in a predetermined format is transmitted.

Claims (89)

1. A transmission device, comprising circuitry configured to:

perform a first mixing process on two temporally-consecutive first pictures in high-frame-rate image data to obtain basic image data, a first mixing ratio of the first mixing process being p to q, p and q being numbers, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and a second mixing process on two temporally-consecutive second pictures in the high-frame-rate image data to obtain extended image data, a second mixing ratio of the second mixing process being r to s, r and s being numbers, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1;

perform an encoding process to encode the basic image data to obtain basic encoded image data, and to encode the extended image data to obtain extended encoded image data; and

transmit the basic encoded image data, the extended encoded image data, and mixing ratio information indicating the first mixing ratio.

2. The transmission device according to claim 1 , wherein the first mixing ratio is different from the second mixing ratio.

3. The transmission device according to claim 1 , wherein the two temporally-consecutive first pictures include at least one of the two temporally-consecutive second pictures.

4. The transmission device according to claim 1 , wherein the two temporally-consecutive first pictures are the same two pictures of the two temporally-consecutive second pictures.

5. The transmission device according to claim 1 , wherein the circuitry is configured to transmit a container including the basic encoded image data, the extended encoded image data, and the mixing ratio information, and the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF).

6. A reception device, comprising:

a receiver configured to:

receive basic encoded image data which is obtained by encoding basic image data, and extended encoded image data which is obtained by encoding extended image data, wherein the basic image data is obtained by performing a first mixing process on two temporally-consecutive first pictures in high-frame-rate image data, a first mixing ratio of the first mixing process being p to q, p and q being numbers, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and the extended image data is obtained by performing a second mixing process on two temporally-consecutive second pictures in the high-frame-rate image data, a second mixing ratio of the second mixing process being r to s, r and s being numbers, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1; and

receive mixing ratio information indicating the first mixing ratio; and

circuitry configured to:

decode the basic encoded image data to obtain decoded basic image data;

decode the extended encoded image data to obtain decoded extended image data; and

perform a reverse mixing process with the decoded basic image data, the decoded extended image data, and the mixing ratio information to obtain the high-frame-rate image data.

7. The reception device according to claim 6 , wherein the reverse mixing process is performed according to:

[

A

B

]

=

[

C

D

]

*

1

p

*

s

-

q

*

r

[

s

-

r

-

q

p

]

,

where A and B represent the image data of the two temporally-consecutive pictures, respectively, C and D represent the decoded basic image data and the decoded extended image data, respectively.

8. The reception device according to claim 6 , wherein the two temporally-consecutive first pictures in the high-frame-rate image data are the same two pictures of the two temporally-consecutive second pictures in the high-frame-rate image data.

9. The reception device according to claim 6 , wherein the circuitry is further configured to perform interpolation processing on the high-frame-rate image data to obtain image data having a higher frame rate than the high-frame-rate image data.

10. The reception device according to claim 6 , wherein the basic encoded image data, the extended encoded image data, and the mixing ratio information are included in a container, and the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF).

11. The reception device according to claim 6 , further comprising:

a display to display the high-frame-rate image data.

12. A reception method, comprising:

receiving, by a receiver of a reception device, basic encoded image data which is obtained by encoding basic image data, and extended encoded image data which is obtained by encoding extended image data, wherein the basic image data is obtained by performing a first mixing process on two temporally-consecutive first pictures in high-frame-rate image data, a first mixing ratio of the first mixing process being p to q, p and q being numbers, p being greater than or equal to 0 and smaller than or equal to 1, a sum of p and q being equal to 1, and the extended image data is obtained by performing a second mixing process on two temporally-consecutive second pictures in the high-frame-rate image data, a second mixing ratio of the second mixing process being r to s, r and s being numbers, r being greater than or equal to 0 and smaller than or equal to 1, a sum of r and s being equal to 1;

receiving, by the receiver of the reception device, mixing ratio information indicating the first mixing ratio;

decoding, by circuitry of the reception device, the basic encoded image data to obtain decoded basic image data;

decoding, by the circuitry of the reception device, the extended encoded image data to obtain decoded extended image data; and

performing, by the circuitry of the reception device, a reverse mixing process with the decoded basic image data, the decoded extended image data, and the mixing ratio information to obtain the high-frame-rate image data.

13. The reception method according to claim 12 , wherein the reverse mixing process is performed according to:

[

A

B

]

=

[

C

D

]

*

1

p

*

s

-

q

*

r

[

s

-

r

-

q

p

]

,

where A and B represent the image data of the two temporally-consecutive pictures, respectively, C and D represent the decoded basic image data and the decoded extended image data, respectively.

14. The reception method according to claim 12 , wherein the two temporally-consecutive first pictures in the high-frame-rate image data are the same two pictures of the two temporally-consecutive second pictures in the high-frame-rate image data.

15. The reception method according to claim 12 , further comprising:

performing, by the circuitry of the reception device, interpolation processing on the high-frame-rate image data to obtain image data having a higher frame rate than the high-frame-rate image data.

16. The reception method according to claim 12 , wherein the basic encoded image data, the extended encoded image data, and the mixing ratio information are included in a container, and the container has a format of MPEG-2 Transport Stream (MPEG-2 TS), MPEG Media Transport (MMT) or ISO Base Media File Format (ISO BMFF).

Assignments (3)
CHANGE OF NAME Recorded Dec 22, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 074020/0054 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2025
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 074027/0759 →
CHANGE OF NAME Recorded Dec 15, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062136/0310 →
Continuity (3)
Continuation 17215961 · Mar 29, 2021
Continuation 15756212
Related Publication 20220329753A1 · Oct 13, 2022