IP Library › Granted Patent US 11,350,115
Granted Patent B2
US 11,350,115 · App. 16/621,437 · Granted May 31, 2022

Transmitting apparatus, transmitting method, receiving apparatus, and receiving method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SATURN LICENSING LLC
H04N19/31H04N19/132H04N19/136H04N19/172H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,350,115
App. No.
16/621,437
Granted
May 31, 2022
Kind
B2
Abstract

A transmission apparatus configured to mix, at a mixing rate, pixels of first video data with pixels of peripheral frames of the first video data and obtain second video data at a first frame rate. The mixing rate for each pixel of a frame of the first video data is based on a luminance value of the pixel. The second video data includes frames having a second frame rate lower than the first frame rate. The apparatus encodes the frames having the second frame rate to obtain a basic stream and encodes remaining frames of the second video data to obtain an extended stream, inserts information about the mixing rate into the basic stream and the extended stream in association with each frame, and transmits the basic stream and the extended stream into which the information about the mixing rate has been inserted.

Claims (51)

1. A transmission apparatus, comprising:

circuitry configured to

perform blending, at one or more blending rates, pixels of each frame of first video data with pixels of one or more peripheral frames of the first video data and obtain second video data at a first frame rate, the blending rate for each pixel of the respective frame of the first video data being selected from plural candidate blending rates based on a luminance value of the respective pixel, the second video data including frames corresponding to a second frame rate that is lower than the first frame rate, the frames corresponding to the second frame rate being blended with the one or more peripheral frames,

encode the frames corresponding to the second frame rate to obtain a basic stream and encode remaining frames of the second video data to obtain an extended stream,

insert information about the one or more blending rates for blending the pixels of the respective frame of the first video data into the basic stream or the extended stream, and

transmit the basic stream and the extended stream with the information about the one or more blending rates inserted in the basic stream or the extended stream.

2. The transmission apparatus according to claim 1 , wherein the information about the one or more blending rates includes the plural candidate blending rates and a corresponding luminance range for at least one of the plural candidate blending rates.

3. The transmission apparatus according to claim 1 ,

wherein the basic stream and the extended stream have a Network Abstraction Layer (NAL) unit structure, and

the circuitry is configured to insert a Supplemental Enhancement Information (SEI) NAL unit with the information about the one or more blending rates into the basic stream or the extended stream.

4. The transmission apparatus according to claim 1 , wherein the circuitry is configured to determine, when performing the blending the pixels of each frame of the first video data with the pixels of the one or more peripheral frames of the first video data, the blending rate for each pixel of the respective frame of the first video data based on the luminance value of the respective pixel, and based on luminance values of the corresponding pixels of the one or more peripheral frames.

5. The transmission apparatus according to claim 2 , wherein the information about the one or more blending rates includes a first luminance threshold and a second luminance threshold, the first luminance threshold and the second luminance threshold defining the corresponding luminance range for the at least one of the plural candidate blending rates.

6. The transmission apparatus according to claim 1 ,

wherein the first frame rate is 120 Hz or 240 Hz, and the second frame rate is 60 Hz.

7. A reception apparatus, comprising:

circuitry configured to

receive a basic stream and an extended stream, which are obtained by

performing blending, at one or more blending rates, pixels of each frame of first video data with pixels of one or more peripheral frames of the first video data and obtaining second video data at a first frame rate, the blending rate for each pixel of the respective frame of the first video data being selected from plural candidate blending rates based on a luminance value of the respective pixel, the second video data including frames corresponding to a second frame rate that is lower than the first frame rate, the frames corresponding to the second frame rate are blended with the one or more peripheral frames,

encoding the frames corresponding to the second frame rate to obtain the basic stream, and

encoding remaining frames of the second video data to obtain the extended stream, wherein

information about the one or more blending rates for blending the pixels of the respective frame of the first video data is included in the basic stream or the extended stream, and

the circuitry is further configured to, based on a frame rate capability of a display connected to the reception apparatus,

decode the basic stream to obtain the frames corresponding to the second frame rate, or

decode the basic stream and the extended stream to obtain the second video data, and obtain unblended video data at the first frame rate by performing a reverse blending process on the second video data on a basis of the information about the one or more blending rates.

8. The reception apparatus according to claim 7 , wherein

the information about the one or more blending rates includes the plural candidate blending rates and a corresponding luminance range for at least one of the plural candidate blending rates, and

the circuitry is configured to perform the reverse blending process based on the plural candidate blending rates and the corresponding luminance range for the at least one of the plural candidate blending rates.

9. A reception method comprising:

receiving, by circuitry of a reception apparatus, a basic stream and an extended stream, which are obtained by

performing blending, at one or more blending rates, pixels of each frame of first video data with pixels of one or more peripheral frames of the first video data and obtaining second video data at a first frame rate, the blending rate for each pixel of the respective frame of the first video data being selected from plural candidate blending rates based on a luminance value of the respective pixel, the second video data including frames corresponding to a second frame rate that is lower than the first frame rate, the frames corresponding to the second frame rate are blended with the one or more peripheral frames,

encoding the frames corresponding to the second frame rate to obtain the basic stream, and

encoding remaining frames of the second video data to obtain the extended stream, wherein

information about the one or more blending rates for blending the pixels of the respective frame of the first video data is included in the basic stream or the extended stream, and

the reception method further comprises, based on a frame rate capability of a display connected to the reception apparatus,

decoding, by the circuitry, the basic stream to obtain the frames corresponding to the second frame rate, or

decoding the basic stream and the extended stream to obtain the second video data, and obtaining unblended video data at the first frame rate by performing a reverse blending process on the second video data on a basis of the information about the one or more blending rates.

10. The reception apparatus according to claim 7 ,

wherein the basic stream and the extended stream have a Network Abstraction Layer (NAL) unit structure, and

a Supplemental Enhancement Information (SEI) NAL unit with the information about the one or more blending rates is inserted into the basic stream or the extended stream.

11. The reception apparatus according to claim 8 , wherein the information about the one or more blending rates includes a first luminance threshold and a second luminance threshold, the first luminance threshold and the second luminance threshold defining the corresponding luminance range for the at least one of the plural candidate blending rates.

12. The reception apparatus according to claim 7 ,

wherein the first frame rate is 120 Hz or 240 Hz, and the second frame rate is 60 Hz.

13. The reception method according to claim 9 , wherein

the information about the one or more blending rates includes the plural candidate blending rates and a corresponding luminance range for at least one of the plural candidate blending rates, and

performing, by the circuitry, the reverse blending process based on the plural candidate blending rates and the corresponding luminance range for the at least one of the plural candidate blending rates.

14. The reception method according to claim 9 , wherein

the basic stream and the extended stream have a Network Abstraction Layer (NAL) unit structure, and

a Supplemental Enhancement Information (SEI) NAL unit with the information about the one or more blending rates is inserted into the basic stream or the extended stream.

15. The reception method according to claim 13 , wherein the information about the one or more blending rates includes a first luminance threshold and a second luminance threshold, the first luminance threshold and the second luminance threshold defining the corresponding luminance range for the at least one of the plural candidate blending rates.

16. The reception method according to claim 9 ,

wherein the first frame rate is 120 Hz or 240 Hz, and the second frame rate is 60 Hz.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2021
From: SONY CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 055649/0604 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2019
From: TSUKAGOSHI, IKUO
To: SONY CORPORATION
Reel/Frame 051375/0028 →
Priority Claims (1)
JP JP2017-120026 · Jun 19, 2017 · national
Continuity (1)
Related Publication 20200195943A1 · Jun 18, 2020