IP Library Granted Patent US 10,349,144
Granted Patent B2
US 10,349,144 · App. 15/572,313 · Granted Jul 9, 2019

Reception device, receiving method, transmission device, and transmitting method

Inventor: Ikuo Tsukagoshi (Tokyo, JP)
Assignee: SONY CORPORATION
H04N21/4884H04N5/278H04N5/44504H04N19/46H04N9/67H04N2005/44526
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,349,144
App. No.
15/572,313
Granted
Jul 9, 2019
Kind
B2
Abstract

The technology is directed to keeping high image quality when a subtitle is superimposed on a video. A reception device includes circuitry configured to receive a video stream and a subtitle stream. The circuitry processes the video stream to obtain video data of a video. The circuitry processes the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image. The circuitry adjusts a color gamut of the subtitle bitmap data to a color gamut of the video data. The color gamut of the subtitle bitmap data is adjusted based on color gamut identification information of the subtitle bitmap data and color gamut identification information of the video data. The circuitry further superimposes, on the video, the color gamut adjusted subtitle bitmap image.

Claims (41)

1. A reception device comprising:

circuitry configured to

receive a video stream and a subtitle stream;

process the video stream to obtain video data of a video;

process the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image;

obtain color gamut identification information of the subtitle bitmap data that is provided in the subtitle stream or a container that includes the video stream and the subtitle stream;

generate a color gamut adjusted subtitle bitmap image by adjusting a color gamut of the subtitle bitmap data to a color gamut of the video data, the color gamut of the subtitle bitmap data being adjusted based on the color gamut identification information of the subtitle bitmap data and color gamut identification information of the video data; and

when a pixel of a region of the video on which the color gamut adjusted subtitle bitmap image is to be superimposed corresponds to a high luminance portion and a mixing ratio of the video data exceeds a threshold value,

decrease an original luminance level of the pixel to become a decreased luminance level, and

superimpose, on the video with the pixel having the decreased luminance level, the color gamut adjusted subtitle bitmap image.

2. The reception device according to claim 1 , wherein the circuitry is configured to adjust a maximum level of luminance of the subtitle bitmap data to a reference level or less of luminance of the video data, the maximum level of the luminance being adjusted based on dynamic range information of the subtitle bitmap data and dynamic range information of the video data.

3. The reception device according to claim 2 , wherein the circuitry is configured to obtain the dynamic range information of the subtitle bitmap data from the subtitle stream or the container that includes the video stream and the subtitle stream.

4. The reception device according to claim 2 , wherein the dynamic range of the subtitle bitmap data is set to a default range when the dynamic range information of the subtitle bitmap data is not available from the subtitle stream or the container that includes the video stream and the subtitle stream.

5. The reception device according to claim 1 , wherein the circuitry is configured to, when the pixel of the region of the video does not correspond to the high luminance portion or the mixing ratio of the video data does not exceed the threshold value,

superimpose, on the video with the pixel having the original luminance level, the color gamut adjusted subtitle bitmap image.

6. A reception device comprising:

circuitry configured to

receive a video stream and a subtitle stream;

process the video stream to obtain video data of a video;

process the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image;

obtain dynamic range information of the subtitle bitmap data that is provided in the subtitle stream or a container that includes the video stream and the subtitle stream;

generate an luminance adjusted subtitle bitmap image by adjusting a maximum level of luminance of the subtitle bitmap data to a reference level or less of luminance of the video data, the maximum level of the luminance of the subtitle bitmap data being adjusted based on the dynamic range information of the subtitle bitmap data and dynamic range information of the video data; and

when a pixel of a region of the video on which the luminance adjusted subtitle bitmap image is to be superimposed corresponds to a high luminance portion and a mixing ratio of the video data exceeds a threshold value,

decrease an original luminance level of the pixel to become a decreased luminance level, and

superimpose, on the video with the pixel having the decreased luminance level, the luminance adjusted subtitle bitmap image.

7. The reception device according to claim 6 , wherein the circuitry is configured to adjust a color gamut of the subtitle bitmap data to a color gamut of the video data, the color gamut of the subtitle bitmap data being adjusted based on color gamut identification information of the subtitle bitmap data and color gamut identification information of the video data.

8. The reception device according to claim 7 , wherein the circuitry is configured to obtain the color gamut identification information of the subtitle bitmap data from the subtitle stream or the container that includes the video stream and the subtitle stream.

9. The reception device according to claim 7 , wherein the color gamut identification information of the subtitle bitmap data is set to a default range when the color gamut identification information of the subtitle bitmap data is not available from the subtitle stream or the container that includes the video stream and the subtitle stream.

10. The reception device according to claim 6 , wherein the circuitry is configured to, when the pixel of the region of the video does not correspond to the high luminance portion or the mixing ratio of the video data does not exceed the threshold value,

superimpose, on the video with the pixel having the original luminance level, the luminance adjusted subtitle bitmap image.

11. A method of video processing, comprising:

receiving a video stream and a subtitle stream;

processing the video stream to obtain video data of a video;

processing the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image;

adjusting, by circuitry of a reception device, the subtitle bitmap data of the subtitle bitmap image to obtain an adjusted subtitle bitmap image based on one or a combination of a color gamut of the video data, a color gamut of the subtitle bitmap data, dynamic range information of the video data, and dynamic range information of the subtitle bitmap data;

when a pixel of a region of the video on which the adjusted subtitle bitmap image is to be superimposed corresponds to a high luminance portion and a mixing ratio of the video data exceeds a threshold value,

decreasing, by the circuitry of the reception device, an original luminance level of the pixel to become a decreased luminance level, and

superimposing, by the circuitry of the reception device, on the video with the pixel having the decreased luminance level, the adjusted subtitle bitmap image to obtain a superimposed video; and

outputting the superimposed video for display.

12. The method of video processing according to claim 11 , further comprising, when the pixel of the region of the video does not correspond to the high luminance portion or the mixing ratio of the video data does not exceed the threshold value,

superimposing, on the video with the pixel having the original luminance level, the adjusted subtitle bitmap image to obtain the superimposed video.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2023
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 062366/0447 →
CHANGE OF NAME Recorded Dec 16, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062149/0062 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2017
From: TSUKAGOSHI, IKUO
To: SONY CORPORATION
Reel/Frame 044392/0165 →
Continuity (1)
Related Publication 20180109850A1 · Apr 19, 2018