IP Library › Granted Patent US 10,515,667
Granted Patent B2
US 10,515,667 · App. 14/904,959 · Granted Dec 24, 2019

HDR metadata transport

Inventors: Wiebe De Haan (Eindhoven, NL); Charles Leonardus Cornelius Maria Knibbeler (Eindhoven, NL)
Assignee: Koninklijke Philips N.V.
G11B27/105G11B20/10G11B27/329H04N9/646H04N9/87H04N11/24H04N21/2358H04N21/234327H04N21/42646H04N21/440227H04N21/631
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,515,667
App. No.
14/904,959
Granted
Dec 24, 2019
Kind
B2
Abstract

A video distribution system transfers a formatted video signal ( 20 ) having elementary streams representing audiovisual content to be rendered in a selected combination and stream information indicative of selectable elementary streams. The formatted video signal represents extended video having an extended range (HDR) of brightness and/or color. A video device ( 21 ) processes input video to provide video processing metadata representing a conversion between standard video and the extended video. The formatted video signal comprises a primary video elementary stream representing standard or extended video, a video processing elementary stream not comprising audiovisual content but comprising video processing metadata representing a conversion between standard and extended video or vice versa, and extended stream information comprising an entry indicative of the video processing elementary stream. Advantageously a video player ( 22 ), for example a BD player, is enabled to render both extended and standard video based on the extended stream information and the video processing elementary stream.

Claims (71)

1. A method of providing a formatted video signal for transfer according to a standardized transfer format, the standardized transfer format defining stream information having entries indicative of selectable elementary streams and elementary streams having a common structure according to the standardized transfer format and representing audiovisual content to be rendered in a selected combination of the elementary streams, a respective elementary stream representing one of video content, audio content, graphics content;

the formatted video signal representing extended video having an extended range of brightness and/or color with respect to standard video having a standard range of brightness and/or color, the standard range being as defined in the standardized transfer format;

the method comprising:

processing input video to provide video processing metadata representing a conversion between the standard video and the extended video and generating a primary video elementary stream representing the standard video, or

processing input video to provide video processing metadata representing a conversion between the extended video and the standard video and generating a primary video elementary stream representing the extended video;

generating a video processing elementary stream having the common structure but not comprising audiovisual content, the video processing elementary stream comprising the video processing metadata for converting in rendering the selected combination, wherein the video processing metadata in the video processing elementary stream comprises an extended range info field comprising multiple different process descriptors, a respective process descriptor defining the conversion for a respective data type, the data types comprising video and at least one of graphics and subtitles,

generating extended stream information comprising at least an entry indicative of the primary video elementary stream and an entry indicative of the video processing elementary stream, and

generating the formatted video signal comprising the primary video elementary stream, the video processing elementary stream and the extended stream information.

2. Method as claimed in claim 1 , wherein the method comprises applying, for said conversion, a transformation that is reversible by applying inverse mapping to the video in the primary video elementary stream, and

the video processing metadata in the video processing elementary stream comprises information on the mapping.

3. Method as claimed in claim 1 , wherein the formatted video signal has a first transport stream and a second transport stream, and the method comprises

including, in the first transport stream, the primary video elementary stream,

including, in the second transport stream, the video processing elementary stream.

4. Method as claimed in claim 3 , wherein the method comprises

transferring the first transport stream via a medium, and

transferring the second transport stream and the extended stream information via a network.

5. A video processing device for providing a formatted video signal for transfer according to a standardized transfer format, the standardized transfer format defining stream information having entries indicative of selectable elementary streams and elementary streams having a common structure according to the standardized transfer format and representing audiovisual content to be rendered in a selected combination of the elementary streams, a respective elementary stream representing one of video content, audio content, graphics content;

the formatted video signal representing extended video having an extended range for brightness and/or color with respect to standard video content having a standard range, the standard range being as defined in the standardized transfer format;

the processing device comprising:

a video processing unit for processing input video, and

a formatting unit for generating the formatted video signal;

the video processing unit and the formatting unit being arranged for

processing input video to provide video processing metadata representing a conversion between the standard video and the extended video and generating a primary video elementary stream representing the standard video, or

processing input video to provide video processing metadata representing a conversion between the extended video and the standard video and generating a primary video elementary stream representing the extended video;

and the formatting unit being further arranged for

generating a video processing elementary stream having the common structure but not comprising audiovisual content, the video processing elementary stream comprising the video processing metadata for converting in rendering the selected combination, wherein the video processing metadata in the video processing elementary stream comprises an extended range info field comprising multiple different process descriptors, a respective process descriptor defining the conversion for a respective data type, the data types comprising video and at least one of graphics and subtitles,

generating extended stream information comprising at least an entry indicative of the primary video elementary stream and an entry indicative of the video processing elementary stream, and

generating the formatted video signal comprising the primary video elementary stream, the video processing elementary stream and the extended stream information.

6. A video player for processing a formatted video signal according to a standardized transfer format, the standardized transfer format defining stream information having entries indicative of selectable elementary streams and elementary streams having a common structure according to the standardized transfer format and representing audiovisual content to be rendered in a selected combination of the elementary streams, a respective elementary stream representing one of video content, audio content, graphics content;

the formatted video signal representing extended video having an extended range for brightness and/or color with respect to standard video content having a standard range, the standard range being as defined in the standardized transfer format;

the formatted video signal comprising

a video processing elementary stream having the common structure but not comprising audiovisual content, the video processing elementary stream comprising video processing metadata for converting in rendering the selected combination,

a primary video elementary stream representing the standard video and the video processing metadata representing a conversion between the standard video and the extended video, or

a primary video elementary stream representing the extended video and the video processing metadata representing a conversion between the extended video and the standard video;

and the formatted video signal further comprising

extended stream information comprising at least an entry indicative of the primary video elementary stream and an entry indicative of the video processing elementary stream; and wherein the video processing metadata in the video processing elementary stream comprises an extended range info field comprising multiple different process descriptors, a respective process descriptor defining the conversion for a respective data type, the data types comprising video and at least one of graphics and subtitles;

the player comprising

an input unit for receiving the formatted video signal and extracting the extended stream information and the video processing metadata, and a processing unit for

processing the extended stream information, and, in dependence on the extended stream information entry indicating a video processing elementary stream,

converting primary video from the primary video elementary stream into target video adapted to brightness and/or color rendering capabilities of a target display device by processing the primary video according to the video processing metadata, while using the respective process descriptors for the conversion of respective data types, the data types comprising video and at least one of graphics and subtitles.

7. The video player as claimed in claim 6 , wherein

the formatted video signal comprises a transport stream including the primary video elementary stream and the video processing elementary stream, and

the input unit is arranged for receiving the transport stream and retrieving, from the transport stream, the primary video elementary stream and the video processing elementary stream; or

the formatted video signal comprises a first transport stream including the primary video elementary stream and a second transport stream including the video processing elementary stream, and

the input unit is arranged for receiving the first and second transport stream and retrieving,

from the first transport stream, the primary video elementary stream and

from the second transport stream, the video processing elementary stream.

8. The video player as claimed in claim 7 , wherein

the input unit comprises an optical disc unit for reading an optical record carrier and retrieving the transport stream; or

the first transport stream; or

the first transport stream and the second transport stream.

9. The video player as claimed in claim 6 , wherein

the input unit comprises a network interface for downloading the video processing elementary stream and the extended stream information from a server to local storage, and

the processing unit is arranged for replacing stream information received earlier by the extended stream information.

10. The video player as claimed in claim 6 , wherein

said conversion is a transformation that is reversible by applying inverse mapping to the video in the primary video elementary stream and the video processing metadata in the video processing elementary stream comprises information on the mapping, and

the processing unit is arranged for said converting by applying the mapping according to the video processing metadata.

11. A formatted video signal for transfer according to a standardized transfer format, the standardized transfer format defining stream information having entries indicative of selectable elementary streams and elementary streams having a common structure according to the standardized transfer format and representing audiovisual content to be rendered in a selected combination of the elementary streams, a respective elementary stream representing one of video content, audio content, graphics content; the formatted video signal representing extended video having an extended range for brightness and/or color with respect to standard video content having a standard range, the standard range being as defined in the standardized transfer format; the formatted video signal comprising: a video processing elementary stream having the common structure but not comprising audiovisual content, the video processing elementary stream comprising video processing metadata for converting in rendering the selected combination, wherein the video processing metadata in the video processing elementary stream comprises an extended range info field comprising multiple different process descriptors, a respective process descriptor defining the conversion for a respective data type, the data types comprising video and at least one of graphics and subtitles a primary video elementary stream representing the standard video and the video processing metadata representing a conversion between the standard video and the extended video, or a primary video elementary stream representing the extended video and the video processing metadata representing a conversion between the extended video and the standard video; and the formatted video signal further comprising: extended stream information comprising at least an entry indicative of the primary video elementary stream and an entry indicative of the video processing elementary stream.

12. The formatted video signal as claimed in claim 11 , wherein

the formatted video signal comprises a transport stream including the primary video elementary stream and the video processing elementary stream, or

said conversion is a transformation that is reversible by applying inverse mapping to the video in the primary video elementary stream and the video processing metadata in the video processing elementary stream comprises information on the mapping.

13. The formatted video signal as claimed in claim 12 , wherein the formatted video signal is a broadcast signal, and the transport stream comprises the extended stream information in the form of program specific information.

14. The formatted video signal as claimed in claim 11 , wherein the formatted video signal comprises

a first transport stream including the primary video elementary stream, and

a second transport stream including the video processing elementary stream, or—a file having network data specifying for a player where to download the video processing elementary stream.

15. A tangible computer-readable storage medium that is not a transitory propagating signal or wave, the storage medium storing stream information of a formatted video signal for transfer according to a standardized transfer format, the stream information having entries indicative of selectable elementary streams and elementary streams having a common structure according to a standardized transfer format and representing audiovisual content to be rendered in a selected combination of the elementary streams, a respective elementary stream representing one of video content, audio content, graphics content, the formatted video signal representing extended video having an extended range for brightness and/or color with respect to standard video content having a standard range, the standard range being as defined in the standardized transfer format; the formatted video signal comprising: a video processing elementary stream having the common structure but not comprising audiovisual content, the video processing elementary stream comprising video processing metadata for converting in rendering the selected combination, a primary video elementary stream representing the standard video and the video processing metadata representing a conversion between the standard video and the extended video, or a primary video elementary stream representing the extended video and the video processing metadata representing a conversion between the extended video and the standard video; and the formatted video signal further comprising: extended stream information comprising at least an entry indicative of the primary video elementary stream and an entry indicative of the video processing elementary stream wherein the video processing metadata in the video processing elementary stream comprises an extended range info field comprising multiple different process descriptors, a respective process descriptor defining the conversion for a respective data type, the data types comprising video and at least one of graphics and subtitles, wherein the formatted video signal comprises a first transport stream including the primary video elementary stream, and a second transport stream including the video processing elementary stream or a file having network data specifying for a player where to download the video processing elementary stream, the storage medium comprising a track of optical readable marks, wherein the marks represent the extended stream information and the first transport stream including the primary video elementary stream and the video processing elementary stream.

16. The tangible computer-readable storage medium as claimed in claim 15 , wherein the video processing elementary stream comprises: a sequence of video processing segments, a respective segment being associated with a corresponding sequence of video frames, and/or instructions to adapt brightness level and/or color space of the video in dependence of brightness or color rendering capabilities of a display device, and/or instructions to adapt brightness level and/or color space of graphics in dependence of brightness or color rendering capabilities of a display device.

17. A tangible computer-readable storage medium that is not a transitory propagating signal or wave, the storage medium storing stream information of a formatted video signal for transfer according to a standardized transfer format, the stream information having entries indicative of selectable elementary streams and elementary streams having a common structure according to a standardized transfer format and representing audiovisual content to be rendered in a selected combination of the elementary streams, a respective elementary stream representing one of video content, audio content, graphics content, the formatted video signal representing extended video having an extended range for brightness and/or color with respect to standard video content having a standard range, the standard range being as defined in the standardized transfer format; the formatted video signal having a first transport stream and a second transport stream, the formatted video signal comprising: a video processing elementary stream having the common structure but not comprising audiovisual content, the video processing elementary stream comprising video processing metadata for converting in rendering the selected combination, a primary video elementary stream representing the standard video and the video processing metadata representing a conversion between the standard video and the extended video, or a primary video elementary stream representing the extended video and the video processing metadata representing a conversion between the extended video and the standard video; and the formatted video signal further comprising: extended stream information comprising at least an entry indicative of the primary video elementary stream and an entry indicative of the video processing elementary stream wherein the video processing metadata in the video processing elementary stream comprises an extended range info field comprising multiple different process descriptors, a respective process descriptor defining the conversion for a respective data type, the data types comprising video and at least one of graphics and subtitles, wherein the formatted video signal comprises a first transport stream including the primary video elementary stream, and a second transport stream including the video processing elementary stream or a file having network data specifying for a player where to download the video processing elementary stream, the storage medium comprising a track of optical readable marks, wherein the marks represent the extended stream information and the first transport stream including the primary video elementary stream and the second transport stream including the video processing elementary stream.

18. The tangible computer-readable storage medium as claimed in claim 17 , wherein the video processing elementary stream comprises: a sequence of video processing segments, a respective segment being associated with a corresponding sequence of video frames, and/or instructions to adapt brightness level and/or color space of the video in dependence of brightness or color rendering capabilities of a display device, and/or instructions to adapt brightness level and/or color space of graphics in dependence of brightness or color rendering capabilities of a display device.

19. A tangible computer-readable storage medium that is not a transitory propagating signal or wave, the storage medium storing stream information of a formatted video signal for transfer according to a standardized transfer format, the stream information having entries indicative of selectable elementary streams and elementary streams having a common structure according to a standardized transfer format and representing audiovisual content to be rendered in a selected combination of the elementary streams, a respective elementary stream representing one of video content, audio content, graphics content, the formatted video signal representing extended video having an extended range for brightness and/or color with respect to standard video content having a standard range, the standard range being as defined in the standardized transfer format; the formatted video signal having a first transport stream and a second transport stream, the formatted video signal comprising: a video processing elementary stream having the common structure but not comprising audiovisual content, the video processing elementary stream comprising video processing metadata for converting in rendering the selected combination, a primary video elementary stream representing the standard video and the video processing metadata representing a conversion between the standard video and the extended video, or a primary video elementary stream representing the extended video and the video processing metadata representing a conversion between the extended video and the standard video; and the formatted video signal further comprising: extended stream information comprising at least an entry indicative of the primary video elementary stream and an entry indicative of the video processing elementary stream wherein the video processing metadata in the video processing elementary stream comprises an extended range info field comprising multiple different process descriptors, a respective process descriptor defining the conversion for a respective data type, the data types comprising video and at least one of graphics and subtitles, wherein the formatted video signal comprises a first transport stream including the primary video elementary stream, and a second transport stream including the video processing elementary stream or a file having network data specifying for a player where to download the video processing elementary stream, the storage medium comprising a track of optical readable marks, wherein the marks represent the extended stream information, the first transport stream but not the second transport stream.

20. The tangible computer-readable storage medium as claimed in claim 19 , wherein the video processing elementary stream comprises: a sequence of video processing segments, a respective segment being associated with a corresponding sequence of video frames, and/or instructions to adapt brightness level and/or color space of the video in dependence of brightness or color rendering capabilities of a display device, and/or instructions to adapt brightness level and/or color space of graphics in dependence of brightness or color rendering capabilities of a display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2016
From: DE HAAN, WIEBE; KNIBBELER, CHARLES LEONARDUS CORNELIUS MARIA
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 037485/0499 →
Priority Claims (1)
EP 13177150 · Jul 19, 2013 · regional
Continuity (1)
Related Publication 20160163356A1 · Jun 9, 2016
Cited By (1)
US 12,394,444