Method and device for providing audio/video content to a rendering device

1. A method ( 500 ) for providing combined audio and video content from a source device ( 210 ) to an audio sink device ( 230 ) and to a video sink device ( 220 ); wherein the method ( 500 ) comprises,

determining ( 501 ) latency information regarding

a video latency for processing the video content of the combined audio and video content along a video device chain ( 100 ) between the source device ( 210 ) and the video sink device ( 220 );

an audio latency for processing the audio content of the combined audio and video content along an audio device chain ( 100 ) between the source device ( 210 ) and the audio sink device ( 230 ); and

a latency difference between the video latency and the audio latency; and

delaying ( 502 ) the audio content or the video content in dependence of the latency information; and

providing ( 503 ) the combined audio and video content with the delayed audio content or the delayed video content.

2. The method ( 500 ) of claim 1 , wherein

the combined audio and video content is transmitted from the source device ( 210 ) to one or more of the audio sink device ( 230 ) and the video sink device ( 220 ) using a transmission interface ( 111 , 112 ); and

the latency information is determined using messages ( 241 , 242 ) which are exchanged between the source device ( 210 ) and at least one of the audio sink device ( 230 ) and the video sink device ( 220 ) using the transmission interface ( 111 , 112 ).

3. The method ( 500 ) of claim 2 , wherein

the transmission interface ( 111 , 112 ) comprises a High Definition Multimedia Interface, referred to as HDMI; and

the messages ( 241 , 242 ) for determining the latency information are transmitted using a Consumer Electronics Control, referred to as CEC, communication channel of HDMI.

4. The method ( 500 ) of claim 1 , wherein the method ( 500 ) comprises

determining whether one or more of the audio sink device ( 230 ) and the video sink device ( 220 ) support providing latency information from the audio sink device ( 230 ) or the video sink device ( 220 ) to the source device ( 210 ); and

using default latency information, if it is determined that at least one of the audio sink device ( 230 ) and the video sink device ( 220 ) does not support providing latency information from the audio sink device ( 230 ) or the video sink device ( 220 ) to the source device ( 210 ); or

using latency information provided by the audio sink device ( 230 ) or the video sink device ( 220 ), if it is determined that at least one of the audio sink device ( 230 ) and the video sink device ( 220 ) supports providing latency information from the audio sink device ( 230 ) or the video sink device ( 220 ) to the source device ( 210 ).

5. The method ( 500 ) of claim 1 , wherein

the audio content of the combined audio and video content is provided to the audio sink device ( 230 ) via an intermediate device; and

the method ( 500 ) comprises providing latency information to the source device ( 210 ) which is indicative of or which takes into account a cumulated latency incurred by processing of the audio content in the intermediate device and by processing of the audio content in the audio sink device ( 230 ).

6. The method ( 500 ) of claim 5 , wherein

the video content of the combined audio and video content is provided to the video sink device ( 220 ) via an intermediate device; and

the method ( 500 ) comprises providing latency information to the source device ( 210 ) which is indicative of or which takes into account a cumulated latency incurred by processing of the video content in the intermediate device and by processing of the video content in the video sink device ( 220 ).

7. The method ( 500 ) of claim 5 , wherein the method ( 500 ) comprises adding the latency incurred by processing one or more of the audio content and the video content in the intermediate device to the latency incurred by processing of the audio content in the audio sink device ( 230 ) or by processing of the video content in the video sink device ( 220 ), respectively, to determine the cumulated latency.

8. The method ( 500 ) of claim 1 , wherein the method ( 500 ) comprises

sending a <request latency information> message from an upstream device of at least one of the audio device chain ( 100 ) and the video device chain ( 100 ) to a downstream device of the audio device chain ( 100 ) or the video device chain ( 100 ), respectively; wherein the <request latency information> message is directed at requesting latency information from the downstream device; and

receiving a <report latency information> message at the upstream device from the downstream device; wherein the <report latency information> message comprises latency information regarding a subset of at least one of the audio device chain ( 100 ) and the video device chain ( 100 ) from the downstream device to one or more of the audio sink device ( 230 ) and the video sink device ( 220 ).

9. The method ( 500 ) of claim 8 , wherein the <request latency information> message is directed at requesting

latency information regarding the audio latency only;

latency information regarding the video latency only; or

latency information regarding the audio latency and the video latency.

10. The method ( 500 ) of claim 8 , wherein the <request latency information> message is indicative of one or more of

an audio rendering mode which is to be used by the audio sink device ( 230 ) for rendering the audio content; and

a video rendering mode which is to be used by the video sink device ( 220 ) for rendering the video content.

11. The method ( 500 ) of claim 1 , wherein the method ( 500 ) comprises

sending a <request protocol support> message from an upstream device of at least one of the audio device chain ( 100 ) and the video device chain ( 100 ) to a downstream device of the audio device chain ( 100 ) or the video device chain ( 100 ), respectively; wherein the <request protocol support > message is directed at receiving information from the downstream device on whether the downstream device supports providing latency information from one or more of the audio sink device ( 230 ) and the video sink device ( 220 ) to the source device ( 210 ); and

receiving a <report protocol support > message at the upstream device from the downstream device; wherein the <report protocol support > message comprises an indication that the downstream device supports providing latency information from the audio sink device ( 230 ) or the video sink device ( 220 ) to the source device ( 210 ).

12. The method ( 500 ) of claim 11 , wherein the <report protocol support > message comprises one or more of

latency information regarding a subset of one or more of the audio device chain ( 100 ) and the video device chain ( 100 ) from the downstream device to one or more of the audio sink device ( 230 ) and the video sink device ( 220 ), respectively; and

an identifier for the subset of one or more of the audio device chain ( 100 ) and the video device chain ( 100 ) from the downstream device to one or more of the audio sink device ( 230 ) and the video sink device ( 220 ), respectively; and

an indication of an audio rendering mode which is used by the audio sink device ( 230 ); and

an indication of a video rendering mode which is used by the video sink device ( 220 ).

13. The method ( 500 ) of claim 1 , wherein the method ( 500 ) comprises

determining an identifier for one or more of the audio device chain ( 100 ) and the video device chain ( 100 ) from the source device ( 210 ) to one or more of the audio sink device ( 230 ) and the video sink device ( 220 ), respectively; or

determining an identifier for a partial device chain ( 100 ) from an intermediate device of one or more of the audio device chain ( 100 ) and the video device chain ( 100 ) to one or more of the audio sink device ( 230 ) and the video sink device ( 220 ), respectively; and

verifying whether the identifier is part of a list of known identifiers; and

determining the latency information from a storage unit ( 215 ) based on the identifier, if the identifier is part of the list of known identifiers for which the latency information is stored on the storage unit ( 215 ); or

saving the determined latency information in association with the identifier and including the identifier into the list of known identifiers, if the identifier is not part of the list of known identifiers.

14. The method ( 500 ) of claim 13 , wherein

each device within one or more of the audio device chain ( 100 ) and the video device chain ( 100 ) exhibits an address; and

the identifier for one or more of the audio device chain ( 100 ) and the video device chain ( 100 ) or for the partial device chain ( 100 ) is dependent on the address of all devices within the respective device chain ( 100 ) that process one or more of the audio content and the video content.

15. The method ( 500 ) of claim 1 , wherein the method ( 500 ) comprises

providing an AV rendering mode which is indicative of one or more of an audio format of the audio content and a video format of the video content; and

determining the latency information in dependence of the AV rendering mode.

16. The method ( 500 ) of claim 15 referring back to any of claims 13 to 14 ; wherein the identifier is dependent on the AV rendering mode.

17. The method ( 500 ) of claim 1 , wherein

the audio sink device ( 230 ) comprises one or more of an audio receiver and a soundbar; and/or

the video sink device ( 220 ) comprises a TV set; or

the source device ( 210 ) comprises one or more of a TV set, a settop-box, a video recorder, a disk player and a game console.

18. The method ( 500 ) of claim 1 , wherein the audio content or the video content is delayed according to one or more of the following

in dependence of or exactly by the difference of the audio latency and the video latency; or

such that an extent of buffering, which is required for a synchronous rendering of the audio content at the audio sink device ( 230 ) and of the video content at the video sink device ( 220 ) is reduced or completely cancelled; or

such that the audio content is delayed with respect to the video content, if the video latency is higher than the audio latency; or

such that the video content is delayed with respect to the audio content, if the audio latency is higher than the video latency.

19. The method ( 500 ) of claim 1 , wherein the method ( 500 ) comprises,

determining that there is one or more of an audio element and a video element that do not need to be synchronized with the combined AV content or that should be rendered immediately; and

mixing one or more of the audio element and the video element with the combined AV content without delaying the audio element or the video element, respectively, in dependence of the determined latency information.

20. A source device ( 210 ) configured to provide combined audio and video content to an audio sink device ( 230 ) and to a video sink device ( 220 ); wherein the source device ( 210 ) is configured to

determine latency information regarding one or more of

a video latency for processing the video content of the combined audio and video content along a video device chain ( 100 ) between the source device ( 210 ) and the video sink device ( 220 ); and

an audio latency for processing the audio content of the combined audio and video content along an audio device chain ( 100 ) between the source device ( 210 ) and the audio sink device ( 230 ); and

a latency difference between the video latency and the audio latency; and

delay the audio content or the video content in dependence of the latency information; and

provide the combined audio and video content with the delayed audio content or the delayed video content.