IP Library › Granted Patent US 12,355,831
Granted Patent B2
US 12,355,831 · App. 17/698,064 · Granted Jul 8, 2025

Techniques for signaling multiple audio mixing gains for teleconferencing and telepresence for remote terminals

Inventors: Rohit Abhishek (San Jose, CA); Iraj Sodagar (Los Angeles, CA)
Assignee: TENCENT AMERICA LLC
H04L65/65G10L21/034G10L25/57H04L65/75
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,355,831
App. No.
17/698,064
Granted
Jul 8, 2025
Kind
B2
Abstract

A method and device for signaling multiple audio mixing gains in a teleconference using a single Real-time Transport Protocol (RTP) header extension is provided. The method includes receiving an input audio stream from a 360-degree video/audio stream that includes multiple mixing gains from the input audio stream and overlay audio stream, declaring a single RTP header extension (including one or more of an element identifier, a length of an extension element, and a magnitude of the mixing gains) for all the mixing gains, and signaling the mixing gains using the single RTP header extension. The single RTP header extension may use a one-byte or two-byte header extension format which is declared using a Session Description Protocol (SDP).

Claims (33)

1. A method for signaling multiple audio mixing gains in a teleconference using a Real-time Transport Protocol (RTP) header extension, performed by at least one processor and comprising:

receiving mixing gain levels of different audio streams each from a same conference room, the mixing gain levels comprising a first mixing gain level, of a first audio stream of the different audio streams from the same conference room, and a second mixing gain level of a second audio stream of the different audio streams from the same conference room;

declaring a single RTP header extension comprising one or more of an element identifier, a length of an extension element, the first mixing gain level, and the second mixing gain level; and

signaling both the first mixing gain level and the second mixing gain level together in the single RTP header extension,

wherein the first mixing gain level is different than the second mixing gain level, and the single RTP header extension consists of any of a one-byte header extension and a two-byte header extension.

2. The method of claim 1 , wherein the single RTP header extension is declared in a Session Description Protocol (SDP) using a Uniform Resource Identifier (URI) to identify the single RTP header extension.

3. The method of claim 1 , wherein the single RTP header extension is only present in a first packet or a plurality of consecutive first packets of an audio stream.

4. The method of claim 1 , wherein the single RTP header extension is repeated based on a change in a mixing gain of the mixing gain levels.

5. The method of claim 1 , wherein the second mixing gain level is an overlay to the first mixing gain level.

6. The method of claim 5 , wherein the different audio streams are indicated in a single RTP session.

7. The method of claim 5 , wherein the single RTP header extension carries a gain of overlay audio streams as an extension element to the single RTP header extension, and

wherein an overlay identifier value is included in the element identifier of the extension element.

8. A device for signaling multiple audio mixing gains in a teleconference using a Real-time Transport Protocol (RTP) header extension, the device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

receiving code configured to cause the at least one processor to receive mixing gain levels of different audio streams each from a same conference room, the mixing gain levels comprising a first mixing gain level, of a first audio stream of the different audio streams from the same conference room, and a second mixing gain level of a second audio stream of the different audio streams from the same conference room;

declaring code configured to cause the at least one processor to declare a single RTP header extension comprising one or more of an element identifier, a length of an extension element, the first mixing gain level, and the second mixing gain level; and

signaling code configured to cause the at least one processor to signal both the first mixing gain level and the second mixing gain level the single RTP header extension,

wherein the first mixing gain level is different than the second mixing gain level, and the single RTP header extension consists of any of a one-byte header extension and a two-byte header extension.

9. The device of claim 8 , wherein the single RTP header extension is declared using a Session Description Protocol (SDP) using a Uniform Resource Identifier (URI) to identify the single RTP header extension.

10. The device of claim 8 , wherein the single RTP header extension is present in a first packet or a plurality of consecutive first packets of an audio stream, and

the single RTP header extension is repeated based on a change in a mixing gain of the mixing gain levels.

11. The device of claim 8 , wherein the second mixing gain level is an overlay to the first mixing gain level.

12. The device of claim 11 , wherein the single RTP header extension carries a gain of overlay audio streams as an extension element to the single RTP header extension, wherein an overlay identifier value is included in the element identifier of the extension element.

13. A non-transitory computer readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by at least one processor of a device for signaling multiple audio mixing gains in a teleconference using a Real-time Transport Protocol (RTP) header extension, cause the at least one processor to:

receive mixing gain levels of different audio streams each from a same conference room, the mixing gain levels comprising a first mixing gain level, of a first audio stream of the different audio streams from the same conference room, and a second mixing gain level of a second audio stream of the different audio streams from the same conference room;

declare a single RTP header extension comprising one or more of an element identifier, a length of an extension element, and the first mixing gain level, and the second mixing gain level; and

signal both the first mixing gain level and the second mixing gain level together in the single RTP header extension,

wherein the first mixing gain level is different than the second mixing gain level, and the single RTP header extension consists of either a one-byte header extension or a two-byte header extension.

14. The non-transitory computer readable medium of claim 13 , wherein the single RTP header extension is declared using a Session Description Protocol (SDP) using a Uniform Resource Identifier (URI) to identify the single RTP header extension.

15. The non-transitory computer readable medium of claim 13 , wherein the single RTP header extension is present in a first packet or a plurality of consecutive first packets of an audio stream, and

the single RTP header extension is repeated based on a change in a mixing gain of the mixing gain levels.

16. The non-transitory computer readable medium of claim 13 , wherein the single RTP header extension carries a gain of overlay audio streams as an extension element to the single RTP header extension, wherein an overlay identifier value is included in the element identifier of the extension element.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2022
From: ABHISHEK, ROHIT; SODAGAR, IRAJ
To: TENCENT AMERICA LLC
Reel/Frame 059303/0509 →
Continuity (2)
Provisional Application 63167236 · Mar 29, 2021
Related Publication 20220311814A1 · Sep 29, 2022
References Cited (22)
US 20060041431A1 · Maes · 2006 [cited by applicant]
US 20140092783A1 · Pulicherla · 2014 [cited by applicant]
US 20150098589A1 · Hetherington · 2015 [cited by examiner]
US 20160359803A1 · Kwon et al. · 2016 [cited by applicant]
US 20200329088A1 · Oyman · 2020 [cited by examiner]
US 20220021864A1 · Mate · 2022 [cited by examiner]
EP 2285106A2 · 2011 [cited by applicant]
EP 2285106A3 · 2011 [cited by applicant]
WO 2020102153A1 · 2020 [cited by applicant]
“ITT4RT Permanent Document—Requirements, Working Assumptions and Potential Solutions”, 3GPP TSG-SA4, Meeting #109e, S4-200840, Intel, Nokia Corporation (ITT4RT Co-Rapporteurs), May 20-Jun. 3, 2020, 44 pages. [cited by applicant]
“Information technology—Coded representation of immersive media—Part 2: Omnidirectional MediA Format (OMAF) 2nd Edition”, ISO 23090-2:2020(E) ISO TC 1/SC 29/WG 11, ISO/IEC JTC 1/SC 29/WG 3, N00072, online Dec. 2020, 385… [cited by applicant]
D. Singer et al., “A General Mechanism for RTP Header Extensions”, Internet Engineering Task Force (IETF) RFC 8285, Oct. 2017, 25 pages. [cited by applicant]
E. Ivov et al., “A Real-time Transport Protocol (RTP) Header Extension for Mixer-to-Client Audio Level Indication”, Internet Engineering Task Force (IETF) RFC 6465, Dec. 2011, pp. 1-9. [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority dated Jul. 19, 2022 in International Application No. PCT/US22/21681. [cited by applicant]
Communication dated Jun. 15, 2023 issued by the European Patent Office in application No. 22747566.2. [cited by applicant]
Tencent, “Signaling for Audio mixing gain”, 3GPP TSG-SA4 Meeting SA4#113-e, Apr. 6-14, 2021, S4-210534, 3 pages total. [cited by applicant]
Nokia Corporation (ITT4RT Rapporteur), “ITT4RT Permanent Document—Requirements, Working Assumptions and Potential Solutions”, 3GPP TSG-SA WG4 Meeting #114e, S4-210933, May 19-28, 2021, 85 pages total. [cited by applicant]
Leung, N., “MTSI SWG Report during SA4#112-e”, 3GPP TSG SA WG4#112-e meeting, Feb. 1-10, 2020, Tdoc S4-210175, 37 pages total. [cited by applicant]
Intel, Nokia Corporation (ITT4RT Co-Rapporteurs), “ITT4RT Permanent Document—Requirements, Working Assumptions and Potential Solutions”, 3GPP TSG-SA4, Meeting #112e, S4-210200, Feb. 1-10, 2021, 81 pages total. [cited by applicant]
Intel, Nokia Corporation (ITT4RT Co-Rapporteurs), Intel, Nokia Corporation (ITT4RT Co-Rapporteurs), “ITT4RT Permanent Document—Requirements, Working Assumptions and Potential Solutions”, 3GPP TSG-SA4, Meeting #112e, S4-… [cited by applicant]
Handley, et al., “SDP: Session Description Protocol”, Network Working Group, Request for Comments: 4566, Obsoletes: 2327, 3266, Category: Standards Track; University of Glasgow, Jul. 2006, 49 pages total. [cited by applicant]
Schulzrinne, et al., “RTP: A Transport Protocol for Real-Time Applications”, Network Working Group, Request for Comments: 3550, Obsoletes: 1889, Category: Standards Track; Blue Coat Systems Inc., Jul. 2003, 104 pages to… [cited by applicant]