Granted Patent B2

US 12,206,737 · App. 17/354,657 · Granted Jan 21, 2025

Inventors: Tian Xia (Shanghai, CN); Liu Yong (Shanghai, CN)

Assignee: Agora Lab, Inc.

H04L67/141H04L7/0079H04L7/0091H04L67/146H04L67/60

Abstract

Claims (40)

1. An apparatus for communication between a receiving application executing at the apparatus and a sending application of a sending apparatus, comprising:

a processor configured to:

establish a stream for transmitting data between the sending application and the receiving application;

transmit a first request to the sending application to transmit metadata to the receiving application, wherein the metadata are associated with the stream and are descriptive of an application data transmitted over the stream;

transmit a second request to the sending application to transmit the application data to the receiving application;

receive a first frame from the sending application, wherein the first frame is generated, by the sending application, to include the application data and the metadata based on a determination that the metadata and the application data do not exceed a maximum frame size, and the metadata is included in a second frame based on a determination that that the metadata and the application data exceed the maximum frame size; and

process the application data from the first frame in response to a determination that the metadata has been received and processed, wherein the application data from the first frame is not processed until the metadata associated with the stream is received, wherein the application data is cached by the receiving application until the metadata associated with the stream is received and processed.

2. The apparatus of claim 1 , wherein the first frame and the second frame are received using an unreliable transport protocol.

3. The apparatus of claim 1 , wherein the processor is further configured to:

receive, from the sending application, a metadata frame after a threshold time since receiving the first frame, wherein the metadata frame is received in response to a determination that the metadata of the is lost during transmission.

4. The apparatus of claim 1 , wherein the processor is further configured to:

receive, from the sending application, a metadata frame the includes the metadata, wherein the metadata frame is received responsive to a determination, by the sending application, that no acknowledgment of the metadata has been received from the receiving application and a time difference between a current time and a time of transmission of the first frame not exceeds a threshold time.

5. The apparatus of claim 1 , wherein the sending application retransmits the metadata up to a threshold number of times, responsive to a determination that no acknowledgment of the metadata has been received from the receiving application.

6. The apparatus of claim 5 , wherein the stream is closed by the sending application responsive to a determination that no acknowledgment of the metadata has been received after the threshold number of retransmissions.

7. A method for communication between a receiving application executing at a receiving apparatus and a sending application of a sending apparatus, comprising:

establishing a stream for transmitting data between the sending application and the receiving application, wherein the stream is used to transmit media data;

transmitting, to a session manager module of the sending apparatus, a first request to transmit metadata to the receiving application, wherein the metadata are associated with the stream and are descriptive of data transmitted over the stream;

transmitting, to the session manager module, a second request to transmit application data to the receiving application;

receiving, at the receiving application, a frame from a connection management module of the sending application, wherein the frame is generated, by the sending application, to include the application data and the metadata based on a determination that the metadata and the application data do not exceed a maximum frame size; and

processing, by the receiving application, the application data in response to a determination that the metadata has been received and processed, wherein the application data from the frame is not processed until the metadata associated with the stream is received, wherein the application data is cached by the receiving application until the metadata associated with the stream is received and processed.

8. The method of claim 7 , wherein a second frame includes the metadata based on a determination that the application data and the metadata are of such respective sizes that the application data and the metadata exceed a maximum frame size.

9. The method of claim 7 , wherein the frame is received using an unreliable transport protocol.

10. The method of claim 7 , further comprising:

receiving, from the connection management module, metadata frame that includes the metadata, wherein the metadata frame is received responsive to a determination, by the connection management module, that no acknowledgement of the metadata has been received from the receiving application within a threshold time since transmitting the frame.

11. The method of claim 7 , further comprising:

receiving, from the connection management module, a metadata frame that includes the metadata, responsive to a determination, by the connection management module, that no acknowledgment of the metadata has been received from the receiving application and a time difference between a current time and a time of transmission of the frame exceeds a threshold time.

12. The method of claim 7 , wherein the connection management module retransmits the metadata up to a threshold number of times, responsive to receiving no acknowledgment of the metadata from the receiving application.

13. The method of claim 12 , wherein the connection management module closes the stream responsive to a determination that no acknowledgment of the metadata has been received, from the receiving application, after the threshold number of retransmissions.

14. A non-transitory computer-readable storage medium that includes executable instructions that, when executed by a processor, perform operations of a transport framework for communication between a sending application of a sending apparatus and a receiving application of a receiving apparatus, the operations comprising:

establishing, through a session manager module of the transport framework, a stream for transmitting data between the sending application and the receiving application;

transmitting to the session manager module a first request to transmit metadata to the receiving application, wherein the metadata are associated with the stream and are descriptive of data transmitted over the stream;

transmitting to the session manager module a second request to transmit application data to the receiving application;

receiving a first frame from a connection management module of the transport framework, wherein the first frame is generated, by the sending application, to include the application data and the metadata based on a determination that the metadata and the application data do not exceed a maximum frame size, and the metadata is included in a second frame based on a determination that that the metadata and the application data exceed the maximum frame size; and

processing the application data in response to a determination, by the receiving application, that the metadata has been received and processed, wherein the application data from the first frame is not processed until the metadata associated with the stream is received, wherein the application data is cached by the receiving application until the metadata associated with the stream is received and processed.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the first frame and the second frame are received using an unreliable transport protocol.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the operations further comprise:

receiving, from the connection management module, a metadata frame the includes the metadata, wherein the metadata frame is transmitted responsive to a determination, by the connection management module, that no acknowledgement of the metadata has been received from the receiving application with a threshold time since transmitting the first frame.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the operations further comprise:

receiving, from the connection management module, a metadata frame that includes the metadata, responsive to a determination, by the connection management module, that no acknowledgment of the metadata has been received from the receiving application and a time difference between a current time and a time of transmission of the first frame is not exceeding a threshold time.

18. The non-transitory computer-readable storage medium of claim 14 , wherein the stream is closed, by the connection management module, responsive to receiving no acknowledgment of the metadata from the receiving apparatus after retransmitting the metadata to the receiving application a threshold number of times.

Assignments (1)

Continuity (2)

References Cited (62)