IP Library Granted Patent US 12713210
Granted Patent B2
US 12713210 · App. 18/657,986 · Granted Aug 18, 2026

Method and apparatus for transmitting multimedia resource, electronic device, and storage medium

Inventors: Zheng Xue (Shenzhen, CN); Yu Zhou (Shenzhen, CN); Siyu Tang (Shenzhen, CN); Zehui Guo (Shenzhen, CN); Xiaoping Huang (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
H04W4/08H04W4/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12713210
App. No.
18/657,986
Filed
May 8, 2024
Granted
Aug 18, 2026
Kind
B2
Art Unit
2631
USPC
455/414.1
Abstract

A multimedia resource transmission method includes determining, by a first device in response to that a role of the first device during a voice call is changed to a presenter, a second device from at least one terminal device participating in a same voice call as the first device. The presenter is a device configured to output multimedia during the voice call. The method further includes creating, by the first device, a direct link between the first device and the second device, transmitting, by the first device, a multimedia resource to the second device through the direct link, and transmitting, by the first device, the multimedia resource to a server, to enable the server to forward the multimedia resource to the second device.

Claims (87)

1 . A multimedia resource transmission method comprising:

determining, by a first device in response to that a role of the first device during a voice call is changed to a presenter, a second device from at least one terminal device participating in a same voice call as the first device, the presenter being a device configured to output multimedia during the voice call;

creating, by the first device, a direct link between the first device and the second device;

transmitting, by the first device, a multimedia resource to the second device through the direct link; and

transmitting, by the first device, the multimedia resource to a server, to enable the server to forward the multimedia resource to the second device.

2 . The method according to claim 1 , further comprising, before determining the second device:

obtaining, by the first device in response to that a device state of the first device is changed to an audio resource collection state, an audio resource collected by the first device; and

determining, by the first device in response to that object audio is detected in the collected audio resource, that the role of the first device during the voice call is changed to the presenter.

3 . The method according to claim 1 , further comprising, before determining the second device:

determining, by the first device in response to that a device state of the first device is changed to a video resource collection state, that the role of the first device during the voice call is changed to the presenter.

4 . The method according to claim 1 , wherein creating the direct link between the first device and the second device includes:

transmitting, by the first device, a direct connection request with respect to the second device to the server, the direct connection request carrying an external network address of the first device;

receiving, by the first device, a direct connection response forwarded by the server, the direct connection response being response information transmitted by the second device to the server in response to the direct connection request forwarded by the server to the second device, the direct connection response carrying an external network address of the second device;

extracting, by the first device, the external network address of the second device from the direct connection response; and

creating, by the first device, the direct link between the first device and the second device based on the external network address of the first device and the external network address of the second device.

5 . The method according to claim 4 , wherein creating the direct link between the first device and the second device based on the external network address of the first device and the external network address of the second device includes:

transmitting, by the first device, a plurality of direct connection packets to the second device based on the external network address of the second device; and

determining, by the first device in response to receiving a reception response transmitted by the second device, that the direct link between the first device and the second device has been established, the reception response being response information fed back by the second device for the direct connection packets based on the external network address of the first device.

6 . The method according to claim 1 , wherein:

the multimedia resource includes an audio resource;

the server forwards the audio resource to the second device in response to that a forwarding condition is satisfied, the forwarding condition being that a relay packet utilization of the second device is greater than a utilization threshold, the relay packet utilization of the second device being a ratio of a quantity of packets that are forwarded by the server and that are used by the second device over a total quantity of packets used by the second device; and

the server stops forwarding the audio resource to the second device in response to that the forwarding condition is not satisfied.

7 . The method according to claim 1 , wherein:

the multimedia resource includes an audio resource and a video resource; and

transmitting the multimedia resource to the second device through the direct link includes:

transmitting, by the first device, the audio resource to the second device through the direct link;

determining, by the first device, a video bitrate of the video resource; and

transmitting, by the first device, the video resource to the second device through the direct link in response to that an available uplink bandwidth of the first device is not less than a product of the video bitrate of the video resource and a reference quantity.

8 . The method according to claim 1 , wherein:

the multimedia resource includes an audio resource and a video resource;

transmitting the multimedia resource to the second device through the direct link includes:

transmitting, by the first device, the audio resource to the second device through the direct link;

determining, by the first device, a video bitrate of the video resource; and

transmitting, by the first device, the video resource of the first device to the second device through the direct link in response to that an available uplink bandwidth of the first device is less than a product of the video bitrate of the video resource of the first device and a reference quantity, and the second device satisfies a transmission condition; and

transmitting, by the first device, the multimedia resource to the server includes:

transmitting, by the first device, the audio resource to the server, to enable the server to forward the audio resource to the second device; and

transmitting, by the first device, the video resource to the server to enable the server to forward the video resource to the second device, in response to that the available uplink bandwidth of the first device is less than the product of the video bitrate of the video resource and the reference quantity, and the second device does not satisfy the transmission condition.

9 . The method according to claim 8 , wherein the second device satisfying the transmission condition includes:

a direct connection packet utilization of the second device is not less than a utilization threshold, the direct connection packet utilization of the second device being a ratio of a quantity of packets that are transmitted through the direct link and that are used by the second device over a total quantity of packets used by the second device.

10 . The method according to claim 1 , further comprising, after creating the direct link:

transmitting, by the first device, a direct connection deactivation request to the second device through the direct link in response to that the role of the first device during the voice call is changed;

receiving, by the first device through the direct link, a direct connection deactivation response transmitted by the second device in response to the direct connection deactivation request; and

deactivating the direct link based on the direct connection deactivation response.

11 . The method according to claim 10 , wherein transmitting the direct connection deactivation request to the second device includes:

in response to that a device state of the first device is changed to a multimedia resource collection deactivation state:

determining, by the first device, that the role of the first device during the voice call is changed and the role is changed to a listener, the listener being a device configured to receive the multimedia resource outputted by the presenter during the voice call; and

transmitting, by the first device in response to a role of the second device during the voice call being a listener, the direct connection deactivation request to the second device through the direct link; and

in response to that the device state of the first device is changed to a voice call exiting state:

determining, by the first device, that the role of the first device during the voice call is changed and the role is changed to no role, the no role being a device not participating in the voice call; and

transmitting, by the first device, the direct connection deactivation request to the second device through the direct link.

12 . An electronic device comprising:

at least one processor; and

at least one memory storing at least one computer program that, when being loaded and executed by the at least one processor, causes the electronic device to perform the method according to claim 1 .

13 . A non-transitory computer-readable storage medium storing at least one computer program that, when being loaded and executed by at least one processor, causes the at least one processor to perform the method according to claim 1 .

14 . A multimedia resource transmission method comprising:

in response to a direct connection request of a first device forwarded by a server, creating, by a second device, a direct link between the second device and the first device, the second device being determined from at least one terminal device participating in a same voice call as the first device when a role of the first device during the voice call is changed to a presenter, the presenter being a device configured to output multimedia during the voice call;

receiving, by the second device through the direct link, a multimedia resource transmitted by the first device; and

receiving, by the second device, the multimedia resource forwarded by the server.

15 . The method according to claim 14 , wherein receiving the multimedia resource transmitted by the first device includes:

receiving, by the second device through the direct link, an audio resource transmitted by the first device; and

receiving, by the second device through the direct link, a video resource transmitted by the first device, the video resource being transmitted through the direct link in a response to that an available uplink bandwidth of the first device is not less than a product of a video bitrate of the video resource and a reference quantity.

16 . The method according to claim 14 , wherein receiving the multimedia resource transmitted by the first device includes:

receiving, by the second device through the direct link, an audio resource transmitted by the first device; and

receiving, by the second device through the direct link, a video resource transmitted by the first device, the video resource being transmitted through the direct link in response to that an available uplink bandwidth of the first device is less than a product of a video bitrate of the video resource and a reference quantity, and the second device satisfies a transmission condition.

17 . The method according to claim 16 , wherein the second device satisfying the transmission condition includes:

a direct connection packet utilization of the second device is not less than a utilization threshold, the direct connection packet utilization of the second device being a ratio of a quantity of packets that are transmitted through the direct link and that are used by the second device over a total quantity of packets used by the second device.

18 . The method according to claim 14 , wherein receiving the multimedia resource forwarded by the server includes:

receiving, by the second device, an audio resource of the first device forwarded by the server; and

receiving, by the second device, a video resource of the first device forwarded by the server, the video resource being forwarded by the server in response to that an available uplink bandwidth of the first device is less than a product of a video bitrate of the video resource and a reference quantity, and the second device does not satisfy a transmission condition.

19 . The method according to claim 14 , further comprising, after creating the direct link:

receiving, by the second device through the direct link, a direct connection deactivation request transmitted by the first device, the direct connection deactivation request being transmitted to the second device in response to the role of the first device being changed during the voice call; and

transmitting, by the second device through the direct link, a direct connection deactivation response to the first device in response to the direct connection deactivation request, and deactivating the direct link based on the direct connection deactivation response.

20 . A system comprising:

a first device;

a second device; and

a server;

wherein:

the first device is configured to:

determine, in response to that a role of the first device during a voice call is changed to a presenter, the second device from at least one terminal device participating in a same voice call as the first device, the presenter being a device configured to output multimedia during the voice call;

create a direct link between the first device and the second device;

transmit a multimedia resource to the second device through the direct link; and

transmit the multimedia resource to the server;

the second device is configured to:

in response to a direct connection request of the first device forwarded by the server, establish the direct link between the second device and the first device;

receive, through the direct link, the multimedia resource transmitted by the first device; and

receive the multimedia resource forwarded by the server; and

the server is configured to forward the multimedia resource and the direct connection request received from the first device to the second device.