Granted Patent B2

US 12,569,756 · App. 18/239,665 · Granted Mar 10, 2026

Inventor: Shili Xu (Shenzhen, CN)

Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED

A63F13/358A63F13/355

Abstract

Claims (41)

1 . A cloud application-based device control method performed by an electronic device, the method comprising:

establishing a communication connection with a cloud application server;

receiving, via the communication connection, a communication establishment request transmitted by the cloud application server;

querying a multimedia feedback type supported by a physical device associated with the electronic device and a protocol version of multimedia feedback according to the communication establishment request;

transmitting, via the communication connection, a communication response message to the cloud application server, the communication response message comprising the multimedia feedback type and the protocol version of the multimedia feedback;

receiving, via the communication connection, a video stream corresponding to a cloud application scene transmitted by the cloud application server and multimedia feedback information corresponding to the cloud application scene, wherein the cloud application server is configured to (i) perform scene recognition on the cloud application scene to obtain a scene recognition result and (ii) determine the multimedia feedback information based on the scene recognition result, the multimedia feedback type and the protocol version of the multimedia feedback; and

controlling the physical device associated with a cloud application client on the electronic device to execute a multimedia feedback operation in accordance with the multimedia feedback information while the video stream corresponding to the cloud application scene being played by the cloud application client on the electronic device.

2 . The method according to claim 1 , wherein the physical device comprises a third-party device, and the controlling a physical device associated with the cloud application client to execute a multimedia feedback operation in accordance with the multimedia feedback information comprises:

generating a multimedia control instruction for the third-party device according to the multimedia feedback information; and

transmitting the multimedia control instruction to the third-party device, so that the third-party device executes the multimedia feedback operation according to the multimedia feedback information.

3 . The method according to claim 1 , wherein the multimedia feedback information comprises a multimedia feedback type, and the cloud application client controls the physical device to execute the multimedia feedback operation indicated by the multimedia feedback type.

4 . The method according to claim 1 , wherein the multimedia feedback information comprises a time parameter of multimedia feedback, the time parameter is used for indicating a time period for performing the multimedia feedback, and the cloud application client controls the physical device to execute the multimedia feedback operation within a time period indicated by the time parameter.

5 . The method according to claim 1 , wherein the multimedia feedback information comprises an execution frequency of the multimedia feedback, and the cloud application client controls the physical device to execute the multimedia feedback operation according to the execution frequency of the multimedia feedback.

6 . The method according to claim 1 , wherein the multimedia feedback information comprises an execution intensity of the multimedia feedback, and the cloud application client controls the physical device to execute the multimedia feedback operation according to the execution intensity of the multimedia feedback.

7 . An electronic device, comprising:

a processor; and

a memory, configured to store an executable instruction of the processor;

the processor being configured to execute the executable instruction to implement a cloud application-based device control method including:

establishing a communication connection with a cloud application server;

receiving, via the communication connection, a communication establishment request transmitted by the cloud application server;

querying a multimedia feedback type supported by a physical device associated with the electronic device and a protocol version of multimedia feedback according to the communication establishment request;

transmitting, via the communication connection, a communication response message to the cloud application server, the communication response message comprising the multimedia feedback type and the protocol version of the multimedia feedback;

receiving, via the communication connection, a video stream corresponding to a cloud application scene transmitted by the cloud application server and multimedia feedback information corresponding to the cloud application scene, wherein the cloud application server is configured to (i) perform scene recognition on the cloud application scene to obtain a scene recognition result and (i) determine the multimedia feedback information based on the scene recognition result, the multimedia feedback type and the protocol version of the multimedia feedback; and

controlling the physical device associated with a cloud application client on the electronic device to execute a multimedia feedback operation in accordance with the multimedia feedback information while the video stream corresponding to the cloud application scene being played by the cloud application client on the electronic device.

8 . The electronic device according to claim 7 , wherein the physical device comprises a third-party device, and the controlling a physical device associated with the cloud application client to execute a multimedia feedback operation in accordance with the multimedia feedback information comprises:

generating a multimedia control instruction for the third-party device according to the multimedia feedback information; and

transmitting the multimedia control instruction to the third-party device, so that the third-party device executes the multimedia feedback operation according to the multimedia feedback information.

9 . The electronic device according to claim 7 , wherein the multimedia feedback information comprises a multimedia feedback type, and the cloud application client controls the physical device to execute the multimedia feedback operation indicated by the multimedia feedback type.

10 . The electronic device according to claim 7 , wherein the multimedia feedback information comprises a time parameter of multimedia feedback, the time parameter is used for indicating a time period for performing the multimedia feedback, and the cloud application client controls the physical device to execute the multimedia feedback operation within a time period indicated by the time parameter.

11 . The electronic device according to claim 7 , wherein the multimedia feedback information comprises an execution frequency of the multimedia feedback, and the cloud application client controls the physical device to execute the multimedia feedback operation according to the execution frequency of the multimedia feedback.

12 . The electronic device according to claim 7 , wherein the multimedia feedback information comprises an execution intensity of the multimedia feedback, and the cloud application client controls the physical device to execute the multimedia feedback operation according to the execution intensity of the multimedia feedback.

13 . A non-transitory computer-readable medium, having a computer program stored thereon, the computer program, when executed by a processor of an electronic device, causing the electronic device to implement a cloud application-based device control method including:

establishing a communication connection with a cloud application server;

receiving, via the communication connection, a communication establishment request transmitted by the cloud application server;

querying a multimedia feedback type supported by a physical device associated with the electronic device and a protocol version of multimedia feedback according to the communication establishment request;

transmitting, via the communication connection, a communication response message to the cloud application server, the communication response message comprising the multimedia feedback type and the protocol version of the multimedia feedback;

receiving, via the communication connection, a video stream corresponding to a cloud application scene transmitted by the cloud application server and multimedia feedback information corresponding to the cloud application scene, wherein the cloud application server is configured to (i) perform scene recognition on the cloud application scene to obtain a scene recognition result and (i) determine the multimedia feedback information based on the scene recognition result, the multimedia feedback type and the protocol version of the multimedia feedback; and

controlling the physical device associated with a cloud application client on the electronic device to execute a multimedia feedback operation in accordance with the multimedia feedback information while the video stream corresponding to the cloud application scene being played by the cloud application client on the electronic device.

14 . The non-transitory computer-readable medium according to claim 13 , wherein the physical device comprises a third-party device, and the controlling a physical device associated with the cloud application client to execute a multimedia feedback operation in accordance with the multimedia feedback information comprises:

generating a multimedia control instruction for the third-party device according to the multimedia feedback information; and

transmitting the multimedia control instruction to the third-party device, so that the third-party device executes the multimedia feedback operation according to the multimedia feedback information.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (21)