Granted Patent B2

US 12,549,778 · App. 18/551,913 · Granted Feb 10, 2026

Inventor: Youzhi Jin (Beijing, CN)

Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.

H04N21/21805H04N21/2187H04N21/6587

Abstract

Claims (75)

1 . A view angle switching method for a free view angle video, being applied to a client and comprising:

determining view angle switching information according to a view angle switching operation triggered by a user;

transmitting the view angle switching information to a low-latency room corresponding to the client through a low-latency server, so that in response to determining that a view angle change message in the low-latency room is monitored, a media server acquires a preset number of video frame sets currently and most newly cached, determines a target video frame set from the preset number of video frame sets, determines a target video stream from the target video frame set after a view angle is switched based on the view angle switching information, pushes the target video stream to the low-latency room, and returns to executing an operation of acquiring the preset number of video frame sets currently and most newly cached to push a next target video stream, wherein each video frame set of the preset number of video frame sets comprises video frames in each view angle after alignment; and

obtaining the target video stream pushed to the low-latency room through the low-latency server and playing the target video stream;

wherein the low-latency server is a real-time communication (RTC) server, and the low-latency room is an RTC room.

2 . The method of claim 1 , wherein

in a video live scenario, the view angle switching information comprises target view angle information after the view angle is switched; and

in a video on-demand scenario, the view angle switching information comprises the target view angle information after the view angle is switched and a current play progress identifier when the user triggers the view angle switching operation.

3 . The method of claim 2 , wherein the current play progress identifier is a current play time stamp or a current play video frame sequence number.

4 . The method of claim 2 , wherein determining the target view angle information after the view angle is switched according to the view angle switching operation triggered by the user comprises:

determining the target view angle information after the view angle is switched according to a sliding operation of the user or a view angle clicking operation of the user.

5 . The method of claim 4 , wherein determining the target view angle information after the view angle is switched according to the sliding operation of the user comprises:

in response to determining that the user slides a screen to left, using next view angle information of current view angle information in a counterclockwise direction as the target view angle information after the view angle is switched; and

in response to determining that the user slides the screen to right, using next view angle information of current view angle information in a clockwise direction as the target view angle information after the view angle is switched.

6 . The method of claim 1 , before determining the view angle switching information according to the view angle switching operation triggered by the user, further comprising:

transmitting a video play request to the media server so that the media server creates the low-latency room corresponding to the client through the low-latency server based on the video play request and transmits room information of the low-latency room to the client;

receiving the room information of the low-latency room, and connecting to the low-latency room corresponding to the room information through the low-latency server; and

obtaining a video stream in the low-latency room through the low-latency server, and playing the obtained video stream, wherein the obtained video stream is a video stream which is in a preset view angle and pushed by the media server.

7 . A view angle switching method for a free view angle video, being applied to a media server and comprising:

in response to determining that a view angle change message in a low-latency room corresponding to a client is monitored, determining a target video stream after a view angle is switched based on view angle switching information in the low-latency room, wherein the view angle change message is generated when the client transmits the view angle switching information to the low-latency room through a low-latency server, and the view angle switching information is determined according to a view angle switching operation triggered by a user; and

pushing the target video stream to the low-latency room so that the client obtains the target video stream in the low-latency room through the low-latency server and plays the target video stream;

wherein the low-latency server is a real-time communication (RTC) server, and the low-latency room is an RTC room;

wherein determining the target video stream after the view angle is switched based on the view angle switching information in the low-latency room comprises:

acquiring a preset number of video frame sets currently and most newly cached, wherein each video frame set of the preset number of video frame sets comprises video frames in each view angle after alignment;

determining a target video frame set from the preset number of video frame sets; and

determining, from the target video frame set, a target video frame after the view angle is switched according to target view angle information after the view angle is switched in the low-latency room; and

wherein pushing the target video stream to the low-latency room comprises:

pushing the target video frame to the low-latency room, and returning to executing an operation of acquiring the preset number of video frame sets currently and most newly cached to push a next target video stream.

8 . The method of claim 7 , before acquiring the preset number of video frame sets currently and most newly, further comprising:

acquiring a current live video stream currently acquired by a camera in each view angle and alignment information corresponding to each video frame in the current live video stream; and

combining video frames having same alignment information in the current live video stream of each view angle into one video frame set, and caching the combined video frame set.

9 . The method of claim 8 , wherein combining the video frames having the same alignment information in the current live video stream of each view angle into the one video frame set comprises:

combining video frames having a same acquisition time stamp in the current live video stream of each view angle into one video frame set; or

combining video frames having a same frame sequence number in the current live video stream of each view angle into one video frame set.

10 . The method of claim 7 , wherein determining the target video frame set from the preset number of video frame sets comprises:

determining, among the preset number of video frame sets, a video frame set having an earliest acquisition time or a video frame set having a smallest frame sequence number as the target video frame set.

11 . The method of claim 7 , after pushing the target video frame to the low-latency room, further comprising:

in response to determining that a plurality of clients exist, deleting the target video frame set in a cache after a video frame pushing traversal performed on a low-latency room corresponding to each of the plurality of clients ends.

12 . The method of claim 7 , wherein determining the target video stream after the view angle is switched based on the view angle switching information in the low-latency room comprises:

determining the target video stream after the view angle is switched according to a current live video stream corresponding to each view angle information after alignment and target view angle information after the view angle is switched in the low-latency room.

13 . The method of claim 7 , wherein determining the target video stream after the view angle is switched based on the view angle switching information in the low-latency room comprises:

determining a target on-demand video stream in a target view angle according to an on-demand video stream corresponding to each view angle information after alignment and target view angle information after the view angle is switched in the low-latency room; and

determining the target video stream after the view angle is switched based on the target on-demand video stream and a current play progress identifier when the user triggers the view angle switching operation in the low-latency room.

14 . A view angle switching system for a free view angle video, comprising: a client, a media server, and a low-latency server,

wherein the client is configured to implement the following:

determining view angle switching information according to a view angle switching operation triggered by a user;

transmitting the view angle switching information to a low-latency room corresponding to the client through a low-latency server, so that in response to determining that a view angle change message in the low-latency room is monitored, a media server acquires a preset number of video frame sets currently and most newly cached, determines a target video frame set from the preset number of video frame sets, determines a target video stream from the target video frame set after a view angle is switched based on the view angle switching information, pushes the target video stream to the low-latency room, and returns to executing an operation of acquiring the preset number of video frame sets currently and most newly cached to push a next target video stream, wherein each video frame set of the preset number of video frame sets comprises video frames in each view angle after alignment; and

obtaining the target video stream pushed to the low-latency room through the low-latency server and playing the target video stream, wherein the low-latency server is a real-time communication (RTC) server, and the low-latency room is an RTC room; and

the media server is configured to implement the view angle switching method for a free view angle video according to claim 7 .

15 . An electronic device, comprising:

at least one processor; and

a memory configured to store at least one program,

wherein when the at least one program is executed by the at least one processor, the at least one processor is caused to implement the following:

determining view angle switching information according to a view angle switching operation triggered by a user;

transmitting the view angle switching information to a low-latency room corresponding to the client through a low-latency server, so that in response to determining that a view angle change message in the low-latency room is monitored, a media server acquires a preset number of video frame sets currently and most newly cached, determines a target video frame set from the preset number of video frame sets, determines a target video stream from the target video frame set after a view angle is switched based on the view angle switching information, pushes the target video stream to the low-latency room, and returns to executing an operation of acquiring the preset number of video frame sets currently and most newly cached to push a next target video stream, wherein each video frame set of the preset number of video frame sets comprises video frames in each view angle after alignment; and

obtaining the target video stream pushed to the low-latency room through the low-latency server and playing the target video stream;

wherein the low-latency server is a real-time communication (RTC) server, and the low-latency room is an RTC room.

16 . The electronic device of claim 15 , wherein

in a video live scenario, the view angle switching information comprises target view angle information after the view angle is switched; and

in a video on-demand scenario, the view angle switching information comprises the target view angle information after the view angle is switched and a current play progress identifier when the user triggers the view angle switching operation.

17 . The electronic device of claim 16 , wherein the current play progress identifier is a current play time stamp or a current play video frame sequence number.

18 . The electronic device of claim 16 , wherein the at least one processor is caused to implement determining the target view angle information after the view angle is switched according to the view angle switching operation triggered by the user by:

determining the target view angle information after the view angle is switched according to a sliding operation of the user or a view angle clicking operation of the user.

19 . A non-transitory computer readable storage medium storing a computer program, wherein the computer program is configured to, when executed by a processor, implements the view angle switching method for a free view angle video according to claim 1 .

20 . A view angle switching system for a free view angle video, comprising: a client, a media server, and a low-latency server,

wherein the client is configured to implement the view angle switching method for a free view angle video according to claim 1 ; and

the media server is configured to implement the following:

in response to determining that a view angle change message in a low-latency room corresponding to a client is monitored, determining a target video stream after a view angle is switched based on view angle switching information in the low-latency room, wherein the view angle change message is generated when the client transmits the view angle switching information to the low-latency room through a low-latency server, and the view angle switching information is determined according to a view angle switching operation triggered by a user; and

pushing the target video stream to the low-latency room so that the client obtains the target video stream in the low-latency room through the low-latency server and plays the target video stream;

wherein the media server is configured to implement determining the target video stream after the view angle is switched based on the view angle switching information in the low-latency room by:

acquiring a preset number of video frame sets currently and most newly cached, wherein each video frame set of the preset number of video frame sets comprises video frames in each view angle after alignment;

determining a target video frame set from the preset number of video frame sets; and

determining, from the target video frame set, a target video frame after the view angle is switched according to target view angle information after the view angle is switched in the low-latency room; and

wherein the media server is configured to implement pushing the target video stream to the low-latency room by:

pushing the target video frame to the low-latency room, and returning to executing an operation of acquiring the preset number of video frame sets currently and most newly cached to push a next target video stream.

Assignments (2)

Priority Claims (1)

Continuity (1)

References Cited (40)