IP Library › Granted Patent US 11,159,848
Granted Patent B2
US 11,159,848 · App. 16/664,093 · Granted Oct 26, 2021

Video playing method, device, and system

Inventors: Ran Ju (Nanjing, CN); Jin Li (Nanjing, CN); Feng Li (Nanjing, CN)
Assignee: Huawei Technologies Co., Ltd.
H04N21/440263H04N13/156H04N13/167H04N13/194H04N21/414H04N21/433H04N21/434H04N21/44004H04N21/4621H04N21/816H04N21/8547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,159,848
App. No.
16/664,093
Granted
Oct 26, 2021
Kind
B2
Abstract

A video playing method, a device, and a system are provided. The method includes: receiving, by a VR device, a first-resolution VR video stream of a first viewing angle and a second-resolution VR video stream of a full viewing angle that are sent by a server, where the first resolution is greater than the second resolution; playing an image of the first viewing angle by using the VR video stream of the first viewing angle; when determining that the viewing angle changes, playing an image of a current viewing angle by using the first or both of the VR video stream of the full viewing angle and the VR video stream of the first viewing angle; sending, to the server, viewing angle information that carries a parameter for indicating a changed-to second viewing angle; receiving a first-resolution VR video stream of the second viewing angle sent by the server.

Claims (64)

1. A method, comprising:

receiving, by a virtual reality (VR) device, a first-resolution VR video stream of a first viewing angle and a second-resolution VR video stream of a full viewing angle that are sent by a server, wherein the first resolution is greater than the second resolution;

playing, by the VR device, an image of the first viewing angle using the first-resolution VR video stream of the first viewing angle;

in response to the VR device determining that a current viewing angle has changed, playing, by the VR device, an image of the current viewing angle using the second-resolution VR video stream of the full viewing angle;

sending, by the VR device, viewing angle information to the server, wherein the viewing angle information carries a parameter for indicating a changed-to second viewing angle;

receiving, by the VR device, a first-resolution VR video stream of the second viewing angle sent by the server;

detecting, by the VR device, whether a time stamp of the received first-resolution VR video stream of the second viewing angle comprises a time stamp of a currently played image;

in response to detecting that the time stamp of the received first-resolution VR video stream of the second viewing angle is synchronized with the time stamp of the currently played image, playing, by the VR device, an image of the second viewing angle using the first-resolution VR video stream of the second viewing angle; and

in response to detecting that the time stamp of the received first-resolution VR video stream of the second viewing angle does not comprise the time stamp of the currently played image, playing, by the VR device, the image of the second viewing angle using the second-resolution VR video stream of the full viewing angle.

2. The method according to claim 1 , wherein playing, by the VR device, the image of the current viewing angle using the second-resolution VR video stream of the full viewing angle comprises:

decoding, by the VR device, the second-resolution VR video stream of the full viewing angle, to obtain a full viewing angle image;

extracting, by the VR device, the image of the current viewing angle from the full viewing angle image; and

playing, by the VR device, the image of the current viewing angle.

3. The method according to claim 1 , wherein playing, by the VR device, the image of the current viewing angle using the second-resolution VR video stream of the full viewing angle comprises:

decoding, by the VR device, the first-resolution VR video stream of the first viewing angle, to obtain the image of the first viewing angle;

decoding, by the VR device, the second-resolution VR video stream of the full viewing angle, to obtain a full viewing angle image;

extracting, by the VR device, an overlapping image from the image of the first viewing angle, and extracting a non-overlapping image from the full viewing angle image, wherein the overlapping image is an image of an overlapping area between the image of the first viewing angle and the image of the current viewing angle, and the non-overlapping image is an image different from the image of the overlapping area in the image of the current viewing angle;

combining, by the VR device, the overlapping image and the non-overlapping image to obtain the image of the current viewing angle; and

playing, by the VR device, the image of the current viewing angle.

4. A method, comprising:

receiving, by a virtual reality (VR) device, a first-resolution VR video stream of a first viewing angle and a second-resolution VR video stream of a full viewing angle that are sent by a server, wherein the first resolution is greater than the second resolution;

after receiving, by the VR device, the first-resolution VR video stream of the first viewing angle and the second-resolution VR video stream of the full viewing angle that are sent by the server, storing, by the VR device, the first-resolution VR video stream of the first viewing angle to a first video buffer, and storing the second-resolution VR video stream of the full viewing angle to a second video buffer;

playing, by the VR device, an image of the first viewing angle using the first-resolution VR video stream of the first viewing angle;

in response to the VR device determining that a current viewing angle has changed, playing, by the VR device, an image of the current viewing angle using the second-resolution VR video stream of the full viewing angle;

sending, by the VR device, viewing angle information to the server, wherein the viewing angle information carries a parameter for indicating a changed-to second viewing angle;

receiving, by the VR device, a first-resolution VR video stream of the second viewing angle sent by the server;

playing, by the VR device, an image of the second viewing angle using the first-resolution VR video stream of the second viewing angle; and

in response to the VR device determining that the current viewing angle has changed, or in response to the VR device playing the image of the second viewing angle by using the first-resolution VR video stream of the second viewing angle, performing, by the VR device, data aging on the first-resolution VR video stream of the first viewing angle buffered in the first video buffer.

5. A virtual reality (VR) device, comprising:

a transmitter;

a receiver;

a processor; and

a non-transitory memory, the non-transitory memory storing a plurality of processor-executable instructions, wherein the processor executes the plurality of processor executable instructions to:

receive, using the receiver, a first-resolution VR video stream of a first viewing angle and a second-resolution VR video stream of a full viewing angle that are sent by a server, wherein the first resolution is greater than the second resolution;

play an image of the first viewing angle by using the first-resolution VR video stream of the first viewing angle;

in response to the VR device determining that a current viewing angle has changed, play an image of the current viewing angle by using the first-resolution VR video stream of the first viewing angle, or both of the second-resolution VR video stream of the full viewing angle and the first-resolution VR video stream of the first viewing angle;

send, using the transmitter, viewing angle information to the server, wherein the viewing angle information carries a parameter for indicating a changed-to second viewing angle;

receive, using the receiver, a first-resolution VR video stream of the second viewing angle sent by the server;

detect whether a time stamp of the received first-resolution VR video stream of the second viewing angle comprises a time stamp of a currently played image;

in response to detecting the time stamp of the received first-resolution VR video stream of the second viewing angle comprises the time stamp of the currently played image, play an image of the second viewing angle by using the first-resolution VR video stream of the second viewing angle;

in response to detecting the time stamp of the received first-resolution VR video stream of the second viewing angle does not comprise the time stamp of the currently played image, play the image of the second viewing angle using the second-resolution VR video stream of the full viewing angle or the first-resolution VR video stream of the first viewing angle.

6. The VR device according to claim 5 , wherein the processor executes the plurality of processor executable instructions to:

decode the second-resolution VR video stream of the full viewing angle, to obtain a full viewing angle image;

extract the image of the current viewing angle from the full viewing angle image; and

play the image of the current viewing angle.

7. The VR device according to claim 5 , wherein the processor executes the plurality of processor executable instructions further to:

decode the first-resolution VR video stream of the first viewing angle, to obtain the image of the first viewing angle;

decode the second-resolution VR video stream of the full viewing angle, to obtain a full viewing angle image;

extract an overlapping image from the image of the first viewing angle, and extract a non-overlapping image from the full viewing angle image, wherein the overlapping image is an image of an overlapping area between the image of the first viewing angle and the image of the current viewing angle, and the non-overlapping image is an image different from the image of the overlapping area in the image of the current viewing angle;

combine the overlapping image and the non-overlapping image to obtain the image of the current viewing angle; and

play the image of the current viewing angle.

8. A virtual reality (VR) device, comprising:

a transmitter;

a receiver;

a processor; and

a non-transitory memory, the non-transitory memory storing a plurality of processor-executable instructions, wherein the processor executes the plurality of processor executable instructions to:

receive, using the receiver, a first-resolution VR video stream of a first viewing angle and a second-resolution VR video stream of a full viewing angle that are sent by a server, wherein the first resolution is greater than the second resolution;

store the first-resolution VR video stream of the first viewing angle to a first video buffer, and store the second-resolution VR video stream of the full viewing angle to a second video buffer;

play an image of the first viewing angle using the first-resolution VR video stream of the first viewing angle;

in response to the VR device determining that a current viewing angle has changed, play an image of the current viewing angle using the first-resolution VR video stream of the first viewing angle, or both of the second-resolution VR video stream of the full viewing angle and the first-resolution VR video stream of the first viewing angle;

send, using the transmitter, viewing angle information to the server, wherein the viewing angle information carries a parameter for indicating a changed-to second viewing angle;

receive, using the receiver, a first-resolution VR video stream of the second viewing angle sent by the server;

play an image of the second viewing angle by using the first-resolution VR video stream of the second viewing angle;

in response to the current viewing angle has changed, or in response to the image of the second viewing angle being played using the first-resolution VR video stream of the second viewing angle, perform data aging on the first-resolution VR video stream of the first viewing angle buffered in the first video buffer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2020
From: JU, RAN; LI, JIN; LI, FENG
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 052546/0946 →
Priority Claims (1)
CN 201710294033.5 · Apr 28, 2017 · national
Continuity (2)
Continuation PCTCN2018084496 · Apr 25, 2018
Related Publication 20200059694A1 · Feb 20, 2020
Cited By (1)
US 12,531,920