IP Library › Granted Patent US 11,402,894
Granted Patent B2
US 11,402,894 · App. 16/495,858 · Granted Aug 2, 2022

VR image sending method and apparatus

Inventors: Yi Luo (Shenzhen, CN); Fangzhou Zheng (Nanning, CN); Yu Xu (Taipei, TW); Wenyi Qiu (London, GB)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
G06F3/011G02B27/0093G02B27/017G06F3/017G06T19/006G06T19/20G06V20/20A63F2300/8082G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,402,894
App. No.
16/495,858
Granted
Aug 2, 2022
Kind
B2
Abstract

A method and an apparatus for sending a VR image, to improve accuracy of an image compression ratio determined when a VR image is sent. The method includes: receiving, by a VR host, first motion information sent by a VR device, where the first motion information is used to indicate a current motion status of the VR device; determining, by the VR host, a first image compression ratio based on the motion information; compressing, by the VR host, a to-be-sent VR image based on the first image compression ratio; and sending, by the VR host, the compressed VR image to the VR device.

Claims (70)

1. A method for sending a virtual reality (VR) image, comprising:

detecting, by the VR host, a channel quality of a radio channel, wherein the radio channel is a communication channel between the VR device and the VR host;

determining, by the VR host based on a mapping relationship between channel quality of a radio channel and a modulation and coding scheme, a modulation and coding scheme corresponding to the detected channel quality;

receiving, by a VR host, first motion information from a VR device, wherein the first motion information indicates a current motion status of the VR device;

determining, by the VR host, a first image compression ratio from a plurality of potential image compression ratios including a first ratio and a second ratio larger than the first ratio, based on a moving rate magnitude of a motion value in the first motion information;

determining, by the VR host based on the first motion information, the modulation and coding scheme corresponding to the detected channel quality as a first modulation and coding scheme; or adjusting, by the VR host based on the first motion information, the modulation and coding scheme corresponding to the detected channel quality, and using an adjusted modulation and coding scheme as a first modulation and coding scheme;

compressing, by the VR host, a to-be-sent VR image based on the first image compression ratio;

performing, by the VR host, modulation and coding on the compressed VR image according to the first modulation and coding scheme; and

sending, by the VR host, the compressed VR image on which modulation and coding has been performed to the VR device.

2. The method according to claim 1 , the method further comprising:

determining, by the VR host based on a relationship between the channel quality of the radio channel and an image compression ratio, an image compression ratio corresponding to the detected channel quality; and

wherein the determining, by the VR host, of a first image compression ratio based on the first motion information comprises:

determining, by the VR host based on the first motion information, the image compression ratio corresponding to the detected channel quality as the first image compression ratio; or

adjusting, by the VR host based on the first motion information, the image compression ratio corresponding to the detected channel quality, and using an adjusted image compression ratio as the first image compression ratio.

3. The method according to claim 2 , wherein the determining, by the VR host based on the first motion information, of the image compression ratio corresponding to the detected channel quality as the first image compression ratio comprises:

determining, by the VR host, the image compression ratio corresponding to the detected channel quality as the first image compression ratio if it is determined, based on the first motion information and historical motion information of the VR device, that the VR device is in a stationary state in future first duration.

4. The method according to claim 2 , wherein the adjusting, by the VR host based on the first motion information, of the image compression ratio corresponding to the detected channel quality comprises:

adjusting, by the VR host based on the first motion information, the image compression ratio corresponding to the detected channel quality if it is determined, based on the first motion information and historical motion information of the VR device, that the VR device is in a moving state in future first duration.

5. The method according to claim 2 , wherein the adjusting, by the VR host based on the first motion information, of the image compression ratio corresponding to the detected channel quality comprises:

reducing, by the VR host, the image compression ratio corresponding to the detected channel quality if the first motion information is used to indicate that a moving rate of the VR device is less than or equal to a first rate; or

increasing, by the VR host, the image compression ratio corresponding to the detected channel quality if the first motion information is used to indicate that a moving rate of the VR device is greater than a second rate; wherein

the first rate is less than or equal to the second rate.

6. The method according to claim 1 , wherein the determining, by the VR host based on the first motion information, of the modulation and coding scheme corresponding to the detected channel quality as a first modulation and coding scheme comprises:

determining, by the VR host, the modulation and coding scheme corresponding to the detected channel quality as the first modulation and coding scheme if determining, based on the first motion information and the historical motion information of the VR device, that the VR device is in a stationary state in the future first duration.

7. The method according to claim 1 , wherein the adjusting, by the VR host based on the first motion information, of the modulation and coding scheme corresponding to the detected channel quality comprises:

adjusting, by the VR host based on the first motion information, the modulation and coding scheme corresponding to the detected channel quality if determining, based on the first motion information and the historical motion information of the VR device, that the VR device is in a moving state in the future first duration.

8. The method according to claim 7 , wherein the adjusting, by the VR host based on the first motion information, of the modulation and coding scheme corresponding to the detected channel quality comprises:

adjusting, by the VR host, the modulation and coding scheme corresponding to the detected channel quality to a second modulation and coding scheme if the first motion information is used to indicate that the moving rate of the VR device is less than or equal to a first rate, wherein a modulation and coding rate of the second modulation and coding scheme is greater than a modulation and coding rate of the modulation and coding scheme corresponding to the detected channel quality; or

adjusting, by the VR host, the modulation and coding scheme corresponding to the detected channel quality to a third modulation and coding scheme if the first motion information is used to indicate that the moving rate of the VR device is greater than a second rate, wherein a modulation and coding rate of the third modulation and coding scheme is less than a modulation and coding rate of the modulation and coding scheme corresponding to the detected channel quality; wherein

the first rate is less than the second rate.

9. A non-transitory computer-readable storage medium, comprising an instruction, wherein when the instruction runs on a computer, the computer is configured to:

detect a channel quality of a radio channel by the VR host, wherein the radio channel is a communication channel between the VR device and the VR host;

determine a modulation and coding scheme corresponding to the detected channel quality by the VR host, based on a mapping relationship between channel quality of a radio channel and a modulation and coding scheme;

receive first motion information sent by a VR device, wherein the first motion information is used to indicate a current motion status of the VR device;

determine a first image compression ratio from a plurality of potential image compression ratios including a first ratio and a second ratio larger than the first ratio, based on a moving rate magnitude of a motion value in the first motion information;

determine the modulation and coding scheme corresponding to the detected channel quality as a first modulation and coding scheme by the VR host, based on the first motion information; or adjust the modulation and coding scheme corresponding to the detected channel quality by the VR host based on the first motion information, and use an adjusted modulation and coding scheme as a first modulation and coding scheme;

compress a to-be-sent VR image based on the first image compression ratio;

perform modulation and coding on the compressed VR image according to the first modulation and coding scheme by the VR host; and

send the compressed VR image on which modulation and coding has been performed to the VR device by the VR host.

10. A virtual reality (VR) host device, comprising:

a receiver, configured to receive first motion information sent by a VR device, wherein the first motion information is used to indicate a current motion status of the VR device;

a processor, configured to detect current channel quality of a radio channel, wherein the radio channel is a communication channel between the VR device and the VR host;

determine, based on a mapping relationship between channel quality of a radio channel and a modulation and coding scheme, a modulation and coding scheme corresponding to the detected channel quality;

determine a first image compression ratio from a plurality of potential image compression ratios including a first ratio and a second ratio larger than the first ratio, based on a moving rate magnitude of a motion value in the first motion information and compress a to-be-sent VR image based on the first image compression ratio;

determine, based on the first motion information, the modulation and coding scheme corresponding to the detected channel quality as a first modulation and coding scheme; or adjusting, by the VR host based on the first motion information, the modulation and coding scheme corresponding to the detected channel quality, and using an adjusted modulation and coding scheme as a first modulation and coding scheme; and

perform modulation and coding on the compressed VR image according to the first modulation and coding scheme; and

a transmitter configured to send the compressed VR image to the VR device.

11. The VR host device according to claim 10 , wherein the processor is further configured to:

determine, based on a mapping relationship between channel quality of a radio channel and an image compression ratio, an image compression ratio corresponding to the detected channel quality; and

the determining of the first image compression ratio based on the first motion information comprises:

determining, based on the first motion information, the image compression ratio corresponding to the detected channel quality as the first image compression ratio; or adjusting, by the VR host based on the first motion information, the image compression ratio corresponding to the detected channel quality, and using an adjusted image compression ratio as the first image compression ratio.

12. The VR host device according to claim 11 , wherein the determining, based on the first motion information, of the image compression ratio corresponding to the detected channel quality as the first image compression ratio comprises:

determining the image compression ratio corresponding to the detected channel quality as the first image compression ratio if determining, based on the first motion information and historical motion information of the VR device, that the VR device is in a stationary state in future first duration.

13. The VR host device according to claim 11 , wherein the adjusting, based on the first motion information, of the image compression ratio corresponding to the detected channel quality comprises:

adjusting, based on the first motion information, the image compression ratio corresponding to the detected channel quality if determining, based on the first motion information and historical motion information of the VR device, that the VR device is in a moving state in future first duration.

14. The VR host device according to claim 11 , wherein the adjusting, based on the first motion information, of the image compression ratio corresponding to the detected channel quality comprises:

reducing the image compression ratio corresponding to the detected channel quality if the first motion information is used to indicate that a moving rate of the VR device is less than or equal to a first rate; or

increasing the image compression ratio corresponding to the detected channel quality if the first motion information is used to indicate that a moving rate of the VR device is greater than a second rate; wherein

the first rate is less than or equal to the second rate.

15. The VR host device according to claim 11 , wherein the first motion information is used to indicate current location information of the VR device, and the detecting current channel quality of a radio channel comprises:

determining within a range of a first angle based on the location information, a first wireless transmission direction from at least one wireless transmission direction that is generated by the VR device and distributed in a 360-degree range, wherein the first angle is greater than 0 degrees and less than 360 degrees; and

detecting current channel quality of a radio channel in the first wireless transmission direction.

16. The VR host device according to claim 10 , wherein the determining of the processor, based on the first motion information, of the modulation and coding scheme corresponding to the detected channel quality as a first modulation and coding scheme comprises:

determining, the modulation and coding scheme corresponding to the detected channel quality as the first modulation and coding scheme if determining, based on the first motion information and the historical motion information of the VR device, that the VR device is in a stationary state in the future first duration.

17. The VR host device according to claim 10 , wherein the adjusting, based on the first motion information, of the modulation and coding scheme corresponding to the detected channel quality comprises:

adjusting, based on the first motion information, the modulation and coding scheme corresponding to the detected channel quality if determining, based on the first motion information and the historical motion information of the VR device, that the VR device is in a moving state in the future first duration.

18. The VR host device according to claim 17 , wherein the adjusting, based on the first motion information, of the modulation and coding scheme corresponding to the detected channel quality comprises:

adjusting the modulation and coding scheme corresponding to the detected channel quality to a second modulation and coding scheme if the first motion information is used to indicate that the moving rate of the VR device is less than or equal to a first rate, wherein a modulation and coding rate of the second modulation and coding scheme is greater than a modulation and coding rate of the modulation and coding scheme corresponding to the detected channel quality; or

adjusting the modulation and coding scheme corresponding to the detected channel quality to a third modulation and coding scheme if the first motion information is used to indicate that the moving rate of the VR device is greater than a second rate, wherein a modulation and coding rate of the third modulation and coding scheme is less than a modulation and coding rate of the modulation and coding scheme corresponding to the detected channel quality; wherein

the first rate is less than the second rate.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2020
From: LUO, YI; ZHENG, FANGZHOU; XU, YU; QIU, WENYI
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 053493/0126 →
Priority Claims (1)
CN 201710175242.8 · Mar 22, 2017 · national
Continuity (1)
Related Publication 20200064907A1 · Feb 27, 2020