IP Library Granted Patent US 11,474,594
Granted Patent B2
US 11,474,594 · App. 17/311,393 · Granted Oct 18, 2022

Virtual reality display method, device and apparatus, and computer storage medium

Inventors: Dehui Kong (Guangdong, CN); Ke Xu (Guangdong, CN); Xiao Zhang (Guangdong, CN); Bin Han (Guangdong, CN); Chong Xiang (Guangdong, CN); Shuai Jiao (Guangdong, CN); Hong Wang (Guangdong, CN); Guoning Lu (Guangdong, CN); Degen Zhen (Guangdong, CN)
Assignee: ZTE CORPORATION
G06F3/011G06T3/005G09G3/03G09G2340/0464G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,474,594
App. No.
17/311,393
Granted
Oct 18, 2022
Kind
B2
Abstract

A virtual reality display method, device, apparatus and storage medium are provided. The method includes: acquiring multimedia data to be displayed and a visible region of a viewer on a curved display surface, wherein the visible region is obtained by projecting a visible range of the viewer to the curved display surface, and is not larger than a display area of the curved display surface; determining target curvatures of at least two positions in the visible region of the viewer, wherein in the target curvatures, target curvatures of different positions are related to a distance to a center of the visible region of the viewer; adjusting, based on the target curvatures of the at least two positions in the visible region, a curvature of a corresponding position on the curved display surface; and mapping the multimedia data to be displayed to the curved display surface having the adjusted curvature.

Claims (43)

1. A virtual reality display method, comprising:

acquiring multimedia data to be displayed and a visible region of a viewer on a curved display surface, wherein the visible region is obtained by projecting a visible range of the viewer to the curved display surface, and the visible region is not larger than a display area of the curved display surface;

determining target curvatures of at least two positions in the visible region of the viewer, wherein in the target curvatures of the at least two positions, target curvatures of different positions are related to a distance to a center of the visible region of the viewer;

adjusting, based on the target curvatures of the at least two positions in the visible region, a curvature of a corresponding position on the curved display surface; and

mapping the multimedia data to be displayed to the curved display surface having the adjusted curvature,

wherein the step of mapping the multimedia data to be displayed to the curved display surface having the adjusted curvature comprises:

acquiring a positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature;

generating target display multimedia data based on the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature, and displaying the target display multimedia data in the curved display surface having the adjusted curvature,

wherein the step of generating the target display multimedia data based on the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature comprises:

performing pixel interpolation on the multimedia data to be displayed based on the positional correspondence relation between the curved display surface having the adjusted curvature and the multimedia data to be displayed to obtain the target display multimedia data.

2. The method according to claim 1 , wherein the step of determining the target curvatures of at least two positions in the visible region of the viewer comprises:

dividing the visible region into at least a first region and a second region; and

setting a target curvature of at least one position contained in the first region as a preset curvature parameter, and calculating a target curvature of at least one position in the second region.

3. The method according to claim 2 , wherein the step of calculating the target curvature of the at least one position in the second region comprises:

calculating to obtain the target curvature of the at least one position in the second region based on a distance between the viewer and the curved display surface as well as the center of the visible region of the viewer,

wherein a target curvature of a corresponding position of the at least one position in the second region is proportional to a distance of the corresponding position to the center of the visible region.

4. The method according to claim 1 , wherein the step of acquiring the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature comprises:

mapping the multimedia data to be displayed to a spherical reference surface to obtain a positional relation between the multimedia data to be displayed and the spherical reference surface;

mapping the curved display surface having the adjusted curvature to the spherical reference surface to obtain a positional relation between the curved display surface having the adjusted curvature and the spherical reference surface, wherein the spherical reference surface is configured to indicate the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature; and

determining, based on the positional relation between the multimedia data to be displayed and the spherical reference surface, and the positional relation between the curved display surface having the adjusted curvature and the spherical reference surface, the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature.

5. A virtual reality display device, comprising a processor, and a memory having a program stored therein which, when executed by the processor, causes the processor to:

acquire multimedia data to be displayed and a visible region of a viewer on a curved display surface, wherein the visible region is obtained by projecting a visible range of the viewer to the curved display surface, and the visible region is not larger than a display area of the curved display surface;

determine target curvatures of at least two positions in the visible region of the viewer, wherein in the target curvatures of the at least two positions, target curvatures of different positions being related to a distance to a center of the visible region of the viewer;

adjust, based on the target curvatures of the at least two positions in the visible region, a curvature of a corresponding position on the curved display surface; and

map the multimedia data to be displayed to the curved display surface having the adjusted curvature,

wherein the program, when executed by the processor, further causes the processor to:

acquire a positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature;

generate target display multimedia data based on the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature, and display the target display multimedia data in the curved display surface having the adjusted curvature,

wherein the program, when executed by the processor, further causes the processor to:

perform pixel interpolation on the multimedia data to be displayed based on the positional correspondence relation between the curved display surface having the adjusted curvature and the multimedia data to be displayed to obtain the target display multimedia data.

6. The device according to claim 5 , wherein the program, when executed by the processor, further causes the processor to:

divide the visible region into at least a first region and a second region; and set a target curvature of at least one position contained in the first region as a preset curvature parameter; and

calculate a target curvature of at least one position in the second region.

7. The device according to claim 6 , wherein the program, when executed by the processor, further causes the processor to:

calculate to obtain the target curvature of the at least one position in the second region based on a distance between the viewer and the curved display surface as well as the center of the visible region of the viewer,

wherein a target curvature of a corresponding position of the at least one position in the second region is proportional to a distance of the corresponding position to the center of the visible region.

8. The device according to claim 5 , wherein the program, when executed by the processor, further causes the processor to:

map the multimedia data to be displayed to a spherical reference surface to obtain a positional relation between the multimedia data to be displayed and the spherical reference surface;

map the curved display surface having the adjusted curvature to the spherical reference surface to obtain a positional relation between the curved display surface having the adjusted curvature and the spherical reference surface, wherein the spherical reference surface is configured to indicate the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature; and

determine, based on the positional relation between the multimedia data to be displayed and the spherical reference surface, and the positional relation between the curved display surface having the adjusted curvature and the spherical reference surface, the positional correspondence relation between the multimedia data to be displayed and the curved display surface having the adjusted curvature.

9. A virtual reality display apparatus, comprising a processor and a memory configured to store a computer program operable on the processor,

wherein the processor is configured to execute the computer program to perform the method of claim 1 .

10. A non-transitory computer-readable storage medium storing computer executable instructions thereon which, when executed by a processor, cause the processor to implement the method of claim 1 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2023
From: ZTE CORPORATION
To: SANECHIPS TECHNOLOGY CO., LTD.
Reel/Frame 062777/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2021
From: KONG, DEHUI; XU, KE; ZHANG, XIAO; HAN, BIN; XIANG, CHONG; JIAO, SHUAI; WANG, HONG; LU, GUONING; ZHEN, DEGEN
To: ZTE CORPORATION
Reel/Frame 056494/0646 →
Priority Claims (1)
CN 201811534066.3 · Dec 14, 2018 · national
Continuity (1)
Related Publication 20220026982A1 · Jan 27, 2022