IP Library › Granted Patent US 12701207

Granted Patent B2

US 12701207 · App. 18/320,801 · Granted Aug 4, 2026

Data processing method, apparatus and electronic device

Inventors: Lei Li (Beijing, CN); Xinyu Cui (Beijing, CN)

Assignee: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.

H04N13/161 H04N13/194 H04N13/366 H04N13/344

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12701207
App. No.: 18/320,801
Granted: Aug 4, 2026
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

The present disclosure relates to a data processing method, an apparatus, and an electronic device, which relates to the technical field of data processing. The method comprises: a VR device decodes received image data to obtain a planar image to be processed; first acquiring field of view information of a user; then generating, according to the field of view information and the planar image, a left eye image and a right eye image at a same timestamp; and displaying a virtual reality image according to the left eye image and the right eye image at the same timestamp. The present disclosure can reduce the amount of transmitted data by half, reduce the pressure on network bandwidth by half, reduce the situation of network congestion, and correspondingly reduce the transmission delay. The simplified processing procedures result in no problem of asynchronous transmission between the left eye and the right eye.

Claims (88)

1 . A data processing method, comprising:

decoding received image data to obtain a planar image to be processed;

acquiring field of view information of a user;

generating, according to the field of view information and the planar image, a left eye image and a right eye image at a same timestamp;

displaying a virtual reality image according to the left eye image and the right eye image at the same timestamp,

wherein the acquiring field of view information of a user comprises:

acquiring posture information for a head of the user;

determining, according to the posture information for the head of the user, the field of view information of the user,

wherein the field of view information comprises field of view matrix information of the user;

the determining, according to the posture information for the head of the user, the field of view information of the user comprises:

acquiring, from the posture information for the head of the user, a quaternion for the head of the user detected by a sensor;

determining, according to the quaternion for the head of the user, a field of view matrix for a binocular center of the user;

determining, according to the field of view matrix for the binocular center, field of view matrices for left and right eyes of the user;

determining, using the field of view matrices for the left and right eyes, drawing positions of an element in a left eye picture and a right eye picture.

2 . The method according to claim 1 , wherein the determining, according to the quaternion for the head of the user, a field of view matrix for a binocular center of the user comprises:

converting the quaternion for the head of the user into a matrix form, to obtain a rotation matrix for the binocular center of the user, and determining, according to a position of the binocular center in a world coordinate system, an offset matrix for the binocular center of the user;

determining the field of view matrix for the binocular center according to the rotation matrix for the binocular center and the offset matrix for the binocular center.

3 . The method according to claim 2 , wherein the determining the field of view matrix for the binocular center according to the rotation matrix for the binocular center and the offset matrix for the binocular center comprises:

multiplying the rotation matrix for the binocular center and the offset matrix for the binocular center to obtain a conversion matrix for the binocular center of the user;

computing an inverse matrix of the conversion matrix for the binocular center to obtain the field of view matrix for the binocular center.

4 . The method according to claim 1 , wherein the determining, according to the field of view matrix for the binocular center, field of view matrices for left and right eyes of the user comprises:

creating a homogeneous offset matrix based on an interpupillary distance of the user;

determining, according to the homogeneous offset matrix and the field of view matrix for the binocular center, the field of view matrices for the left and right eyes.

5 . The method according to claim 4 , wherein the creating a homogeneous offset matrix based on an interpupillary distance of the user comprises:

determining, based on an interpupillary distance of the user, displacements required to be offset for the left and right eyes;

creating, using the displacements required to be offset for the left and right eyes, the homogeneous offset matrix.

6 . The method according to claim 4 , wherein the determining, according to the homogeneous offset matrix and the field of view matrix for the binocular center, the field of view matrices for the left and right eyes comprises:

multiplying the field of view matrix for the binocular center and the homogeneous offset matrix, to obtain the field of view matrices for the left and right eyes.

7 . The method according to claim 1 , wherein the generating, according to the field of view information and the planar image, a left eye image and a right eye image at a same timestamp comprises:

adjusting, according to a drawing position of an element in a left eye picture, the planar image to obtain the left eye image, and adjusting, according to a drawing position of an element in a right eye picture, the planar image to obtain the right eye image.

8 . The method according to claim 1 , wherein the displaying a virtual reality image according to the left eye image and the right eye image at the same timestamp comprises:

displaying the left eye image in a left eye displaying area, while displaying the right eye image in a right eye displaying area.

9 . A non-transitory computer-readable storage medium, storing a computer program thereon that, when executed by a processor to implement a data processing method, the method comprising:

decoding received image data to obtain a planar image to be processed;

acquiring field of view information of a user;

generating, according to the field of view information and the planar image, a left eye image and a right eye image at a same timestamp;

displaying a virtual reality image according to the left eye image and the right eye image at the same timestamp,

wherein the acquiring field of view information of a user comprises:

acquiring posture information for a head of the user;

determining, according to the posture information for the head of the user, the field of view information of the user,

wherein the field of view information comprises field of view matrix information of the user;

the determining, according to the posture information for the head of the user, the field of view information of the user comprises:

acquiring, from the posture information for the head of the user, a quaternion for the head of the user detected by a sensor;

determining, according to the quaternion for the head of the user, a field of view matrix for a binocular center of the user;

determining, according to the field of view matrix for the binocular center, field of view matrices for left and right eyes of the user;

determining, using the field of view matrices for the left and right eyes, drawing positions of an element in a left eye picture and a right eye picture.

10 . The non-transitory computer-readable storage medium according to claim 9 , wherein the determining, according to the quaternion for the head of the user, a field of view matrix for a binocular center of the user comprises:

determining the field of view matrix for the binocular center according to the rotation matrix for the binocular center and the offset matrix for the binocular center.

11 . The non-transitory computer-readable storage medium according to claim 10 , wherein the determining the field of view matrix for the binocular center according to the rotation matrix for the binocular center and the offset matrix for the binocular center comprises:

multiplying the rotation matrix for the binocular center and the offset matrix for the binocular center to obtain a conversion matrix for the binocular center of the user;

computing an inverse matrix of the conversion matrix for the binocular center to obtain the field of view matrix for the binocular center.

12 . The non-transitory computer-readable storage medium according to claim 9 , wherein the determining, according to the field of view matrix for the binocular center, field of view matrices for left and right eyes of the user comprises:

creating a homogeneous offset matrix based on an interpupillary distance of the user;

determining, according to the homogeneous offset matrix and the field of view matrix for the binocular center, the field of view matrices for the left and right eyes.

13 . The non-transitory computer-readable storage medium according to claim 12 , wherein the creating a homogeneous offset matrix based on an interpupillary distance of the user comprises:

determining, based on an interpupillary distance of the user, displacements required to be offset for the left and right eyes;

creating, using the displacements required to be offset for the left and right eyes, the homogeneous offset matrix.

14 . An electronic device, comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, wherein the processor implements a data processing method, the method comprising:

decoding received image data to obtain a planar image to be processed;

acquiring field of view information of a user;

generating, according to the field of view information and the planar image, a left eye image and a right eye image at a same timestamp;

displaying a virtual reality image according to the left eye image and the right eye image at the same timestamp,

wherein the acquiring field of view information of a user comprises:

acquiring posture information for a head of the user;

determining, according to the posture information for the head of the user, the field of view information of the user,

wherein the field of view information comprises field of view matrix information of the user;

the determining, according to the posture information for the head of the user, the field of view information of the user comprises:

acquiring, from the posture information for the head of the user, a quaternion for the head of the user detected by a sensor;

determining, according to the quaternion for the head of the user, a field of view matrix for a binocular center of the user;

determining, according to the field of view matrix for the binocular center, field of view matrices for left and right eyes of the user;

determining, using the field of view matrices for the left and right eyes, drawing positions of an element in a left eye picture and a right eye picture.

15 . The electronic device according to claim 14 , wherein the determining, according to the quaternion for the head of the user, a field of view matrix for a binocular center of the user comprises:

determining the field of view matrix for the binocular center according to the rotation matrix for the binocular center and the offset matrix for the binocular center.

16 . The electronic device according to claim 15 , wherein the determining the field of view matrix for the binocular center according to the rotation matrix for the binocular center and the offset matrix for the binocular center comprises:

multiplying the rotation matrix for the binocular center and the offset matrix for the binocular center to obtain a conversion matrix for the binocular center of the user;

computing an inverse matrix of the conversion matrix for the binocular center to obtain the field of view matrix for the binocular center.

17 . The electronic device according to claim 9 , wherein the determining, according to the field of view matrix for the binocular center, field of view matrices for left and right eyes of the user comprises:

creating a homogeneous offset matrix based on an interpupillary distance of the user;

determining, according to the homogeneous offset matrix and the field of view matrix for the binocular center, the field of view matrices for the left and right eyes.

18 . The electronic device according to claim 17 , wherein the creating a homogeneous offset matrix based on an interpupillary distance of the user comprises:

determining, based on an interpupillary distance of the user, displacements required to be offset for the left and right eyes;

creating, using the displacements required to be offset for the left and right eyes, the homogeneous offset matrix.

19 . The electronic device according to claim 17 , wherein the determining, according to the homogeneous offset matrix and the field of view matrix for the binocular center, the field of view matrices for the left and right eyes comprises:

multiplying the field of view matrix for the binocular center and the homogeneous offset matrix, to obtain the field of view matrices for the left and right eyes.

20 . The electronic device according to claim 9 , wherein the generating, according to the field of view information and the planar image, a left eye image and a right eye image at a same timestamp comprises: