IP Library Granted Patent US 9,983,546
Granted Patent B2
US 9,983,546 · App. 14/415,603 · Granted May 29, 2018

Display apparatus and visual displaying method for simulating a holographic 3D scene

Inventors: Meihong Liu (Shenzhen, CN); Wei Gao (Shenzhen, CN)
Assignee: SHENZHEN MAGIC EYE TECHNOLOGY CO., LTD.
G03H1/0866G02B27/225G03H1/0005H04N13/0207H04N13/0409H04N13/0484G03H2001/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,983,546
App. No.
14/415,603
Granted
May 29, 2018
Kind
B2
Abstract

A display apparatus and a visual displaying method for simulating a holographic 3D scene are provided. The display apparatus comprises: a display screen; two front-facing 3D cameras, being configured to capture human-eye 3D position information; a 3D human-eye tracking algorithm processing unit, being configured to generate a first signal and a second signal according to the human-eye 3D position information; a 3D scene generating unit, being configured to receive the first signal, render and acquire the corresponding left visual-channel 3D scene and the corresponding right visual-channel 3D scene according to the first signal; and an electronic grating, being configured to receive the second signal and adjust the working angle according to the second signal so that the left visual-channel 3D scene is incident into the left eye of the user and the right visual-channel 3D scene is incident into the right eye of the user.

Claims (23)

1. A display apparatus for simulating a holographic three-dimensional (3D) scene, comprising:

a display screen;

a first front-facing camera and a second front-facing camera, wherein the first front-facing camera is disposed at an upper-left corner of the display screen, the second front-facing camera is disposed at an upper-right corner of the display screen, and the first front-facing camera and the second front-facing camera are adapted to capture user-eye 3D position information;

a 3D user-eye tracking algorithm processor electrically connected to the first front-facing camera and the second front-facing camera, being configured to, according to the user-eye 3D position information, generate a first signal for controlling a 3D scene generator to generate 3D scenes corresponding to a left visual channel and a right visual channel respectively, and generate a second signal for controlling a working angle of an electronic grating;

the 3D scene generator, being electrically connected to the display screen and configured to receive the first signal, render and acquire the corresponding left visual-channel 3D scene and the corresponding right visual-channel 3D scene according to the first signal, and transmit the left visual-channel 3D scene and the right visual-channel 3D scene to the display screen for displaying; and

the electronic grating, being configured to receive the second signal and adjust the working angle according to the second signal so that the left visual-channel 3D scene is incident into a left eye of a user and the right visual-channel 3D scene is incident into a right eye of the user;

wherein the first front-facing camera is configured to acquire a left-eye format picture of the left and right eyes of the user, the second front-facing camera is configured to capture a right-eye format picture of the left and right eyes of the user, the 3D user-eye tracking algorithm processor calculates an angle α between a projection of a first connection line, which connects a midpoint between the left and right eyes and a center point of the display screen, on an XY plane of a spatial rectangular coordinate system O-XYZ and a Y axis, and calculates an angle β between the first connection line, which connects the midpoint between the left and right eyes and the center point of the display screen, and the projection of the first connection line on the XY plane, wherein the first connection line is projected to the XY plane at a right angle, and wherein each of the angle α and angle β is calculated according to differences between positions of the left and right eyes of the user in the left-eye format picture and those in the right-eye format picture;

wherein an origin O of the spatial rectangular coordinate system O-XYZ is located at the center point of the display screen, an X axis of the spatial rectangular coordinate system O-XYZ is parallel to a second connection line that connects a center point of a left edge and a center point of a right edge of the display screen, and the Y axis of the spatial rectangular coordinate system O-XYZ is parallel to a third connection line that connects a center point of a top edge and a center point of a bottom edge of the display screen.

2. The display apparatus of claim 1 , wherein the first signal is a signal comprising the parameters α and β, and the second signal is a signal comprising the parameter α.

3. The display apparatus of claim 2 , wherein the 3D scene generator controls a scene rendering camera to move to a position corresponding to the parameters α and β, then controls the scene rendering camera to move leftwards by an x distance to render and acquire the left visual-channel 3D scene, and then moves the scene rendering camera rightwards by a 2× distance to render and acquire the right visual-channel 3D scene; wherein the parameter x is a preset parameter related to the depth of field.

4. The display apparatus of claim 2 , wherein the electronic grating comprises: a first glass plate, a second glass plate, a liquid crystal layer and a controller, the first glass plate is provided with a first polarizer on a first surface thereof and a first ITO conductive layer on a second surface thereof that is opposite to the first polarizer, the second glass plate is provided with a second polarizer on a first surface thereof and a second ITO conductive layer on a second surface thereof that is opposite to the second polarizer, the first polarizer has a polarization direction perpendicular to that of the second polarizer, the second ITO conductive layer comprises a plurality of ITO electrodes arranged at equal intervals and black insulation bars disposed between adjacent ones of the ITO electrodes, the liquid crystal layer is sandwiched between the first ITO conductive layer and the second ITO conductive layer, the controller is configured to control ON/OFF of an alternating current (AC) voltage between the first ITO conductive layer and each of the ITO electrodes according to the second signal so that bright and dark stripes of the grating change in position adaptively to adapt to the user-eye position and, thus, the left visual-channel 3D scene displayed on the display screen is incident into the left eye of the user via the electronic grating and the right visual-channel 3D scene displayed on the display screen is incident into the right eye of the user via the electronic grating.

5. The display apparatus of claim 1 , wherein the display apparatus is a computer.

6. The display apparatus of claim 1 , wherein the display apparatus is a mobile phone.

7. A visual displaying method for simulating a holographic three-dimensional (3D) scene, comprising:

capturing user-eye 3D position information of eyes of a user;

calculating spatial coordinates of the eyes of the user according to the user-eye 3D position information;

rendering and acquiring a corresponding left visual-channel 3D scene and a corresponding right visual-channel 3D scene according to the spatial coordinates of the eyes of the user, and transmitting the left visual-channel 3D scene and the right visual-channel 3D scene to a display screen for displaying; and

adjusting a working angle of an electronic grating according to the spatial coordinates of the eyes of the user so that the left visual-channel 3D scene displayed on the display screen is incident into the left eye of the user via the electronic grating and the right visual-channel 3D scene displayed on the display screen is incident into the right eye of the user via the electronic grating;

wherein the step of calculating spatial coordinates of the eyes of the user according to the 3D position information of the eyes of the user comprises:

calculating an angle α between a projection of a first connection line, which connects a midpoint between the left and right eyes and a center point of the display screen, on an XY plane of a spatial rectangular coordinate system O-XYZ and a Y axis, and calculating an angle β between the first connection line, which connects the midpoint between the left and right eyes and the center point of the display screen, and the projection of the first connection line on the XY plane, wherein the first connection line is projected to the XY plane at a right angle, and wherein each of the angle α and angle β is calculated according to differences between positions of the left and right eyes of the user in a left-eye format picture of the left and right eyes of the user and those in a right-eye format picture of the left and right eyes of the user;

wherein an origin O of the spatial rectangular coordinate system O-XYZ is located at the center point of the display screen, an X axis of the spatial rectangular coordinate system O-XYZ is parallel to a second connection line that connects a center point of a left edge and a center point of a right edge of the display screen, and the Y axis of the spatial rectangular coordinate system O-XYZ is parallel to a third connection line that connects a center point of a top edge and a center point of a bottom edge of the display screen.

8. The visual displaying method of claim 7 , wherein the step of rendering and acquiring a corresponding left visual-channel 3D scene and a corresponding right visual-channel 3D scene according to the spatial coordinates of the eyes of the user, and transmitting the left visual-channel 3D scene and the right visual-channel 3D scene to the display screen for displaying comprises:

controlling a scene rendering camera to move to a position corresponding to the parameters α and β, then controlling the scene rendering camera to move leftwards by an x distance to render and acquire the left visual-channel 3D scene, and then moving the scene rendering camera rightwards by a 2× distance to render and acquire the right visual-channel 3D scene; wherein the parameter x is a preset parameter related to the depth of field.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2025
From: SHENZHEN SMART SUPERV CO., LTD.
To: SHENZHEN PUWEI INTELLIGENT TECHNOLOGY CO., LTD.
Reel/Frame 073515/0240 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2020
From: SHENZHEN MAGIC EYE TECHNOLOGY CO., LTD.
To: SHENZHEN SMART SUPERV CO., LTD.
Reel/Frame 054022/0180 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2017
From: SHENZHEN CLOUD CUBE INFORMATIONTECH CO., LTD.
To: SHENZHEN MAGIC EYE TECHNOLOGY CO., LTD.
Reel/Frame 041012/0279 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2015
From: LIU, MEIHONG; GAO, WEI
To: SHENZHEN CLOUD CUBE INFORMATIONTECH CO., LTD.
Reel/Frame 034741/0413 →
Priority Claims (1)
CN 2013 1 0094938 · Mar 22, 2013 · national
Continuity (1)
Related Publication 20150227112A1 · Aug 13, 2015