IP Library Granted Patent US 11,822,082
Granted Patent B2
US 11,822,082 · App. 16/925,083 · Granted Nov 21, 2023

AR display method, apparatus and device provided micro mirror array

Inventors: Zhenyu Gao (Qingdao, CN); Dongfeng Zhao (Qingdao, CN)
Assignee: GOER OPTICAL TECHNOLOGY CO., LTD.
G02B27/0172H04N13/332H04N13/344G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,822,082
App. No.
16/925,083
Granted
Nov 21, 2023
Kind
B2
Abstract

Provided are an AR display method, an AR display apparatus and an AR display device, the device including: a display assembly used for displaying a virtual content, an optical assembly, and a micro mirror array coupled to the optical assembly; the micro mirror array is located on a propagation path of light emitted from the display assembly.

Claims (54)

1. An AR display device, comprising:

a display assembly, an optical assembly, and a micro mirror array coupled to the optical assembly;

wherein:

the display assembly comprises a display screen, and the display screen comprises a plurality of effective display areas for displaying a virtual content;

the micro mirror array comprises a plurality of micro mirror units;

the micro mirror array is located on a propagation path of light emitted from the display assembly;

the micro mirror array receives the light emitted from the display assembly, then reflects the light forward the eye of a wearer;

a matrix parameter of the plurality of effective display areas on the display screen is the same as a matrix parameter of the micro mirror array, and each effective display area is located within a circular area on the display screen corresponding to a field of view of a corresponding micro mirror unit in the micro mirror array, respectively;

the display assembly further comprises a projection assembly, and the projection assembly is located between the display screen and the micro mirror array; and

a scaling coefficient of the projection assembly satisfies that a matrix spacing corresponding to a plurality of effective projection areas after being projected via the projection assembly is less than or equal to a matrix spacing of the micro mirror array.

2. The device according to claim 1 , the optical assembly comprises: a first lens and a second lens that are cemented; and the micro mirror array is disposed on a cemented interface between the first lens and the second lens, and a reflection surface of the micro mirror array is close to the human eye.

3. The device according to claim 2 , the plurality of micro mirror units comprises:

a plurality of micro mirrors or a plurality of micro reflection films attached to the cemented interface according to the matrix parameter and a matrix spacing, or a microstructure etched on the cemented interface and coated with a reflection film.

4. The device according to claim 3 , an aperture of the micro mirrors, the micro reflection films or the microstructure is 100 μm-2 mm.

5. The device according to claim 2 , an angle between the cemented interface and a front surface on the first lens close to the human eye is an acute angle;

the display assembly is disposed outside an end of the first lens, the light emitted from the display assembly is incident on the micro mirror array through the end of the first lens, and is reflected toward the human eyes through the micro mirror array.

6. The device according to claim 5 , the end surface of the first lens is perpendicular to a rear surface on the first lens away from the human eye and the front surface, and a light emitting surface of the display assembly is parallel to the end of the first lens; the light emitted from the display assembly reaches the micro mirror array through the end of the first lens, and is reflected toward the human eye through the micro mirror array; or,

the end of the first lens is inclined at an acute angle to the rear surface or the front surface of the first lens, and the light emitting surface of the display assembly is parallel to the end surface of the first lens; and the light emitted from the display assembly passes through the end face of the first lens, is transmitted in the first lens in a total reflection manner, reaches the micro mirror array, and is reflected toward the human eye through the micro mirror array.

7. The device according to claim 2 , wherein the first lens and the second lens are cemented in a direction along a line connecting a left eye and a right eye; or, the first lens and the second lens are cemented in a direction perpendicular to the line connecting the left eye and the right eye.

8. The device according to claim 1 , further comprising a frame used for fixing and making the AR display device easy to wear.

9. The device according to claim 8 , wherein the device comprises a left-eye AR display device and a right-eye AR display device; and

the frame comprises: an adjustable connection mechanism used for connecting the left-eye AR display device and the right of eye AR display device.

10. The device according to claim 1 , the plurality of micro mirror units are attached to the cemented interface according to a matrix parameter and a matrix spacing, or a microstructure etched on the cemented interface and coated with a reflection film.

11. An AR display method, comprising:

determining a matrix spacing of a plurality of effective projection areas after being projected via a projection assembly, according to a layout of a plurality of rectangular fields of view;

determining a matrix spacing of a plurality of effective display areas corresponding to the plurality of effective projection areas on a display screen, according to the matrix spacing corresponding to the plurality of effective projection areas and a scaling coefficient corresponding to the projection assembly;

determining a plurality of rectangular areas corresponding to a field of view of a micro mirror array on the display screen, according to the matrix spacing of a plurality of effective display areas, as the plurality of effective display areas; and

displaying a virtual content in the plurality of effective display areas;

wherein the layout of the plurality of rectangular fields of view comprises: the plurality of rectangular fields being disconnected or the plurality of rectangular fields being superimposed;

the determining the matrix spacing of the plurality of effective projection areas after being projected via the projection assembly, according to the layout of the plurality of rectangular fields of view, comprises:

when the layout is the plurality of rectangular fields being disconnected, determining that the matrix spacing corresponding to the plurality of effective projection areas obtained after projecting via the projection assembly is equal to a matrix spacing of the micro mirror array; or,

when the layout is the plurality of rectangular fields being superimposed, determining that the matrix spacing corresponding to the plurality of effective projection areas obtained after projecting via the projection assembly is less than the matrix spacing of the micro mirror array.

12. The method according to claim 11 , wherein the matrix spacing of the micro mirror array is 4 mm.

13. The method according to claim 11 , wherein the determining the plurality of rectangular areas corresponding to the field of view of the micro mirror array on the display screen, according to the matrix spacing of the plurality of effective display areas, comprises:

determining a circular area corresponding to a field of view of each micro mirror unit in the micro mirror array on the display screen, according to an optical parameter of the micro mirror array; and

determining a rectangular area in each of the circular area on the display screen, wherein a spacing between adjacent rectangular areas is equal to the matrix spacing of the effective display areas.

14. The method according to claim 13 , wherein the rectangular area determined in each of the circular area is inscribed in the circular area.

15. The method according to claim 11 , wherein the determining the plurality of rectangular areas corresponding to the field of view of the micro mirror array on the display screen, according to the matrix spacing of the plurality of effective display areas, as the plurality of effective projection areas, comprises:

determining a plurality of rectangular areas on the display screen with a length of a′=[a−y(M−1)]/M, a width of b′=[b−y(N−1)]/N, and a pairwise spacing of y, as the plurality of effective display areas;

wherein, a is a length of the display screen, b is a width of the display screen, a′∈(0, a], b′∈(0, b], y is the matrix spacing of the plurality of effective display areas, y max(a,b), and M is numbers of row of the micro mirror array, and N is numbers of column of the micro mirror array.

16. The method according to claim 15 , wherein after the determining the plurality of rectangular areas on the display screen with the length of a′=[a−y(M−1)]/M, the width of b′=[b−y(N−1)]/N, and the pairwise spacing of y, as the plurality of effective display areas, further comprises:

determining a circumscribed circle corresponding to each rectangular area in the plurality of rectangular areas, as the circular area corresponding to the field of view of each micro mirror unit in the micro mirror array on the display screen, respectively; and

determining the matrix spacing of the micro mirror array, according to the circular area corresponding to the field of view of each micro mirror unit in the micro mirror array on the display screen and the optical parameter of the micro mirror array.

17. An AR display apparatus, comprising: a memory and a processor;

the memory is used to store one or more computer instructions;

the processor is used to execute the one or more computer instructions for:

determining a matrix spacing of a plurality of effective projection areas after being projected via a projection assembly, according to a layout of a plurality of rectangular fields of view;

determining a matrix spacing of a plurality of effective display areas corresponding to the plurality of effective projection areas on a display screen, according to the matrix spacing corresponding to the plurality of effective projection areas and a scaling coefficient corresponding to the projection assembly;

determining a plurality of rectangular areas corresponding to a field of view of a micro mirror array on the display screen, according to the matrix spacing of a plurality of effective display areas, as the plurality of effective display areas; and

displaying a virtual content in the plurality of effective display areas;

wherein the layout of the plurality of rectangular fields of view comprises: the plurality of rectangular fields being disconnected or the plurality of rectangular fields being superimposed;

the determining the matrix spacing of the plurality of effective projection areas after being projected via the projection assembly, according to the layout of the plurality of rectangular fields of view, comprises:

when the layout is the plurality of rectangular fields being disconnected, determining that the matrix spacing corresponding to the plurality of effective projection areas determined after projecting via the projection assembly is equal to a matrix spacing of the micro mirror array; or,

when the layout is the plurality of rectangular fields being superimposed, determining that the matrix spacing corresponding to the plurality of effective projection areas determined after projecting via the projection assembly is less than the matrix spacing of the micro mirror array.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2022
From: GOERTEK TECHNOLOGY CO., LTD.
To: GOER OPTICAL TECHNOLOGY CO., LTD.
Reel/Frame 062111/0828 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2020
From: GAO, ZHENYU; ZHAO, DONGFENG
To: GOERTEK TECHNOLOGY CO.,LTD.
Reel/Frame 053178/0044 →
Continuity (3)
Continuation PCTCN2018071951 · Jan 9, 2018
Continuation PCTCN2018071953 · Jan 9, 2018
Related Publication 20200341285A1 · Oct 29, 2020