IP Library Granted Patent US 11,635,628
Granted Patent B2
US 11,635,628 · App. 16/296,258 · Granted Apr 25, 2023

Augmented reality display system and display method thereof

Inventors: Shin-Hong Kuo (New Taipei, TW); Yi-Shou Tsai (Taipei, TW); Yu-Hsiang Tsai (Hsinchu County, TW); Kuo-Ping Chang (Taoyuan, TW); Kuan-Ting Chen (Yunlin County, TW)
Assignees: Industrial Technology Research Institute; Intellectual Property Innovation Corporation
G02B27/0176G02B3/0037G02B3/0062G02B3/08G02B9/12G02B27/017G02B27/0172G02B27/095G02B27/0961G02B27/0966G06T19/006H04W4/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,635,628
App. No.
16/296,258
Granted
Apr 25, 2023
Kind
B2
Abstract

An augmented reality display system including an input unit, an operation processing unit and an output unit is provided. The input unit is configured to obtain an environment information. The operation processing unit is configured to operate and process the environment information provided by the input unit to generate an output information. The output unit is configured to transmit the output information provided by the operation processing unit to a user. The output unit includes at least one display module. The at least one display module includes a transparent display, a first lens having a negative refractive power, a second lens having a negative refractive power and a third lens having a positive refractive power arranged in sequence from a display side to an eye side. An augmented reality display method is also provided.

Claims (45)

1. An augmented reality display system, comprising:

an input unit, configured to obtain an environment information;

an operation processor, configured to operate and process the environment information provided by the input unit to generate an output information, wherein the operation processor determines a display sequence, a display size, a display brightness, and a display color of the output information according to an importance weight; and

an output unit, configured to transmit the output information provided by the operation processor to a user, the output unit comprising:

at least one display module, comprising a transparent display, a first lens having a negative refractive power, a second lens having a negative refractive power, and a third lens having a positive refractive power arranged in sequence from a display side to an eye side, wherein the first lens is disposed between the transparent display and the second lens; the second lens is disposed between the first lens and the third lens; the third lens is disposed between the second lens and an eye of the user,

wherein the transparent display of the at least one display module is configured to emit a light beam, and the light beam is incident into eyes of the user on the eye side through the first lens, the second lens and the third lens in sequence so that the eyes see an augmented reality image located on the display side, and light from a background penetrates through the transparent display, the first lens, the second lens, and the third lens in sequence, and is then transmitted to the eyes, and the transparent display is cemented to the first lens to form an optical component. and

wherein the output unit is disposed on a motorcycle helmet, and the output information comprises vehicle approach warning information, road warning information, intersection sign information, vehicle speed, engine speed, navigation information, inter-vehicle communication warnings of road and car conditions in vehicle network, weather information, time information, calls and mails display, information regarding Internet of Things, smart city sharing information or a combination thereof.

2. The augmented reality display system of claim 1 , wherein the input unit comprises a signal receiving module, a built-in database, a sensing module, or a combination thereof.

3. The augmented reality display system of claim 1 , wherein the output unit further comprises an information transmitter configured to provide the output information to a vehicle network.

4. The augmented reality display system of claim 1 , wherein the first lens, the second lens or the third lens is a Fresnel lens.

5. The augmented reality display system of claim 1 , wherein the at least one display module has flexibility.

6. The augmented reality display system of claim 1 , wherein the input unit and the operation processor are disposed on a transportation vehicle.

7. The augmented reality display system of claim 1 , wherein the input unit and the operation processor are disposed on a mobile device.

8. The augmented reality display system of claim 1 , wherein the output unit further comprises a frame such that the transparent display, the first lens, the second lens, and the third lens are disposed within the frame along an arrangement direction.

9. The augmented reality display system of claim 8 , further comprising:

a first connector; and

a second connector, wherein a first end of the first connector and a second end of the second connector are rotatably connected to opposite ends of the frame through a first joint and a second joint respectively, and a third end of the first connector and a fourth end of the second connector are rotatably connected to a first absorber and a second absorber through a third joint and a fourth joint respectively, wherein the frame is adsorbed on a surface of a carrier through the first absorber and the second absorber.

10. The augmented reality display system of claim 9 , wherein the first absorber and the second absorber are magnetic elements or suction cups.

11. The augmented reality display system of claim 9 , wherein the first joint, the second joint, the third joint, and the fourth joint are ball joints.

12. The augmented reality display system of claim 8 , further comprising an elastic element, wherein the frame has a locking portion, the frame makes the locking portion of the frame to be locked in at least one locking space on one side of a slideway after moving along the slideway through the locking portion and the slideway on a receiving portion of a carrier, and the frame makes the locking portion to be abutted in the at least one locking space through an elastic deformation force of the elastic element in the receiving portion.

13. An augmented reality display method, comprising:

obtaining an environment information through an input unit;

transmitting the environment information to an operation processor;

operating and processing the environment information to generate an output information, wherein the operation processor determines a display sequence, a display size, a display brightness, and a display color of the output information according to an importance weight;

transmitting the output information to an output unit; and

providing the output information to a user, wherein the output unit provides a light beam corresponding to the output information through a transparent display, and the output unit transmits the light beam to eyes of the user through a first lens having a negative refractive power, a second lens having a negative refractive power and a third lens having a positive refractive power to generate an augmented reality image, wherein the transparent display, the first lens, the second lens, and the third lens are arranged in sequence from a display side to an eye side; the first lens is disposed between the transparent display and the second lens; the second lens is disposed between the first lens and the third lens; the third lens is disposed between the second lens and an eye of the user; light from a background penetrates through the transparent display, the first lens, the second lens, and the third lens in sequence, and is then transmitted to the eyes; the transparent display is cemented to the first lens to form an optical component;

wherein the output unit is disposed on a motorcycle helmet, and the output information comprises vehicle approach warning information, road warning information, intersection sign information, vehicle speed, engine speed, navigation information, inter-vehicle communication warnings of road and car conditions in vehicle network, weather information, time information, calls and mails display, information regarding Internet of Things, smart city sharing information or a combination thereof.

14. The augmented reality display method of claim 13 , wherein the step of obtaining the environment information comprises:

obtaining a receiving information through a signal receiving module;

obtaining a sensing signal through a sensing module; and

importing the receiving information and the sensing signal into a built-in database for comparison to obtain the environment information.

15. The augmented reality display method of claim 13 , wherein the step of operating and processing the environment information to generate the output information comprises:

determining whether the environment information needs to be provided to the user,

if yes, determining an importance of the output information, and determining a display sequence, a display size, a display brightness, and a display color of the output information according to the importance weight, and transmitting the environment information back to a vehicle network through the output unit,

if not, the environment information is not provided to the user.

16. The augmented reality display method of claim 15 , wherein the output unit transmits the environment information back to the vehicle network through an information transmitter.

17. An augmented reality display system, comprising:

an input unit, configured to obtain an environment information;

an operation processor, configured to operate and process the environment information provided by the input unit to generate an output information, wherein the operation processor determines a display sequence, a display size, a display brightness, and a display color of the output information according to an importance weight; and

an output unit, configured to transmit the output information provided by the operation processor to a user, the output unit comprising:

at least one display module, comprising a transparent display, a first lens having a negative refractive power, a second lens having a negative refractive power, and a third lens having a positive refractive power arranged in sequence from a display side to an eye side, wherein the first lens is disposed between the transparent display and the second lens; the second lens is disposed between the first lens and the third lens; the third lens is disposed between the second lens and an eye of the user; each of the first lens and the second lens is a cylindrical Fresnel lens having a Fresnel surface having a plurality of strip teeth; the third lens is a cylindrical lens,

wherein the transparent display of the at least one display module is configured to emit a light beam, and the light beam is incident into eyes of the user on the eye side through the first lens, the second lens and the third lens in sequence so that the eyes see an augmented reality image located on the display side, and light from a background penetrates through the transparent display, the first lens, the second lens, and the third lens in sequence, and is then transmitted to the eyes, and the transparent display is cemented to the first lens to form an optical component.

18. The augmented reality display system of claim 17 , wherein the output unit is disposed on a sport helmet, and the output information comprises the user's physiological data, global positioning system (GPS) map information, sports information, weather information, time information, calls and mails display, information regarding Internet of Things or a combination thereof.

19. The augmented reality display system of claim 17 , wherein the output unit is disposed on an industrial helmet, and the output information comprises a work station monitoring data, a working environment monitoring information, a time information, a calls and mails display, an industrial internet information or a combination thereof.

20. The augmented reality display system of claim 17 , wherein the output unit is disposed on a telescope, and the output information comprises a GPS map information, a time information or a combination thereof.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2019
From: KUO, SHIN-HONG; TSAI, YI-SHOU; TSAI, YU-HSIANG; CHANG, KUO-PING; CHEN, KUAN-TING
To: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE; INTELLECTUAL PROPERTY INNOVATION CORPORATION
Reel/Frame 048566/0692 →
Continuity (3)
Provisional Application 62642613 · Mar 14, 2018
Provisional Application 62640578 · Mar 9, 2018
Related Publication 20190278092A1 · Sep 12, 2019