Augmented reality glasses for medical applications and corresponding augmented reality system
The invention describes augmented reality glasses ( 1 ) for medical applications configured to be worn by a user, comprising a frame ( 15 ) that supports a glasses lens ( 2 a, 2 b ), wherein the frame ( 15 ) comprises an RGB lighting system comprising RGB-emitting devices ( 16 a, 16 b, 16 c ) configured to emit light beams (B 1 , B 2 , B 3 ); first optical systems ( 17 a, 17 b, 17 c ) configured to collimate at least partially said beams (B 1 , B 2 , B 3 ) into collimated beams (B 1 c ; B 2 c ; B 3 c ); wherein the frame ( 15 ) further comprises a display ( 3 ) configured to be illuminated by the RGB lighting system ( 16 ) by means of the collimated beams (B 1 c ; B 2 c ; B 3 c ); to receive first images (I) from a first processing unit ( 10 ); to emit the first images (I) as second images (IE 1 ) towards the glasses lens ( 2 a, 2 b ), wherein the lens ( 2 a, 2 b ) is configured to reflect the second images (IE 1 ) coming from the display ( 3 ) as images projected (IP) towards an internal zone ( 51 ) of the glasses corresponding to an eye position zone of the user who is wearing the glasses in a configuration for use of the glasses. The invention moreover describes an augmented reality system for medical applications on a user comprising the augmented reality glasses ( 1 ) of the invention, biomedical instrumentation ( 100 ) configured to detect biomedical and/or therapeutic and/or diagnostic data of a user and to generate first data (D 1 ) representative of operational parameters (OP_S) associated with the user, transmitting means ( 101 ) configured to transmit the first data (D 1 ) to the glasses ( 1 ); wherein the glasses ( 1 ) comprise a first processing unit ( 10 ) equipped with a receiving module ( 102 ) configured to receive the first data (D 1 ) comprising the operational parameters (OP_S) associated with the user.
1. Augmented reality glasses ( 1 ) configured to be worn by a user, wherein said glasses ( 1 ) comprise a frame ( 15 ) that supports a glasses lens ( 2 a , 2 b ), wherein said frame ( 15 ) comprises:
a) an RGB lighting system comprising:
1) at least one RGB-emitting device ( 16 a , 16 b , 16 c ) configured to emit a light beam (B 1 , B 2 , B 3 );
2) at least a first optical system ( 17 a , 17 b , 17 c ) configured to collimate at least partially said beam (B 1 , B 2 , B 3 ) received from the at least one RGB-emitting device ( 16 a , 16 b , 16 c ) into a collimated beam (B 1 c , B 2 c , B 3 c );
b) a display ( 3 ) configured to
1) be illuminated by said lighting system ( 16 ) by means of at least said collimated beam (B 1 c , B 21 c , B 31 c );
2) receive first images (I) from a first processing unit ( 10 );
3) emit said first images (I) as second images (IE 1 ) towards said glasses lens ( 2 a , 2 b );
c) wherein the lens ( 2 a , 2 b ) is configured to reflect the second images (IE 1 ) coming from reflecting means ( 3 ) as images (IP) projected towards an internal zone ( 51 ) of the glasses corresponding to an eye position zone of said user who is wearing said glasses in a configuration for use of the glasses;
wherein said lighting system ( 16 ) comprises at least a second optical systems ( 18 a , 18 b , 18 c ) configured to filter at least one of said collimated light beams (B 1 c , B 2 c , B 3 c ) in at least one of predetermined frequencies (f 1 , f 2 , f 3 ), determining at least one of three sub-beams (B 11 c , B 21 c , B 31 c ) and said display ( 3 ) is configured to be illuminated k y said lighting system ( 16 ) by means of at least one of said sub-beams (B 11 c , B 21 c , B 31 c ).
2. The glasses ( 1 ) according to claim 1 , wherein said RGB lighting system ( 16 ) is one system among the following:
a) an RGB LED lighting system;
b) an RGB laser diode system;
c) an RGB white LED system.
3. The glasses ( 1 ) according to claim 2 , wherein said frame ( 15 ) comprises an optical system ( 4 a , 4 b ) configured to:
a) receive said first images (I) from said display ( 3 );
b) process said images so as to create processed images (IE);
c) send said processed images (IE) towards reflecting elements ( 5 ) or towards said lens ( 2 a , 2 b ).
4. The glasses ( 1 ) according to claim 3 , wherein said reflecting elements ( 5 ) are configured to receive said processed images (IE) and reflect them at a first predefined angle (a) towards said glasses lens ( 2 a , 2 b ), so as to project said processed image (IE) on said glasses lens ( 2 a , 2 b ).
5. The glasses ( 1 ) according to claim 2 , wherein said display ( 3 ) comprises a beam splitter ( 3 a ) and it is realised as a reflecting element.
6. The glasses ( 1 ) according to claim 1 , wherein said frame ( 15 ) comprises an optical system ( 4 a , 4 b ) configured to:
a) receive said first images (I) from said display ( 3 );
b) process said images so as to create processed images (IE);
c) send said processed images (IE) towards reflecting elements ( 5 ) or towards said lens ( 2 a , 2 b ).
7. The glasses ( 1 ) according to claim 6 , wherein said reflecting elements ( 5 ) are configured to receive said processed images (IE) and reflect them at a first predefined angle (a) towards said glasses lens ( 2 a , 2 b ), so as to project said processed image (IE) on said glasses lens ( 2 a , 2 b ).
8. The glasses ( 1 ) according to claim 1 , wherein said display ( 3 ) comprises a beam splitter ( 3 a ) and it is realised as a reflecting element.
9. The glasses ( 1 ) according to claim 1 , comprising two dichroic filters ( 19 ) which receive the light beams coming out of the second optical systems ( 18 a , 18 b , 18 c ).
10. The glasses ( 1 ) according to claim 1 , wherein said lens ( 2 a , 2 b ) is configured to reflect said second images (IE 1 ) or said processed images (IE) with an image (IP) projected towards an internal zone ( 51 ) of the glasses corresponding to an eye position zone of said user who is wearing said glasses, said projected image (IP) being projected along the visual axis (A-A) of the eyes of the user who is wearing said glasses in a configuration for use of the glasses.
11. The glasses ( 1 ) according to claim 1 , wherein said lens ( 2 , 2 b ) is realised as a semi-reflective mirror.
12. The glasses ( 1 ) according to claim 1 , wherein said lens ( 2 a , 2 b ) is realised as a holographic component.
13. The glasses ( 1 ) according to claim 12 , wherein said holographic component is monochromatic.
14. The glasses ( 1 ) according to claim 12 , wherein said holographic component is polychromatic.
15. The glasses according to claim 1 , wherein said lens ( 2 a , 2 b ) is made of nanostructured material and is based on surface plasmonic processes.
16. An augmented reality system for medical applications on a user, wherein the system comprises:
a) augmented reality glasses ( 1 ) according to claim 1 ;
b) biomedical instrumentation ( 100 ) configured to detect biomedical and/or therapeutic and/or diagnostic data of a user and to generate first data (D 1 ) representative of operational parameters (OP_S) associated with said user (S);
c) transmitting means ( 101 ) configured to transmit said first data (D 1 ) to said glasses ( 1 );
d) wherein said glasses ( 1 ) comprise a first processing unit ( 10 ) equipped with a receiving module ( 102 ) configured to receive said first data (D 1 ) comprising said operational parameters (OP_S) associated with said user.
17. The augmented reality system according to claim 16 , wherein said operational parameters (OP_S) comprise one or more among diagnostic parameters, clinical parameters in text or graphic form, vital parameters, technical parameters related to instrument settings, biological parameters, clinical information concerning the patient and similar data.
18. The augmented reality system according to claim 16 , further comprising a second processing unit ( 80 ) comprising:
a) a receiving module ( 81 ) configured to receive said first data (D 1 ) representative of operational parameters (OP_S);
b) a display module ( 82 ) configured to display said first data (D 1 ) on said display ( 3 ) in such a manner that the data are projected at the centre of the lens ( 2 a , 2 b );
c) a command module ( 83 ) configured to receive second data (D 2 ) representative of a position on said lens ( 2 a , 2 b ) where said first data (D 1 ) must be displayed;
d) a positioning module ( 84 ) configured to project said first data (D 1 ) on said lens in a given position based on said received second data (D 2 ).
19. The system according to claim 18 , wherein said first processing unit ( 10 ) comprises said second processing unit ( 80 ).
20. The augmented reality system according to claim 16 , comprising a command unit ( 90 , 91 ) associated with said processing unit ( 80 ), wherein said command unit is configured to generate said second data (D 2 ) representative of a position on said lens ( 2 a , 2 b ) where said first data (D 1 ) must be displayed.
21. The augmented reality system according to claim 20 , wherein said command unit ( 90 ) comprises a voice command receiver ( 90 ).
22. The augmented reality system according to claim 20 , wherein said command unit ( 91 ) comprises a mouse ( 91 ).
23. The augmented reality system according to claim 16 , wherein said biomedical instrumentation ( 100 ) comprises one or more among:
a) PACS systems (picture archiving and communication system);
b) surgical navigators;
c) endoscopes;
d) integrated operating room systems that collect the patient's vital parameters and the surgical instrument settings;
e) integrated systems for collecting the patient's clinical data and vital parameters for use outside the operating room;
f) surgical simulators for educational activities.
24. The augmented reality system according to claim 16 , wherein said transmitting means ( 101 ) is configured to transmit said first data (D 1 ) to said glasses ( 1 ), particularly to the receiving module ( 102 ) of the first processing unit ( 10 ), comprises a data connector.
25. The augmented reality system according to claim 16 , wherein said transmitting means ( 101 ) configured to transmit said first data (D 1 ) to said glasses ( 1 ), particularly to the receiving module ( 102 ) of the first processing unit ( 10 ), comprises a wireless transmitter.