IP Library Granted Patent US 11,442,534
Granted Patent B1
US 11,442,534 · App. 17/226,342 · Granted Sep 13, 2022

Smart glasses system

Inventors: Robert Edwin Douglas (Winter Park, FL); Kathleen Mary Douglas (Winter Park, FL); David Byron Douglas (Winter Park, FL)
Assignee: RED PACS, LLC
G06F3/011A61B6/462A61B6/463A61B6/547A61B34/20A61B90/361A61B1/0004A61B1/00048A61B1/00055
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,442,534
App. No.
17/226,342
Granted
Sep 13, 2022
Kind
B1
Abstract

A physician performing a physical examination can miss subtle abnormalities, such as alterations of respiratory rate or dangerous skin lesion. A surgeon performing surgery can miss small areas of bleeding or tumor implants. This invention comprises head display unit comprising sensors including low light level TV (L3TV) cameras that gather data and in real time analyzes the data for potential hazards and alerts the user of a potential hazardous scenario.

Claims (74)

1. A head display unit (HDU) comprising:

a processor;

a first camera located on a first viewing position on said HDU configured to image an area;

a second camera located on a second viewing position on said HDU configured to image said area wherein said second camera is separated from said first camera by a distance;

a left eye display operably connected to the processor;

a right eye display operably connected to the processor;

a GPS;

an orientation sensor; and

a non-transitory memory having computer-executable instructions stored thereupon which, when executed by the processor of the HDU, cause the HDU to:

use said GPS to obtain a GPS coordinate of said HDU at time points,

use said orientation sensor to obtain a viewing angle of said HDU at said time points;

use said first camera to perform imaging of said area at said time points;

use said second camera to perform imaging of said area at said time points;

for said time points, use said GPS coordinate, said viewing angle, said imaging of said area by said first camera, said imaging of said area by said second camera to generate a dataset wherein said dataset represents said area,

for a stored time point from said time points in said dataset, use a left eye image of said dataset wherein said left eye image is based on a GPS coordinate of said HDU at said stored time point, a viewing angle at said stored time point and an image from said first camera at said stored time point;

for said stored time point from said time points in said dataset, use a right eye image of said dataset wherein said right eye image is based on said GPS coordinate of said HDU at said stored time point, said viewing angle at said stored time point and an image from said second camera at said stored time point;

display said left eye image on said left eye display; and

display said right eye image on said right eye display.

2. The HDU of claim 1 further comprising performing an analysis of said dataset to predict if an adverse event scenario is present.

3. The HDU of claim 2 further comprising wherein said adverse event scenario includes at least one of a group of:

a dangerous observation during surgery;

a dangerous observation during driving;

a dangerous event when walking;

a household scenario;

a sports scenario; and

an occupation scenario.

4. The HDU of claim 1 further comprising use by at least one of a group of:

a plumber;

a forest ranger;

an electrician;

a surveyor;

an emergency medical technician;

a security personnel; and

a mechanic.

5. The HDU of claim 1 further comprising wherein said first camera comprises a low light level TV (L3TV) camera and said second camera comprises a L3TV camera.

6. The HDU of claim 1 further comprising wherein said first camera comprises a forward looking infrared (FLIR) camera and said second camera comprises a FLIR camera.

7. The HDU of claim 1 further comprising wherein said left eye image displayed on said left eye display and said right eye image displayed on said right eye display digitally brighten the scene.

8. The HDU of claim 1 further comprising wherein said left eye image displayed on said left eye display and said right eye image displayed on said right eye display are zoomed.

9. The HDU of claim 1 further comprising at least one of a group of:

a laser range finder wherein said laser range finder is used in conjunction with said first camera and said second camera to generate said 3D dataset wherein said 3D dataset comprises voxels; and

a lidar device wherein said lidar device is used in conjunction with said first camera and said second camera to generate said 3D dataset wherein said 3D dataset comprises voxels.

10. The HDU of claim 9 further comprising using one of a group of:

an inertial measurement unit in conjunction with said laser range finder or said lidar device to generate said 3D dataset;

an inclinometer in conjunction with said laser range finder or said lidar device to generate said 3D dataset; and

a GPS in conjunction with said laser range finder or said lidar device to generate said 3D dataset.

11. A method comprising:

performing imaging of an area using a first camera located on a left side of a head display unit (HDU) configured to be in proximity to a left eye of a user wearing said HDU at time points wherein said HDU comprises a GPS system and an orientation sensor;

performing imaging of said area using a second camera located on a right side of said HDU configured to be in proximity to a right eye of said user wearing said HDU at said time points wherein said second camera is separated from said first camera by a distance;

using said GPS to obtain a GPS coordinate of said HDU at said time points;

using said orientation sensor to obtain a viewing angle of said HDU at said time points;

for said time points, using said GPS coordinate, said viewing angle, said imaging of said are from said first camera and, said imaging of said area from said second camera to generate a dataset wherein said dataset represents said area;

for a stored time point from said time points, using a left eye of said dataset wherein said left eye image is based on a GPS coordinate of said HDU at said stored time point, a viewing angle at said stored time point and an image from said first camera at said stored time point;

for said stored time points, using a right eye image of said dataset wherein said right eye image is based on said GPS coordinate of said HDU at said stored time points, said viewing angle at said stored time point and an image from said second camera at said stored time point;

displaying said left eye image onto a left eye display of said HDU; and

displaying said right eye image onto a right eye display of said HDU.

12. The method of claim 11 further comprising generating a scenario database comprising:

a list of adverse event scenarios; and

imaging finding(s) corresponding to each adverse event scenario in said list of adverse event scenarios.

13. The method of claim 12 further comprising analyzing said generated dataset to determine if there is an imaging finding in relation to said scenario database.

14. The method of claim 13 further comprising wherein said analysis uses computer aided detection (CAD) algorithm or an artificial intelligence algorithm.

15. The method of claim 13 further comprising if said imaging finding is present, presenting a notification to said user.

16. The method of claim 15 further comprising wherein said notification to said user comprises at least one of a group of:

a visual notification presented on said HDU; and

an auditory notification presented by speaker(s) on said HDU.

17. The method of claim 11 further comprising using a lidar device to generate metric data to be used in conjunction with imagery from said first camera located on said left side of said HDU and with imagery from said second camera located on said right side of said HDU.

18. The method of claim 17 further comprising displaying metric data to said user onto at least one of a group of:

said left eye display of said HDU; and

said right eye display of said HDU.

19. The method of claim 11 further comprising using at least one of a group of:

an inertial measurement unit in conjunction with a laser range finder or a lidar device to generate said dataset;

an inclinometer in conjunction with a laser range finder or a lidar device to generate said dataset;

a laser range finder in conjunction with said first camera and said second camera to generate said dataset; and

a lidar device in conjunction with said first camera and said second camera to generate said dataset.

20. The method of claim 19 further comprising wherein a relationship between said first camera and said second camera is adjustable.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE SU PATENT APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 058667 FRAME: 0058. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 21, 2022
From: DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON; DOUGLAS, KATHLEEN MARY
To: RED PACS, LLC
Reel/Frame 058803/0854 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2022
From: DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON; DOUGLAS, KATHLEEN MARY
To: RED PACS, LLC
Reel/Frame 058667/0058 →
Continuity (4)
Continuation In Part 16828352 · Mar 24, 2020
Continuation In Part 16509592 · Jul 12, 2019
Continuation In Part 15949202 · Apr 10, 2018
Provisional Application 62813509 · Mar 4, 2019
Cited By (2)
US 12,192,284 US 12,450,760