IP Library › Granted Patent US 10,955,678
Granted Patent B2
US 10,955,678 · App. 16/560,212 · Granted Mar 23, 2021

Field of view enhancement via dynamic display portions

Inventors: Mohamed Abou Shousha (Pembroke Pines, FL); Ahmed Sayed (Miami, FL)
Assignee: University of Miami
G02B27/0172A61B3/0091A61B3/024A61B3/113G02B27/017G02B27/0179G02B2027/014G02B2027/0123G02B2027/0138G02B2027/0141G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,955,678
App. No.
16/560,212
Granted
Mar 23, 2021
Kind
B2
Abstract

In certain embodiments, enhancement of a field of view of a user may be facilitated via one or more dynamic display portions. In some embodiments, one or more changes related to one or more eyes of a user may be monitored. Based on the monitoring, one or more positions of one or more transparent display portions of wearable device may be adjusted, where the transparent display portions enable the user to see through the wearable device. A live video stream representing an environment of the user may be obtained via the wearable device. A modified video stream derived from the live video stream may be displayed on one or more other display portions of the wearable device.

Claims (40)

1. A system for facilitating enhancement of a field of view of a user via one or more dynamic display portions, the system comprising:

a computer system that comprises one or more processors executing computer program instructions that, when executed, cause the computer system to:

monitor one or more changes related to one or more eyes of a user while the user is wearing a wearable device that is capturing a live video stream, the user having a visual field comprising one or more defective visual field portions;

obtain, based on the one or more monitored changes related to the one or more eyes, one or more modification parameters related to adjusting transparency of a display to accommodate the one or more defective visual field portions;

cause, based on the one or more modification parameters, an adjustment of one or more positions, shapes, or sizes of one or more transparent display portions of the wearable device such that the one or more transparent display portions avoid overlapping with the one or more defective visual field portions, the one or more transparent display portions enabling the user to see through the wearable device; and

cause a modified video stream derived from the live video stream to be displayed on one or more other display portions of the wearable device.

2. The system of claim 1 , wherein causing the adjustment comprises causing, based on the one or more modification parameters, an adjustment of at least one position of the one or more transparent display portions of the wearable device.

3. The system of claim 1 , wherein causing the adjustment comprises causing, based on the one or more modification parameters, an adjustment of at least one shape of the one or more transparent display portions of the wearable device.

4. The system of claim 1 , wherein causing the adjustment comprises causing, based on the one or more modification parameters, an adjustment of at least one size of the one or more transparent display portions of the wearable device.

5. The system of claim 1 , wherein the one or more defective visual field portions are determined to fail to satisfy one or more vision criteria.

6. The system of claim 1 , wherein the one or more monitored changes comprises an eye movement, a change in gaze direction, or a pupil size change.

7. The system of claim 1 , wherein the computer system is caused to:

generate the modified video stream based on the live video stream and the one or more monitored changes related to the one or more eyes.

8. The system of claim 1 , wherein the computer system is a wearable computer system comprising the one or more processors executing the computer program instructions that, when executed, cause the wearable computer system to perform all the foregoing operations.

9. A method being implemented by one or more processors executing computer program instructions that, when executed, perform the method, the method comprising:

monitoring one or more changes related to one or more eyes of a user while the user is wearing a wearable device that is capturing a live video stream, the user having a visual field comprising one or more defective visual field portions;

obtaining, based on the one or more monitored changes, one or more modification parameters related to adjusting transparency of a display to accommodate the one or more defective visual field portions;

causing, based on the one or more modification parameters, an adjustment of one or more transparent display portions of a wearable device such that the one or more transparent display portions avoid overlapping with the one or more defective visual field portions, the one or more transparent display portions enabling the user to see through the wearable device; and

causing a modified video stream derived from the live video stream to be displayed on one or more other display portions of the wearable device such that modified video stream is presented around the one or more transparent display portions.

10. The method of claim 9 , wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more positions of the one or more transparent display portions of the wearable device.

11. The method of claim 9 , wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more shapes of the one or more transparent display portions of the wearable device.

12. The method of claim 9 , wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more sizes of the one or more transparent display portions of the wearable device.

13. The method of claim 9 , wherein the one or more monitored changes comprises an eye movement, a change in gaze direction, or a pupil size change.

14. The method of claim 9 , further comprising:

generating the modified video stream based on the live video stream and the one or more monitored changes related to the one or more eyes.

15. The method of claim 9 , further comprising:

providing, to a prediction model, feedback related to a set of stimuli displayed to the user, the feedback indicating whether or how the user senses one or more stimuli, the prediction model being configured based on the feedback related to the set of stimuli;

providing the one or more monitored changes related to the one or more eyes to the prediction model to obtain the one or more modification parameters; and

generating the modified video stream based on (i) the live video stream and (ii) the one or more modification parameters.

16. The method of claim 9 , further comprising:

providing, to a prediction model, feedback related to a set of stimuli displayed to the user, the feedback indicating whether or how the user senses one or more stimuli, the prediction model being configured based on the feedback related to the set of stimuli; and

providing the one or more monitored changes related to the one or more eyes to the prediction model to obtain the one or more modification parameters.

17. One or more non-transitory computer-readable media comprising instructions that, when executed by one or more processors, cause operations comprising:

monitoring one or more changes related to one or more eyes of a user while the user is wearing a wearable device that is capturing a live video stream, the user having a visual field comprising one or more defective visual field portions;

obtaining, based on the one or more monitored changes, one or more modification parameters related to adjusting transparency of a display to accommodate the one or more defective visual field portions;

causing, based on the one or more modification parameters, an adjustment of one or more transparent display portions of a wearable device such that the one or more transparent display portions avoid overlapping with the one or more defective visual field portions; and

causing a modified video stream derived from the live video stream to be displayed on one or more other display portions of the wearable device.

18. The one or more non-transitory computer-readable media of claim 17 , wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more positions of the one or more transparent display portions of the wearable device.

19. The one or more non-transitory computer-readable media of claim 17 , wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more shapes of the one or more transparent display portions of the wearable device.

20. The one or more non-transitory computer-readable media of claim 17 , wherein causing the adjustment of the one or more transparent display portions comprises causing, based on the one or more modification parameters, an adjustment of one or more sizes of the one or more transparent display portions of the wearable device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: ABOU SHOUSHA, MOHAMED; SAYED, AHMED
To: UNIVERSITY OF MIAMI
Reel/Frame 050264/0762 →
Continuity (5)
Continuation 16428380 · May 31, 2019
Continuation 16367751 · Mar 28, 2019
Continuation In Part 16144995 · Sep 27, 2018
Provisional Application 62563770 · Sep 27, 2017
Related Publication 20190391398A1 · Dec 26, 2019
Cited By (1)
US 12,446,770