IP Library › Patent Application 18897630
Patent Application
App. No. 18/897,630

USER INTERFACE TO SELECT FIELD OF VIEW OF A CAMERA IN A SMART GLASS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/897,630
Abstract

A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

Claims (47)

1 . (canceled)

2 . One or more non-transitory computer-readable media storing computer-readable instructions that, when executed by at least one processor, cause the at least one processor to execute operations comprising:

capturing image data from a first forward-looking camera disposed on a head-worn device, wherein the image data comprises a forward-image with a field of view;

determining, based on data from a sensor on the head-worn device, a gaze direction of a user of the device;

identifying a region of interest of the user, wherein the region of interest is identified based at least in part on the gaze direction of the user; and

providing an indication that the field of view of the first forward-looking camera is in misalignment with the region of interest, wherein the misalignment with the region of interest is determined based at least in part on a comparison of the region of interest to the field of view.

3 . The one or more non-transitory computer-readable media storing computer-readable instructions of claim 2 that, when executed by the at least one processor, cause the processor to execute operations further comprising:

identifying the gaze direction of the user based at least in part on a position of a pupil of the user.

4 . The one or more non-transitory computer-readable media storing computer-readable instructions of claim 2 that, when executed by the at least one processor, cause the processor to execute operations further comprising:

centering the region of interest on an object of interest, wherein the object of interest is determined based at least in part on the gaze direction.

5 . The one or more non-transitory computer-readable media storing computer-readable instructions of claim 2 that, when executed by the at least one processor, cause the processor to execute operations further comprising:

selecting a second forward-looking camera disposed on a frame of the device for capturing a second forward-image with a second field of view different from the field of view of the first forward-looking camera, wherein the second field of view at least partially corrects the misalignment with the region of interest.

6 . The one or more non-transitory computer-readable media storing computer-readable instructions of claim 2 that, when executed by the at least one processor, cause the processor to execute operations further comprising:

adjusting a position and/or an orientation of the first forward-looking camera to at least partially correct the misalignment with the region of interest.

7 . The one or more non-transitory computer-readable media storing computer-readable instructions of claim 2 ,

wherein the indication comprises an instruction to the user to move the first forward-looking camera.

8 . A method comprising

capturing image data from a first forward-looking camera disposed on a head-worn device, wherein the image data comprises a forward-image with a field of view;

determining, based on data from a sensor on the head-worn device, a gaze direction of a user of the device;

identifying a region of interest of the user, wherein the region of interest is identified based at least in part on the gaze direction of the user; and

providing an indication that the field of view of the first forward-looking camera is in misalignment with the region of interest, wherein the misalignment with the region of interest is determined based at least in part on a comparison of the region of interest to the field of view.

9 . The method of claim 8 , further comprising:

identifying the gaze direction of the user based at least in part on a position of a pupil of the user.

10 . The method of claim 8 , further comprising:

selecting a second forward-looking camera disposed on a frame of the device for capturing a second forward-image with a second field of view different from the field of view of the first forward-looking camera, wherein the second field of view at least partially corrects the misalignment with the region of interest.

11 . The method of claim 10 , further comprising:

instructing the user to move the first forward-looking camera.

12 . The method of claim 8 , further comprising:

adjusting a position and/or an orientation of the first forward-looking camera to at least partially correct the misalignment with the region of interest.

13 . The method of claim 8 , further comprising:

centering the region of interest on an object of interest, wherein the object of interest is determined based at least in part on the gaze direction.

14 . The method of claim 8 , further comprising:

displaying, with a display disposed on an eyepiece of the device, the forward-image to the user.

15 . A head-worn device comprising:

a first forward-looking camera disposed on the head-worn device and configured to capture image data that comprises a forward-image with a field of view;

an eye tracking mechanism comprising a sensing device disposed on the head-worn device, the eye tracking mechanism configured to determine a gaze direction of a user;

a processor configured to identify a region of interest of the user, wherein the region of interest is identified based at least in part on the gaze direction of the user; and

an interface device configured to indicate to the user that a field of view of the first forward-looking camera is in misalignment with the region of interest, wherein the misalignment with the region of interest is determined based at least in part on a comparison of the region of interest to the field of view.

16 . The head-worn device of claim 15 , wherein the gaze direction of the user is identified based at least in part on a position of a pupil of the user.

17 . The head-worn device of claim 15 , further comprising:

a second forward looking camera disposed on a frame of the device for capturing a second forward-image with a second field of view different from the field of view of the first forward-looking camera,

wherein the processor is further configured to select the second forward-looking camera to at least partially correct the misalignment with the region of interest.

18 . The head-worn device of claim 17 , wherein the indication comprises an instruction to the user to move the first forward-looking camera.

19 . The head-worn device of claim 15 , wherein the processor is further configured to adjust a position and/or an orientation of the first forward-looking camera to at least partially correct the misalignment with the region of interest.

20 . The head-worn device of claim 15 , wherein the region of interest is centered on an object of interest.

21 . The head-worn device of claim 15 , further comprising:

a display disposed on an eyepiece of the device and configured to display the forward-image to the user.