IP Library Granted Patent US 12,132,983
Granted Patent B2
US 12,132,983 · App. 17/859,808 · Granted Oct 29, 2024

User interface to select field of view of a camera in a smart glass

Inventors: Sapna Shroff (Burlingame, CA); Sebastian Sztuk (Menlo Park, CA); Jun Hu (San Jose, CA); Johana Gabriela Coyoc Escudero (Union City, CA)
Assignee: Meta Platforms Technologies, LLC
H04N23/64G02B27/0172G02C7/101G02C7/16G06F3/013G06F3/016G06F3/017G06F3/044G06F3/167G06F40/205G06V10/25G06V10/759G06V20/50G10L17/06G10L17/22H04N23/56H04N23/62H04N23/63H04N23/66H04N23/695H04N23/90G02B2027/0138G02B2027/0141G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,132,983
App. No.
17/859,808
Granted
Oct 29, 2024
Kind
B2
Abstract

A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

Claims (29)

1. A device, comprising:

a frame including an eyepiece to provide a forward-image to a user;

a first forward-looking camera mounted on the frame;

a processor configured to identify a region of interest within the forward-image; and

an interface device to indicate the user that a first field of view of the first forward-looking camera is misaligned with the region of interest;

a second forward-looking camera mounted on the frame, wherein the second forward-looking camera is configured to switch on and the first forward-looking camera is configured switch off when the region of interest is better aligned with a second field of view of the second forward-looking camera.

2. The device of claim 1 , further comprising a sensing device facing the user for tracking a pupil position of the user, wherein the processor identifies the region of interest based on the pupil position of the user.

3. The device of claim 1 , wherein the processor identifies the region of interest based on a gaze direction of the user within a field of view of the user.

4. The device of claim 1 , further comprising a memory storing instructions which, when executed by the processor, cause the device to find a gazing vector indicative of a center of the region of interest within a field of view of the user.

5. The device of claim 1 , wherein the interface device includes an audio device to provide a signal for the user to adjust a head pose and align the first field of view of the first forward-looking camera with the region of interest.

6. The device of claim 1 , wherein the interface device comprises a vibrating component configured to indicate the user to nudge a head position in a desired direction to align the first field of view of the first forward-looking camera with the region of interest.

7. The device of claim 1 , wherein the eyepiece includes a liquid crystal configured to obscure a vertical portion of the eyepiece, or a horizontal portion of the eyepiece, when activated, to induce the user to move a head position horizontally or vertically, respectively, to center the first field of view of the first forward-looking camera with the region of interest.

8. The device of claim 1 , further comprising an actuator configured to modify a color of a portion of a field of view of the eyepiece corresponding to the region of interest.

9. The device of claim 1 , further comprising a microphone to receive a voice command from the user identifying an object of interest within a field of view of the user.

10. The device of claim 1 , further comprising wherein the interface device is configured to provide the user an option to activate the second forward-looking camera when the first field of view of the first forward-looking camera is misaligned with the region of interest.

11. A computer-implemented method, comprising:

receiving from a user of a smart glass, an indication of an object of interest within a forward-image viewed by the user;

comparing a region of interest centered on the object of interest with a first field of view of a first forward-looking camera mounted on a frame of the smart glass;

activating a second forward-looking camera mounted on the frame of the smart glass when the region of interest is better aligned with a second field of view of the second forward-looking camera, wherein the first forward-looking camera is switched off when the second forward-looking camera is activated; and

providing, via an interface actuator mounted on the smart glass, a feedback to the user based on a relative position between the region of interest and the first field of view of the first forward-looking camera.

12. The computer-implemented method of claim 11 , wherein receiving the indication of the object of interest within a field of view of the user includes tracking a location of a pupil of the user and identifying the object of interest based on the location of the pupil of the user.

13. The computer-implemented method of claim 11 , wherein receiving the indication of the object of interest within a field of view of the user includes receiving an eye position for the user of the smart glass, the eye position indicative of a position of the object of interest within the field of view of the user.

14. The computer-implemented method of claim 11 , wherein receiving the indication of the object of interest within a field of view of the user includes determining a gaze direction of the user based on a position of two pupils of the user.

15. The computer-implemented method of claim 11 , wherein receiving the indication of the object of interest within a field of view of the user includes receiving a position of two pupils of the user, and determining a gaze direction comprises determining a vergence of the position of the two pupils of the user.

16. The computer-implemented method of claim 11 , further comprising determining the region of interest having an area of the first field of view of the first forward-looking camera centered on the object of interest.

17. The computer-implemented method of claim 11 , further comprising receiving, from the user, and instruction to turn the second forward-looking camera on when the region of interest is misaligned with the first field of view of the first forward-looking camera.

18. The computer-implemented method of claim 11 , wherein providing the feedback to the user comprises determining a relative position of the region of interest and the second field of view of the second forward-looking camera.

19. The computer-implemented method of claim 11 , wherein the smart glass includes a speaker, and providing the feedback to the user comprises providing an instruction to the user to move the smart glass in a given direction or adjust a head position of the user relative to the object of interest.

20. The computer-implemented method of claim 11 , wherein the smart glass includes a light emitter, and providing the feedback to the user comprises indicating a direction to move a gaze of the user with the light emitter.

Continuity (4)
Provisional Application 63227231 · Jul 29, 2021
Provisional Application 63227238 · Jul 29, 2021
Provisional Application 63227240 · Jul 29, 2021
Related Publication 20230032467A1 · Feb 2, 2023