IP Library Granted Patent US 11,556,009
Granted Patent B1
US 11,556,009 · App. 17/231,473 · Granted Jan 17, 2023

Camera mute indication for headset user

Inventors: Brian Kennedy (Seattle, WA); Sam Sarmast (Redmond, WA); Fletcher Nelson (Maple Valley, WA)
Assignee: Meta Platforms Technologies, LLC
G02B27/0172G06F3/013G02B2027/0112G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,556,009
App. No.
17/231,473
Granted
Jan 17, 2023
Kind
B1
Abstract

To address privacy issues with “always on” cameras of an AR headset, the cameras can be muted and content displayed by the headset adjusted to provide a user with a visual indication that the cameras are deactivated. The headset includes a display element configured to display content to a user and an eye tracking system that includes a camera configured to track eye motion of the user. In response to the headset receiving a camera muting event from the user or the external environment, the headset deactivates the camera and adjusts the content displayed on the display element to provide the user with a visual indication that the camera is deactivated. In one embodiment, the visual indication is an adjustment of the display from a default RGB color mode to “monochrome” or other predefined color map.

Claims (46)

1. A system comprising:

a display element configured to display content to a user;

an eye tracking system including a camera configured to track eye motion of the user;

a controller configured to:

display content including a virtual object on the display element, wherein display uniformity of the displayed content is associated with the tracked eye motion;

apply a display uniformity correction to a color used to display the virtual object based on tracked eye motion of the user for mitigating color abnormalities of the displayed content; and

after a deactivation of the camera, disable the display uniformity correction and adjust the displayed content by displaying the virtual object using a predefined color map that transforms a first set of input colors to a second set of output colors to mask a lack of the display uniformity correction being applied to the virtual object due to the camera being deactivated.

2. The system of claim 1 , wherein the camera is deactivated responsive to a camera muting event.

3. The system of claim 1 , wherein the predefined color map adjusts the color used to display the virtual object to an additional color that is not affected by the lack of the display uniformity correction.

4. The system of claim 1 , wherein the system is configured to be worn by the user.

5. The system of claim 1 , wherein the display element is transparent and the content is augmented reality content.

6. The system of claim 1 , wherein the camera is directed at the display element and the eye motion is determined based on light reflected off the eye and captured by the camera.

7. The system of claim 1 , wherein the controller is further configured to:

after an activation of the camera:

readjust the displayed content by displaying the virtual object using an additional color; and

apply the display uniformity correction to the additional color used to display the virtual object based on additional tracked eye motion of the user.

8. The system of claim 1 , wherein the camera is deactivated responsive to an interaction of the user with the headset, the interaction selected from the group consisting of a voice command, a hand motion, the tracked eye motion, and any combination thereof.

9. A method comprising:

displaying content including a virtual object on a display element of a device, the device including a camera configured to track eye motion of the user, wherein display uniformity of the displayed content is associated with the tracked eye motion;

applying a display uniformity correction to a color used to display the virtual object based on tracked eye motion of the user for mitigating color abnormalities of the displayed content;

in response to a deactivation of the camera:

disabling the display uniformity correction and adjusting the displayed content by displaying the virtual object using a predefined color map that transforms a first set of input colors to a second set of output colors to mask a lack of the display uniformity correction being applied to the virtual object due to the camera being deactivated.

10. The method of claim 9 , wherein the camera is deactivated responsive to a camera muting event.

11. The method of claim 9 , wherein the predefined color map adjusts the color used to display the virtual object to an additional color that are not affected by the lack of display uniformity corrections.

12. The method of claim 9 , wherein adjusting the displayed content includes displaying a mute icon.

13. The method of claim 9 , wherein the display is transparent and the content is augmented reality content.

14. The method of claim 9 , wherein the camera is deactivated responsive to an interaction by the user with the device.

15. The method of claim 14 , wherein the interaction is selected from the group consisting of a voice command, a hand motion, the tracked eye motion, and any combination thereof.

16. The method of claim 9 , wherein the camera is deactivated responsive to:

receiving geographic positioning information for the device;

comparing the geographic positioning information to a set of camera mute geographic regions; and

determining, based on the comparison, that the geographic positioning information is in a camera mute geographic region of the set of camera mute geographic regions.

17. The method of claim 9 , wherein the camera is deactivated responsive to:

receiving, from a second camera of the device, an image of an environment around the device;

classifying the image of the environment as having a context category from a set of context categories;

comparing the context category to a set of camera mute context categories; and

determining, based on the comparison, that the context category is one of the camera mute context categories.

18. The method of claim 9 , wherein the camera is deactivated responsive to:

receiving geographic positioning information for the device;

comparing the geographic positioning information to a set of geographic positions at which a camera muting event previously occurred; and

determining, based on the comparison, that a similarity between the received geographic positioning information and the geographic positioning information of a position from the set of geographic positions is above a threshold.

19. The method of claim 18 , further comprising:

prompting, responsive to determining the similarity is above a threshold, the user to deactivate the camera; and

receiving an interaction with the headset by the user deactivating the camera.

20. The system of claim 1 , wherein the controller is further configured to:

display an object in an environment about the system, wherein the predefined color map is not applied to the object in the environment.

Assignments (1)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060314/0965 →
Continuity (1)
Continuation 16739063 · Jan 9, 2020