IP Library Granted Patent US 12,474,766
Granted Patent B2
US 12,474,766 · App. 17/671,986 · Granted Nov 18, 2025

Providing guidance regarding content viewed via augmented reality devices

Inventors: Michelle Tuyet Vo (San Francisco, CA); Nadine Sharon Anglin (Los Angeles, CA); Aminata Dia (Redwood City, CA); Anjali Induchoodan Menon (Redmond, WA); Sweta Kothari (Fremont, CA)
Assignee: Meta Platforms Technologies, LLC
G06F3/011G02B27/0101G06F16/40G06F16/9536G06T7/85G06V20/20G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,474,766
App. No.
17/671,986
Granted
Nov 18, 2025
Kind
B2
Abstract

Methods, systems, and storage media for providing feedback regarding augmented reality device content are disclosed. Exemplary implementations may: detect, via a sensor of an augmented reality device having an outwardly facing camera, that a user of the augmented reality device appears within content presented in a view area thereof; responsive to detecting that the user of the augmented reality device appears within the content presented in the view area of the augmented reality device, determine an action being performed by the user; and responsive to determining the action being performed by the user, supplement the content presented in the view area of the augmented reality device.

Claims (32)

1 . A computer-implemented method for providing feedback regarding augmented reality device content, the method comprising:

detecting, via a sensor of an augmented reality device having an outwardly facing camera, that a user of the augmented reality device appears within content presented in a view area of the augmented reality device;

responsive to detecting that the user of the augmented reality device appears within the content presented in the view area of the augmented reality device, determining an action being performed by the user;

determining information from a first external data source, comprising supplemental data associated with the action being performed by the user, wherein the supplemental data comprises queried data from a second external data source about a different action related to the action being performed by the user; and

responsive to determining the action being performed by the user, supplementing the content presented in the view area of the augmented reality device using information from the second external data source, wherein the supplementing the content includes providing a user interface for performing a user input with respect to the different action.

2 . The computer-implemented method of claim 1 , wherein the augmented reality device is a wearable, head-mounted augmented reality device.

3 . The computer-implemented method of claim 1 , wherein detecting, via the sensor of the augmented reality device that the user of the augmented reality device appears within the content presented in the view area of the augmented reality device comprises detecting, via the sensor of the augmented reality device, that the user of the augmented reality device is facing a reflective surface.

4 . The computer-implemented method of claim 1 , wherein supplementing the content presented in the view area of the augmented reality device comprises supplementing the content with guidance for at least one of improving and enhancing the action being performed by the user.

5 . The computer-implemented method of claim 4 , wherein supplementing the content presented in the view area of the augmented reality device comprises supplementing the content with at least one of textual content, audio content, and video content containing the guidance for the at least one of improving and enhancing the action being performed by the user.

6 . The computer-implemented method of claim 1 , wherein supplementing the content presented in the view area of the augmented reality device comprises supplementing the content with one or more facts regarding the action being performed by the user.

7 . The computer-implemented method of claim 6 , wherein supplementing the content presented in the view area of the augmented reality device comprises supplementing the content with at least one of textual content, audio content, and video content containing the one or more facts regarding the action being performed by the user.

8 . The computer-implemented method of claim 1 , wherein the supplemental data comprises one or more facts regarding the action being performed by the user.

9 . A non-transient computer-readable storage medium having instructions embodied thereon, the instructions being executable by one or more processors to perform a method for providing feedback regarding augmented reality device content, the method comprising:

detecting, via a sensor of a wearable, head-mounted augmented reality device having an outwardly facing camera, that a user of the wearable, head-mounted augmented reality device appears within content presented in a view area of the wearable, head-mounted augmented reality device;

responsive to detecting that the user of the wearable, head-mounted augmented reality device appears within the content presented in the view area of the wearable, head-mounted augmented reality device, determining an action being performed by the user;

determine information from a first external data source, comprising supplemental data associated with the action being performed by the user, wherein the supplemental data comprises queried data from a second external data source about a different action related to the action being performed by the user; and

responsive to determining the action being performed by the user, supplement the content presented in the view area of the augmented reality device using information from the second external data source, wherein the supplementing the content includes providing a user interface for performing a user input with respect to the different action.

10 . The non-transient computer-readable storage medium of claim 9 , wherein detecting, via the sensor of the wearable, head-mounted augmented reality device, that the user of the wearable, head-mounted augmented reality device appears within the content presented in the view area of the wearable, head-mounted augmented reality device comprises detecting, via the sensor of the wearable, head-mounted augmented reality device, that the user of the wearable, head-mounted augmented reality device is facing a reflective surface.

11 . The non-transient computer-readable storage medium of claim 9 , wherein supplementing the content presented in the view area of the wearable, head-mounted augmented reality device comprises supplementing the content presented in the view area of the wearable, head-mounted augmented reality device with guidance for at least one of improving and enhancing the action being performed by the user.

12 . The non-transient computer-readable storage medium of claim 9 , wherein supplementing the content presented in the view area of the wearable, head-mounted augmented reality device comprises supplementing the content presented in the view area of the wearable, head-mounted augmented reality device with at least one of textual content, audio content, and video content containing guidance for the at least one of improving and enhancing the action being performed by the user.

13 . The non-transient computer-readable storage medium of claim 9 , supplementing the content presented in the view area of the wearable, head-mounted augmented reality device comprises supplementing the content presented in the view area of the wearable, head-mounted augmented reality device with one or more facts regarding the action being performed by the user.

14 . A system, comprising:

one or more processors configured to:

detect, via a sensor of an augmented reality device having an outwardly facing camera, that a user of the augmented reality device appears within content presented in a view area of the augmented reality device;

responsive to detecting that the user of the augmented reality device appears within the content presented in the view area of the augmented reality device, determine an action being performed by the user;

determine information from a first external data source, comprising supplemental data associated with the action being performed by the user, wherein the supplemental data comprises queried data from a second external data source about a different action related to the action being performed by the user; and

responsive to determining the action being performed by the user, supplement the content presented in the view area of the augmented reality device using information from the second external data source, wherein the supplementing the content includes providing a user interface for performing a user input with respect to the different action.

15 . The system of claim 14 , wherein the augmented reality device is a wearable, head-mounted augmented reality device.

16 . The system of claim 14 , wherein detecting, via the sensor of the augmented reality device that the user of the augmented reality device appears within the content presented in the view area of the augmented reality device comprises detecting, via the sensor of the augmented reality device, that the user of the augmented reality device is facing a reflective surface.

17 . The system of claim 14 , wherein supplementing the content presented in the view area of the augmented reality device comprises supplementing the content with guidance for at least one of improving and enhancing the action being performed by the user.

18 . The system of claim 17 , wherein supplementing the content presented in the view area of the augmented reality device comprises supplementing the content with at least one of textual content, audio content, and video content containing the guidance for the at least one of improving and enhancing the action being performed by the user.

19 . The system of claim 14 , wherein supplementing the content presented in the view area of the augmented reality device comprises supplementing the content with one or more facts regarding the action being performed by the user.

Assignments (2)
CHANGE OF NAME Recorded May 31, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060244/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2022
From: VO, MICHELLE TUYET; ANGLIN, NADINE SHARON; DIA, AMINATA; MENON, ANJALI INDUCHOODAN; KOTHARI, SWETA
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 059531/0349 →
Continuity (1)
Related Publication 20230259193A1 · Aug 17, 2023
References Cited (6)
US 20170206691A1 · Harrises · 2017 [cited by examiner]
US 20180040004A1 · Greenberger · 2018 [cited by examiner]
US 20180300046A1 · Goyal · 2018 [cited by examiner]
US 20210327156A1 · Bramwell et al. · 2021 [cited by applicant]
EPO—International Search Report and Written Opinion for International Application No. PCT/US2023/013091, mailed Jul. 12, 2023, 17 pages. [cited by applicant]
EPO—Invitation to Pay Additional Fees for International Application No. PCT/US2023/013091, May 17, 2023, 12 pages. [cited by applicant]