IP Library Granted Patent US 11,036,984
Granted Patent B1
US 11,036,984 · App. 16/153,655 · Granted Jun 15, 2021

Interactive instructions

Inventor: Girish Patangay (Los Altos, CA)
Assignee: Facebook, Inc.
G06K9/00671G06K7/10722G06K7/1413G06K7/1417G06K9/325G09B19/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,036,984
App. No.
16/153,655
Granted
Jun 15, 2021
Kind
B1
Abstract

In one embodiment, a technique includes detecting an identifier associated with a product. The technique further includes accessing a content object associated with the identifier on a third-party system. In the technique, the content object includes a set of instructions. The technique also includes detecting a trigger. The technique further includes selecting a step of the content object and outputting the selected step.

Claims (76)

1. A method comprising:

by one or more computing systems, detecting an identifier associated with a product;

by the one or more computing systems, determining a third-party system associated with the product based on the identifier;

by the one or more computing systems, accessing a content object of a plurality of content objects associated with the identifier from the third-party system, wherein the content object comprises a set of instructions having a plurality of steps, wherein the content object is selected based on the set of instructions and further based on user preferences of a user associated with the product;

by the one or more computing systems, detecting a trigger;

by the one or more computing systems, selecting a step from the plurality of steps of the set of instructions of the content object; and

by the one or more computing systems, outputting the selected step.

2. The method of claim 1 , further comprising monitoring a system environment to detect the product entering the system environment, wherein the identifier is disposed on the product.

3. The method of claim 1 , wherein the identifier comprises one or more of a bar code, a quick-response (QR) code, a number, a symbol, and a set of alphanumerical characters.

4. The method of claim 1 , further comprising:

determining a privacy setting associated with a user; and

based on the privacy setting, restricting a view area of an image capture device.

5. The method of claim 2 , further comprising:

detecting the user associated with the product;

identifying the user as a user of a social-networking system; and

determining one or more user preferences of the user associated with the product based on a user profile associated with the user and stored in the social-networking system.

6. The method of claim 2 , further comprising performing a validation check, wherein performing a validation check comprises:

obtaining image data of one or more items of a product;

obtaining a list of items from the content object associated with the product; and

comparing the one or more items from the image data to the list of items from the content object.

7. The method of claim 1 , wherein the trigger comprises one or more of a gesture, a sound, a time interval, a contact event, crossing a proximity threshold, and a context.

8. The method of claim 1 , further comprising:

detecting a second trigger;

selecting a next step from the plurality of steps of the set of instructions of the content object; and

outputting the next step.

9. The method of claim 8 , wherein selecting the next step comprises:

determining one or more steps of the plurality of steps that are completed;

determining one or more steps of the plurality of steps that are not completed;

evaluating a progress of the user in completing a current step; and

selecting the next step based on the one or more completed steps, the one or more not completed steps, and the progress of the user in completing the current step.

10. The method of claim 8 , wherein selecting the next step further comprises:

identifying a second step from the plurality of steps of the set of instructions of the content object that was skipped; and

selecting the second step as the next step.

11. The method of claim 1 , further comprising:

monitoring a progress of the user as the user completes the selected step;

determining that the user is making an error; and

outputting a warning notification to the user.

12. The method of claim 11 , further comprising:

generating additional instructions to mitigate the error; and

outputting the additional instructions to the user.

13. The method of claim 1 , wherein at least one alternative content object is associated with the identifier, wherein the at least one alternative content object is one of a simplified content object, a detailed content object, and a variant content object.

14. The method of claim 2 , further comprising:

detecting a category associated with the product, wherein the category is a general classification of the product;

identifying the third-party system based on the category;

determining that the third-party system does not store content objects associated with the identifier;

selecting a second identifier associated with the category that is different from the identifier; and

accessing one or more content objects associated with the second identifier.

15. The method of claim 1 , further comprising:

selecting a branded effect corresponding to the selected step; and

outputting the branded effect in conjunction the selected step.

16. The method of claim 12 , further comprising:

identifying a variant content object of the plurality of content objects associated with the identifier;

matching the error to a step of the variant content object; and

prompting the user to complete the variant content object.

17. The method of claim 1 , further comprising:

presenting the plurality of content objects associated with the identifier;

receiving user selection of a first content object; and

selecting a step from the first content object for output to the user.

18. One or more non-transitory computer-readable storage media embodying software that is operable when executed by a server computing system to:

detect an identifier associated with a product;

determine a third-party system associated with the product based on the identifier;

access a content object of a plurality of content objects associated with the identifier from the third-party system, wherein the content object comprises a set of instructions having a plurality of steps, wherein the content object is selected based on the set of instructions and further based on user preferences of a user associated with the product;

detect a trigger;

select a step from the plurality of steps of the set of instructions of the content object; and

output the selected step.

19. A system comprising:

a client system of a user;

one or more processors; and

a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to:

detect an identifier associated with a product;

determine a third-party system associated with the product based on the identifier;

access a content object of a plurality of content objects associated with the identifier from the third-party system, wherein the content object comprises a set of instructions having a plurality of steps, wherein the content object is selected based on the set of instructions and further based on user preferences of a user associated with the product;

detect a trigger;

select a step from the plurality of steps of the set of instructions of the content object; and

output the selected step.

20. The method of claim 5 , wherein the one or more user preferences of the user associated with the product are provided by the user prior to detecting the identifier associated with the product, based on a received user selection, or determined from a user activity history associated with the user.

Assignments (2)
CHANGE OF NAME Recorded Dec 20, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058553/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2019
From: PATANGAY, GIRISH
To: FACEBOOK, INC.
Reel/Frame 050490/0647 →
Continuity (1)
Provisional Application 62682818 · Jun 8, 2018
Cited By (3)
US 12,458,890 US 12,656,120 US 12,669,331