IP Library Granted Patent US 10,229,312
Granted Patent B2
US 10,229,312 · App. 15/849,577 · Granted Mar 12, 2019

Systems and methods for providing augmented reality overlays

Inventors: John Samuel Barnett (Newark, CA); Dantley Davis (Morgan Hill, CA); Congxi Lu (Los Angeles, CA); Jonathan Morton (Menlo Park, CA); Peter Vajda (Palo Alto, CA); Joshua Charles Harris (Belmont, CA)
Assignee: Facebook, Inc.
G06K9/00288G06K9/00671G06K9/66G06N99/005G06Q50/01G06T5/002G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,229,312
App. No.
15/849,577
Filed
Dec 20, 2017
Granted
Mar 12, 2019
Kind
B2
Examiner
HOANG, PHI
Art Unit
2613
USPC
345/633
Abstract

Systems, methods, and non-transitory computer-readable media can identify one or more objects depicted in a camera view of a camera application displayed on a display of a user device. An augmented reality overlay is determined based on the one or more objects identified in the camera view. The camera view is modified based on the augmented reality overlay.

Claims (32)

1. A computer-implemented method comprising:

receiving, by a computing system, user location information indicative of a location of a user;

identifying, by the computing system, one or more objects depicted in a camera view of a camera application displayed on a display based on a first object recognition machine learning model, wherein the first object recognition machine learning model is selected from a plurality of object recognition machine learning models based on the user location information;

determining, by the computing system, an augmented reality overlay based on the one or more objects identified in the camera view; and

modifying, by the computing system, the camera view based on the augmented reality overlay.

2. The computer-implemented method of claim 1 , further comprising downloading to the user device one or more machine learning models associated with the user location information, the one or more machine learning models including the first object recognition machine learning model.

3. The computer-implemented method of claim 1 , wherein the augmented reality overlay comprises context information associated with an object of the one or more objects depicted in the camera view.

4. The computer-implemented method of claim 3 , wherein the context information comprises social networking system information associated with the object.

5. The computer-implemented method of claim 4 , wherein the social networking system information comprises one or more content items associated with the object posted by users of a social networking system.

6. The computer-implemented method of claim 1 , wherein the augmented reality overlay comprises an interactive augmented reality object that appears to interact with an object of the one or more objects depicted in the camera view.

7. The computer-implemented method of claim 6 , wherein the interactive augmented reality object is selected based on an association with the object.

8. The computer-implemented method of claim 1 , wherein the determining the augmented reality overlay comprises

presenting a plurality of augmented reality overlays to a user, and

receiving a selection of an augmented reality overlay from the plurality of augmented reality overlays.

9. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform a method comprising:

receiving user location information indicative of a location of a user;

identifying one or more objects depicted in a camera view of a camera application displayed on a display based on a first object recognition machine learning model, wherein the first object recognition machine learning model is selected from a plurality of object recognition machine learning models based on the user location information;

determining an augmented reality overlay based on the one or more objects identified in the camera view; and

modifying the camera view based on the augmented reality overlay.

10. The system of claim 9 , wherein

the method further comprises downloading to the user device one or more machine learning models associated with the user location information, the one or more machine learning models including the first object recognition machine learning model.

11. The system of claim 9 , wherein the augmented reality overlay comprises context information associated with an object of the one or more objects depicted in the camera view.

12. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

receiving user location information indicative of a location of a user;

identifying one or more objects depicted in a camera view of a camera application displayed on a display based on a first object recognition machine learning model, wherein the first object recognition machine learning model is selected from a plurality of object recognition machine learning models based on the user location information;

determining an augmented reality overlay based on the one or more objects identified in the camera view; and

modifying the camera view based on the augmented reality overlay.

13. The non-transitory computer-readable storage medium of claim 12 , wherein

the method further comprises downloading to the user device one or more machine learning models associated with the user location information, the one or more machine learning models including the first object recognition machine learning model.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the augmented reality overlay comprises context information associated with an object of the one or more objects depicted in the camera view.

Assignments (2)
CHANGE OF NAME Recorded Dec 1, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058294/0384 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2018
From: BARNETT, JOHN SAMUEL; DAVIS, DANTLEY; LU, CONGXI; MORTON, JONATHAN; VAJDA, PETER; HARRIS, JOSHUA CHARLES
To: FACEBOOK, INC.
Reel/Frame 047387/0106 →
Continuity (2)
Provisional Application 62441091 · Dec 30, 2016
Related Publication 20180190032A1 · Jul 5, 2018
Cited By (2)
US 12,326,971 US 12,670,297