IP Library › Granted Patent US 11,776,253
Granted Patent B2
US 11,776,253 · App. 17/204,712 · Granted Oct 3, 2023

Displaying object names in association with augmented reality content

Inventors: Kaveh Anvaripour (Santa Monica, CA); Celia Nicole Mourkogiannis (Los Angeles, CA)
Assignee: Snap Inc.
G06V20/20G06F16/9532G06F16/9538G06T19/006H04L51/046G06F16/955
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,776,253
App. No.
17/204,712
Granted
Oct 3, 2023
Kind
B2
Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying object names in association with augmented reality content. The program and method provide for receiving, by a messaging application running on a device, a first request to identify plural objects based on an image captured by a camera of the device; identifying, in response to receiving the first request, the plural objects based on the image; for each of the plural objects, determining at least one attribute of the object, and calculating a number of augmented reality content items, from plural augmented reality content items, corresponding to the at least one attribute of the object; selecting, from the plural objects, an object with a largest calculated number of corresponding augmented reality content items; and displaying a name for each of the plural objects based on the selecting.

Claims (49)

1. A method, comprising:

receiving, by a messaging application running on a device, a first request to identify plural objects based on an image captured by a camera of the device;

identifying, in response to receiving the first request, the plural objects based on the image;

for each of the plural objects,

determining at least one attribute of the object, and

searching a set of available augmented reality content items to determine a subset of augmented reality content items having the at least one attribute of the object;

selecting, based on the searching for each of the plural objects, an object from the plural objects with a largest subset of augmented reality content items; and

causing display of an iteration through each name of the plural objects, wherein the name of the selected object is displayed last in the iteration.

2. The method of claim 1 , wherein the identifying comprises detecting a preset number of objects based on the image.

3. The method of claim 2 , wherein each of the plural objects corresponds to a physical object identified in the image.

4. The method of claim 2 , wherein at least one of the plural objects corresponds to a non-physical object associated with the image, based on a determination that a number of physical objects identified in the image is less than the preset number of objects.

5. The method of claim 1 , further comprising:

identifying, from the augmented reality content items corresponding to the selected object, an augmented reality content item based on the at least one attribute of the selected object; and

displaying the image captured by the camera with the identified augmented reality content item.

6. The method of claim 5 , wherein identifying the augmented reality content item comprises:

ranking the plural augmented reality content items based on the at least one attribute of the selected object; and

identifying the augmented reality content item based on the ranking.

7. The method of claim 6 , wherein the ranking comprises comparing the at least one attribute of the selected object with predefined attributes associated with each of the plural augmented reality content items.

8. The method of claim 1 , wherein each augmented reality content item in the set of available augmented reality content items is configured to transform content within the image captured by the camera.

9. The method of claim 1 , wherein the iteration corresponds with iteratively displaying each of the names of the plural objects for a first predefined amount of time.

10. The method of claim 9 , wherein the iteration corresponds with waiting a second predefined amount of time before iteratively displaying each of the names of the plural objects for the first predefined amount of time.

11. A device, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to:

receive, by a messaging application running on a device, a first request to identify plural objects based on an image captured by a camera of the device;

identify, in response to receiving the first request, the plural objects based on the image;

for each of the plural objects,

determine at least one attribute of the object, and

search a set of available augmented reality content items to determine a subset of augmented reality content items having the at least one attribute of the object;

select, based on the searching for each of the plural objects, an object from the plural objects with a largest subset of augmented reality content items; and

cause display of an iteration through each name of the plural objects, wherein the name of the selected object is displayed last in the iteration.

12. The device of claim 11 , wherein the identifying comprises detect a preset number of objects based on the image.

13. The device of claim 12 , wherein each of the plural objects corresponds to a physical object identified in the image.

14. The device of claim 12 , wherein at least one of the plural objects corresponds to a non-physical object associated with the image, based on a determination that a number of physical objects identified in the image is less than the preset number of objects.

15. The device of claim 11 , wherein the instructions further cause the processor to:

identify, from the augmented reality content items corresponding to the selected object, an augmented reality content item based on the at least one attribute of the selected object; and

display the image captured by the camera with the identified augmented reality content item.

16. The device of claim 15 , wherein identifying the augmented reality content item comprises:

rank the plural augmented reality content items based on the at least one attribute of the selected object; and

identify the augmented reality content item based on the ranking.

17. The device of claim 16 , wherein the ranking comprises comparing the at least one attribute of the selected object with predefined attributes associated with each of the plural augmented reality content items.

18. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

receive, by a messaging application running on a device, a first request to identify plural objects based on an image captured by a camera of the device;

identify, in response to receiving the first request, the plural objects based on the image;

for each of the plural objects,

determine at least one attribute of the object, and

search a set of available augmented reality content items to determine a subset of augmented reality content items having the at least one attribute of the object;

select, based on the searching for each of the plural objects, an object from the plural objects with a largest subset of augmented reality content items; and

cause display of an iteration through each name of the plural objects, wherein the name of the selected object is displayed last in the iteration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2023
From: ANVARIPOUR, KAVEH; MOURKOGIANNIS, CELIA NICOLE
To: SNAP INC.
Reel/Frame 064358/0466 →
Continuity (2)
Provisional Application 63000762 · Mar 27, 2020
Related Publication 20210303860A1 · Sep 30, 2021
Cited By (1)
US 12,198,429