IP Library Granted Patent US 11,308,327
Granted Patent B2
US 11,308,327 · App. 17/149,428 · Granted Apr 19, 2022

Providing travel-based augmented reality content with a captured image

Inventors: Virginia Drummond (Venice, CA); Jean Luo (Los Angeles, CA); Alek Matthiessen (Marina Del Rey, CA); Celia Nicole Mourkogiannis (Los Angeles, CA)
Assignee: Snap Inc.
G06K9/00671G06F3/0482G06T19/006H04W4/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,308,327
App. No.
17/149,428
Filed
Jan 14, 2021
Granted
Apr 19, 2022
Kind
B2
Art Unit
2611
USPC
345/633
Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content with a captured image in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image; obtaining supplemental content based on the travel parameter and on the attribute; and displaying an augmented reality content item, which includes the supplemental content, with the captured image.

Claims (41)

1. A method, comprising:

receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera;

determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image;

obtaining supplemental content based on the travel parameter and on the attribute; and

displaying an augmented reality content item, which includes the supplemental content, with the image,

wherein the travel parameter indicates at least one of a travel schedule, a transportation schedule, or a list of participants traveling with the user.

2. The method of claim 1 , wherein the travel parameter further indicates at least one of a general location, a specific venue or landmark, an activity, or a topic of interest associated with travel by the user.

3. The method of claim 1 , further comprising:

selecting, from among plural augmented reality content items, the augmented reality content item based on the attribute and the travel parameter; and

activating the selected augmented reality content item prior to the displaying.

4. The method of claim 1 , wherein the augmented reality content item is selected prior to the receiving.

5. The method of claim 1 , wherein the request corresponds to user selection of an interface element for performing the scan.

6. The method of claim 1 , wherein the request corresponds to a press-and-hold gesture performed within a predefined portion of a screen of the device.

7. The method of claim 1 , wherein obtaining the supplemental content is further based on a geolocation of the device.

8. The method of claim 1 , wherein the image corresponds to a live feed of a camera of the device.

9. The method of claim 1 , wherein the image corresponds to a saved image included in a photo library associated with the user.

10. A device, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the processor to:

receive, by a messaging application running on a device of a user, a request to scan an image captured by a device camera;

determine, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image;

obtain supplemental content based on the travel parameter and on the attribute; and

display an augmented reality content item, which includes the supplemental content, with the image,

wherein the travel parameter indicates at least one of a travel sc a transportation schedule, or a list of participants traveling with the user.

11. The device of claim 10 , wherein the travel parameter further indicates at least one of a general location, a specific venue or landmark, an activity, or a topic of interest associated with travel by the user.

12. The device of claim 10 , wherein the instructions further configure the processor to:

select, from among plural augmented reality content items, the augmented reality content item based on the attribute and the travel parameter; and

activate the selected augmented reality content item prior to the displaying.

13. The device of claim 10 ; wherein the augmented reality content item is selected prior to the receiving.

14. The device of claim 10 , wherein the request corresponds to user selection of an interface element for performing the scan.

15. The device of claim 10 , wherein the request corresponds to a press-and-hold gesture performed within a predefined portion of a screen of the device.

16. The device of claim 10 ; wherein obtaining the supplemental content is further based on a geolocation of the device.

17. The device of claim 10 , wherein the image corresponds to a live feed of a camera of the device.

18. The device of claim 10 , wherein the image corresponds to a saved image included in a photo library associated with the user.

19. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

receive, by a messaging application running on a device of a user, a request to scan an image captured by a device camera;

determine, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image;

obtain supplemental content based on the travel parameter and on the attribute; and

display an augmented reality content item, which includes the supplemental content, with the image,

wherein the travel parameter indicates at least one of a travel schedule, a transportation schedule, or a list of participants traveling with the user.

20. The computer-readable storage medium of claim 19 , wherein the travel parameter further indicates at least one of a general location, a specific venue or landmark, an activity, or a topic of interest associated with travel by the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2022
From: DRUMMOND, VIRGINIA; LUO, JEAN; MATTHIESSEN, ALEK; MOURKOGIANNIS, CELIA NICOLE
To: SNAP INC.
Reel/Frame 059251/0488 →
Continuity (2)
Provisional Application 63045436 · Jun 29, 2020
Related Publication 20210406543A1 · Dec 30, 2021
Cited By (2)
US 12,292,299 US 12,536,567