IP Library › Granted Patent US 11,680,814
Granted Patent B2
US 11,680,814 · App. 17/155,819 · Granted Jun 20, 2023

Augmented reality-based translations associated with travel

Inventors: Virginia Drummond (Venice, CA); Jean Luo (Los Angeles, CA); Alek Matthiessen (Marina Del Rey, CA); Celia Nicole Mourkogiannis (Los Angeles, CA)
Assignee: Snap Inc.
G01C21/3614G01C21/3476G06F3/017G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,680,814
App. No.
17/155,819
Filed
Jan 22, 2021
Granted
Jun 20, 2023
Kind
B2
Examiner
SITTA, GRANT
Art Unit
2694
USPC
701/533
Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content corresponding to a translation in association with travel. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; obtaining, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image; determining, based on the travel parameter and the attribute, to perform a translation with respect to the object; performing, in response to the determining, the translation with respect to the object; and displaying an augmented reality content item, which includes the translation, with the image.

Claims (55)

1. A method, comprising:

receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera;

obtaining, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image;

determining, based on the travel parameter and the attribute, to perform a translation with respect to the object;

performing, in response to the determining, the translation with respect to the object;

selecting, from among plural augmented reality content items, an augmented reality content item based on the attribute and the travel parameter;

activating the selected augmented reality content item; and

displaying the augmented reality content item, which includes the translation, with the image.

2. The method of claim 1 , wherein the travel parameter indicates at least one of a travel schedule, a transportation schedule, a language, a general location, a specific venue or landmark, an activity, a list of participants, or a topic of interest associated with travel by the user.

3. A method, comprising:

receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera;

obtaining, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image;

determining, based on the travel parameter and the attribute, to perform a translation with respect to the object;

performing, in response to the determining, the translation with respect to the object;

selecting, from among plural augmented reality content items, an augmented reality content item based on the attribute and the travel parameter;

activating the selected augmented reality content item; and

displaying aa the augmented reality content item, which includes the translation, with the image.

4. The method of claim 1 , wherein the attribute comprises machine-encoded text based on text depicted within the image, and

wherein the translation is performed with respect to the machine-encoded text.

5. The method of claim 1 , further comprising:

receiving, during display of the translation, user input corresponding to a tilt gesture of the device; and

performing, in response to receiving the user input, a second translation with respect to the object.

6. The method of claim 1 , wherein determining to perform the translation is further based on a geolocation of the device.

7. The method of claim 1 , wherein the augmented reality content item is selected prior to receiving the request.

8. The method of claim 1 , wherein the request corresponds to user selection of an interface element for performing the scan.

9. The method of claim 1 , wherein the request corresponds to a press-and-hold gesture performed within a predefined portion of a screen of the device.

10. The method of claim 1 , wherein the image corresponds to a live feed of a camera of the device.

11. The method of claim 1 , wherein the image corresponds to a saved image included in a photo library associated with the user.

12. A device, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the processor to:

receive, by a messaging application, a request to scan an image captured by a device camera;

obtain, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image;

determine, based on the travel parameter and the attribute, to perform a translation with respect to the object;

perform, in response to the determining, the translation with respect to the object;

select, from among plural augmented reality content items, an augmented reality content item based on the attribute and the travel parameter;

activate the selected augmented reality content item; and

display an the augmented reality content item, which includes the translation, with the image.

13. The device of claim 12 , wherein the travel parameter indicates at least one of a travel schedule, a transportation schedule, a language, a general location, a specific venue or landmark, an activity, a list of participants, or a topic of interest associated with travel by a user.

14. The device of claim 12 , wherein the attribute comprises a name of the object, and

wherein the translation is performed with respect to the name of the object.

15. The device of claim 12 , wherein the attribute comprises machine-encoded text based on text depicted within the image, and

wherein the translation is performed with respect to the machine-encoded text.

16. The device of claim 12 , wherein the instructions further configure the processor to:

receive, during display of the translation, user input corresponding to a tilt gesture of the device; and

perform, in response to receiving the user input, a second translation with respect to the object.

17. The device of claim 12 , wherein determining to perform the translation is further based on a geolocation of the device.

18. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

receive, by a messaging application running on a device of a user, a request to scan an image captured by a device camera;

obtain, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image;

determine, based on the travel parameter and the attribute, to perform a translation with respect to the object;

perform, in response to the determining, the translation with respect to the object;

select, from among plural augmented reality content items, an augmented reality content item based on the attribute and the travel parameter;

activate the selected augmented reality content item; and

display an the augmented reality content item, which includes the translation, with the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2023
From: DRUMMOND, VIRGINIA; LUO, JEAN; MATTHIESSEN, ALEK; NICOLE MOURKOGIANNIS, CELIA
To: SNAP INC.
Reel/Frame 063564/0570 →
Continuity (2)
Provisional Application 62705505 · Jun 30, 2020
Related Publication 20210404831A1 · Dec 30, 2021
Cited By (1)
US 12,292,299