IP Library Granted Patent US 12670525
Granted Patent B2
US 12670525 · App. 18/308,727 · Granted Jun 30, 2026

Systems and methods for generating augmented reality scenes for physical items

Inventors: Jonathan Wade (Ottawa, CA); Juho Mikko Haapoja (Toronto, CA); Byron Leonel Delgado (Ottawa, CA); Daniel Beauchamp (Toronto, CA)
Assignee: SHOPIFY INC.
G06Q30/0643G06F3/016G06F3/167G06N20/00G06Q30/0623G06T19/006G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12670525
App. No.
18/308,727
Granted
Jun 30, 2026
Kind
B2
Abstract

Systems and methods are provided for the generation of augmented reality (AR) scenery for a physical item. The AR scenery allows a customer to interact with the physical item in the real-world, while also allowing the customer to view the physical item in a virtual setting that may be tailored to the customer and/or to the physical item. According to an embodiment, an AR scene is generated for a physical item. The AR scene includes computer-generated scenery and at least a portion of an image of the physical item, where the computer-generated scenery is based on information associated with the user and/or the physical item. The AR scene is then displayed on a device.

Claims (48)

1 . A computer-implemented method comprising:

instructing a device to display an indication of a plurality of different virtual scenes backgrounds in which to present a physical real-world object using augmented reality (AR), at least two of the virtual backgrounds each being a respective different virtual background location that is separate from the physical real-world object and in which the physical real-world object may be presented using AR by augmenting the physical real-world object with the virtual background location, wherein at least one of the different virtual background locations that is separate from the physical real-world object and in which the physical real-world object may be presented using AR is recommended based on an identity of the physical real-world object;

receiving a selection of a particular virtual background of the plurality of different virtual backgrounds;

generating an AR scene comprising both: (1) computer-generated scenery including virtual content of the particular virtual background that was selected and (2) at least a portion of the physical real-world object; and

instructing the device to display the AR scene.

2 . The computer-implemented method of claim 1 , wherein at least one of the plurality of different virtual backgrounds is associated with a user.

3 . The computer-implemented method of claim 2 , wherein the at least one of the different virtual background locations is recommended based on both the identity of the physical real-world object and information associated with the user.

4 . The computer-implemented method of claim 1 , wherein at least one of the plurality of different virtual backgrounds is associated with the physical real-world object.

5 . The computer-implemented method of claim 1 , further comprising:

determining the identity of the physical real-world object; and

instructing the device to display the recommendation.

6 . The computer-implemented method of claim 5 , wherein determining the identity of the physical real-world object comprises receiving an indication of the physical real-world object.

7 . The computer-implemented method of claim 5 , wherein determining the identity of the physical real-world object comprises analysing an image of the physical real-world object.

8 . The computer-implemented method of claim 1 , wherein the at least one of the different virtual background locations is recommended based on information corresponding to the identity of the physical real-world object.

9 . The computer-implemented method of claim 1 , wherein the plurality of different virtual backgrounds are each recommended based on the identity of the physical real-world object.

10 . The computer-implemented method of claim 1 , wherein generating the AR scene comprises:

determining the dimensions of the physical real-world object; and

scaling the computer-generated scenery relative to the dimensions of the physical real-world object.

11 . The computer-implemented method of claim 1 , wherein:

the physical real-world object is a first object;

the method further comprises obtaining an indication of a second object; and

the computer-generated scenery comprises a virtual representation of the second object.

12 . The computer-implemented method of claim 1 , wherein the indication of the plurality of different virtual backgrounds is obtained using a machine learning model.

13 . A system comprising:

at least one processor; and

a memory storing processor-executable instructions that, when executed, cause the at least one processor to:

instruct a device to display an indication of a plurality of different virtual backgrounds in which to present a physical real-world object using augmented reality (AR), at least two of the virtual backgrounds each being a respective different virtual background location that is separate from the physical real-world object and in which the physical real-world object may be presented using AR by augmenting the physical real-world object with the virtual background location scene, wherein at least one of the different virtual background locations that is separate from the physical real-world object and in which the physical real-world object may be presented using AR is recommended based on an identity of the physical real-world object;

receive a selection of a particular virtual background of the plurality of different virtual backgrounds;

generate an AR scene comprising both: (1) computer-generated scenery including virtual content of the particular virtual background that was selected and (2) at least a portion of the physical real-world object; and

instruct the device to display the AR scene.

14 . The system of claim 13 , wherein at least one of the plurality of different virtual backgrounds is associated with the physical real-world object.

15 . The system of claim 13 , wherein the instructions, when executed, further cause the at least one processor to:

determine the identity of the physical real-world object; and

instruct the device to display the recommendation.

16 . The system of claim 13 , wherein the at least one of the different virtual background locations is recommended based on information corresponding to the identity of the physical real-world object.

17 . The system of claim 13 , wherein the at least one processor is to generate the AR scene by performing operations including:

determining the dimensions of the physical real-world object; and

scaling the computer-generated scenery relative to the dimensions of the physical real- world object.

18 . The system of claim 13 , wherein:

the physical real-world object is a first object;

the at least one processor is to obtain an indication of a second object; and

the computer-generated scenery comprises a virtual representation of the second object.

19 . The system of claim 13 , wherein the at least one processor obtains the indication of the plurality of different virtual backgrounds using a machine learning model.

20 . A non-transitory computer-readable medium having stored thereon computer-executable instruction that, when executed, cause a computer to perform operations comprising:

instructing a device to display an indication of a plurality of different virtual backgrounds in which to present a physical real-world object using augmented reality (AR), at least two of the virtual backgrounds each being a respective different virtual background location that is separate from the physical real-world object and in which the physical real-world object may be presented using AR by augmenting the physical real-world object with the virtual background location, wherein at least one of the different virtual background locations that is separate from the physical real-world object and in which the physical real-world object may be presented using AR is recommended based on an identity of the physical real-world object;

receiving a selection of a particular virtual background of the plurality of different virtual backgrounds;

generating an AR scene comprising both: (1) computer-generated scenery including virtual content of the particular virtual background that was selected and (2) at least a portion of the physical real-world object; and

instructing the device to display the AR scene.