Granted Patent B2

US 12,430,856 · App. 18/082,952 · Granted Sep 30, 2025

Inventor: Deane Mcgahan (Shoreline, WA)

Assignee: Lowe's Companies, Inc.

G06T19/006G06T17/00G06T19/20G06T2200/24G06T2210/04G06T2219/2004G06T2219/2012G06T2219/2024

Abstract

Claims (50)

1. A method comprising:

receiving image data generated by a camera of a device during an augmented reality (AR) session and showing at least a first existing physical object in a physical space, the first existing physical object having a first dimension along a first axis of a predefined coordinate system and a second dimension along a second axis of the predefined coordinate system;

determining a multi-dimensional model corresponding to the first existing physical object that has a first model dimension along the first axis of the predefined coordinate system that is smaller than the first dimension and that has a second model dimension along the second axis of the predefined coordinate system, wherein the multi-dimensional model corresponds to a second physical object installable to replace the first existing physical object;

determining a user selection of properties from a set of properties associated with the first existing physical object;

configuring the multi-dimensional model to include the properties and retain the first model dimension; and

causing the device to present, during the AR session and using the predefined coordinate system, the multi-dimensional model in an overlay such that the AR session shows (i) at least a portion of the first existing physical object based on the image data and (ii) the multi-dimensional model over a remaining portion of the first existing physical object and configured according to the properties and the first model dimension.

2. The method of claim 1 , wherein causing the device to present the multi-dimensional model in the overlay further comprises:

detecting a reference plane based on the image data, wherein the first existing physical object is at a first distance relative to the reference plane; and

aligning the multi-dimensional model within the overlay using the reference plane such that the multi-dimensional model is shown at a second predefined distance relative to the reference plane.

3. The method of claim 1 , wherein the multi-dimensional model is associated with a virtual model including a first virtual object and a second virtual object, and wherein the multi-dimensional model corresponds to the first virtual object.

4. The method of claim 3 , and wherein the second model dimension is different from the second dimension of the first existing physical object.

5. The method of claim 3 , wherein the first virtual object includes properties that are the same as the selected properties.

6. The method of claim 3 , further comprising:

displaying, in a virtual reality (VR) view of the device, the virtual model; and

responsive to receiving an input at the device in the VR view, entering the AR session.

7. The method of claim 3 , wherein the properties comprise one or more of color, material, a model number, a type, features particular to the first virtual object, or texture.

8. The method of claim 1 , further comprising:

generating, responsive to the user selection of the properties, a virtual model for the physical space, wherein the virtual model includes a virtual object generated according to the selected properties and including information to replace the first existing physical object with a different physical object.

9. The method of claim 8 , further comprising, responsive to receiving an input via the AR session, ceasing the AR session and displaying the virtual model in a virtual reality (VR) view of the device, wherein, in the VR view, the virtual model occludes all objects in the physical space including the first existing physical object.

10. The method of claim 1 , further comprising:

receiving, at the device via the presented multi-dimensional model in the AR session, a request to change the properties to second properties, wherein the second properties includes at least one of a material or a color;

updating the multi-dimensional model by configuring the multi-dimensional model to include the second properties; and

causing the device to present, during the AR session, the updated multi-dimensional model in a subsequent overlay.

11. The method of claim 1 , wherein the multi-dimensional model is associated with a virtual model, wherein the virtual model includes at least one virtual object that has the properties, and further comprising:

receiving, at the device via the presented multi-dimensional model in the AR session, a request to change the properties to second properties; and

updating the at least one virtual object in the virtual model by changing properties of the at least one object to the second properties.

12. The method of claim 1 , wherein a second multi-dimensional model also corresponds to the first existing physical object, and further comprising:

responsive to receiving, at the device, an input in the AR session, configuring the second multi-dimensional model to include at least one property different from the properties of the multi-dimensional model and to retain the second dimension.

13. The method of claim 12 , further comprising, displaying the second multi-dimensional model in the AR session instead of the multi-dimensional model.

14. The method of claim 12 , wherein the multi-dimensional model comprises a set of virtual objects in a first spatial arrangement and the second multi-dimensional model comprises the set of virtual objects in a second spatial arrangement different from the first spatial arrangement.

15. The method of claim 12 , wherein the second multi-dimensional model comprises at least one virtual object that the multi-dimensional model does not comprise.

16. The method of claim 1 , wherein determining the user selection of the properties comprises:

displaying, in the AR session, a set of style templates, each style template of the set of style templates associated with a respective set of properties; and

receiving, at the device in the AR session, a selection of a particular style template of the set of style templates, wherein the properties comprise a set of properties associated with the selected particular style template.

17. The method of claim 1 , wherein the multi-dimensional model comprises a virtual object corresponding to the second physical object that is available to replace the first existing physical object.

18. The method of claim 17 , wherein the multi-dimensional model comprises data associated with the second physical object and further comprising displaying, in the AR session, the data.

19. A non-transitory computer-readable storage medium comprising computer-readable instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving image data generated by a camera of a device during an augmented reality (AR) session and showing at least a first existing physical object in a physical space, the first existing physical object having a first dimension along a first axis of a predefined coordinate system and a second dimension along a second axis of the predefined coordinate system;

determining a multi-dimensional model corresponding to the first existing physical object that has a first model dimension along the first axis of the predefined coordinate system that is smaller than the first dimension and that has a second model dimension along the second axis of the predefined coordinate system, wherein the multi-dimensional model corresponds to a second physical object installable to replace the first existing physical object;

determining a user selection of properties from a set of properties associated with the first existing physical object;

configuring the multi-dimensional model to include the properties and retain the first model dimension; and

causing the device to present, during the AR session and using the predefined coordinate system, the multi-dimensional model in an overlay such that the AR session shows (i) at least a portion of the first existing physical object based on the image data and (ii) the multi-dimensional model over a remaining portion of the first existing physical object and configured according to the properties and the first model dimension.

20. A system comprising:

a processor;

a non-transitory computer-readable storage medium comprising computer-readable instructions that, when executed by the processor, cause the system to perform operations comprising:

receiving image data generated by a camera of a device during an augmented reality (AR) session and showing at least a first existing physical object in a physical space, the first existing physical object having a first dimension along a first axis of a predefined coordinate system and a second dimension along a second axis of the predefined coordinate system;

determining a multi-dimensional model corresponding to the first existing physical object that has a first model dimension along the first axis of the predefined coordinate system that is smaller than the first dimension and that has a second model dimension along the second axis of the predefined coordinate system, wherein the multi-dimensional model corresponds to a second physical object installable to replace the first existing physical object;

determining a user selection of properties from a set of properties associated with the first existing physical object;

configuring the multi-dimensional model to include the properties and retain the first model dimension; and

causing the device to present, during the AR session and using the predefined coordinate system, the multi-dimensional model in an overlay such that the AR session shows (i) at least a portion of the first existing physical object based on the image data and (ii) the multi-dimensional model over a remaining portion of the first existing physical object and configured according to the properties and the first model dimension.

Assignments (1)

Continuity (1)

References Cited (130)