IP Library Granted Patent US 11,513,672
Granted Patent B2
US 11,513,672 · App. 17/063,150 · Granted Nov 29, 2022

Systems and methods for providing an extended reality interface

Inventors: Michael Philip Schenck (Malden, MA); Shrenik Sadalgi (Cambridge, MA); Michael Silvio Festa (Wakefield, MA)
Assignee: Wayfair LLC
G06F3/04845G01P13/00G01S5/16G06F3/0482G06F3/04815G06F16/53G06F3/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,513,672
App. No.
17/063,150
Granted
Nov 29, 2022
Kind
B2
Abstract

Some embodiments include a system comprising an extended reality (XR) display device configured to display an XR interface to a user; at least one hardware processor communicatively coupled to the XR display device and configured to perform: receiving a model of a room; receiving a plurality of furniture models corresponding to a plurality of pieces of furniture; providing the XR interface using the model of the room and the plurality of furniture models at least in part by: displaying, via the XR display device, a furniture display comprising at least some of the plurality of furniture models and a search field to permit entry of text; detecting entry of a text string into the search field; identifying, using the text string, at least one furniture model from the plurality of furniture models; and displaying, via the XR display device, the at least one furniture model in the furniture display.

Claims (130)

1. A system, comprising:

an extended reality (XR) display device configured to display an XR interface to a user;

at least one hardware processor communicatively coupled to the XR display device;

an XR object tracking system communicatively coupled to the at least one hardware processor and configured to generate information indicative of a location of a real-world object that corresponds to a first furniture model in a model of a room; and

at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform:

generating the XR interface using the model of the room and a plurality of furniture models corresponding to a plurality of pieces of furniture;

displaying, via the XR interface, the first furniture model of the plurality of furniture models;

identifying, using at least one placement constraint, one or more surfaces in the model of the room on which the first furniture model may be placed and/or one or more surfaces in the model of the room on which the first furniture model may not be placed;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface that meets the at least one placement constraint;

displaying, via the XR interface, the first furniture model placed on the first surface;

detecting, via the XR object tracking system, movement of the real-world object using the information indicative of the location of the real-world object; and

moving the corresponding first furniture model in the model of the room based on the detected movement of the real-world object.

2. The system of claim 1 , wherein the processor-executable instructions further cause the at least one hardware processor to perform:

identifying a flat surface of a second furniture model in the model of the room; and

permitting, based on the at least one placement constraint, placement of the first furniture model onto the flat surface of the second furniture model in the XR interface.

3. The system of claim 1 , further comprising:

at least one XR control device configured to receive input from the user in the XR interface; and

wherein the processor-executable instructions further cause the at least one hardware processor to perform:

receiving a plurality of texture models corresponding to a plurality of textures, wherein the XR interface is generated using the plurality of texture models;

displaying, via the XR interface, at least some of the plurality of texture models;

detecting, via the at least one XR control device, manipulation of a texture model of the at least some of the plurality of texture models; and

applying the texture model to the first furniture model responsive to manipulation of the texture model.

4. The system of claim 1 , further comprising:

at least one XR control device configured to receive input from the user in the XR interface;

wherein the processor-executable instructions further cause the at least one hardware processor to perform:

displaying, via the XR interface, at least one configurable element to change a scale of the model of the room;

detecting, via the at least one XR control device, manipulation of the at least one configurable element; and

changing the scale of the model of the room responsive to detecting manipulation of the at least one configurable element.

5. The system of claim 1 , wherein the XR object tracking system comprises:

a plurality of infrared (IR) detectors that are attached to the real-world object; and

at least one light source configured to emit IR light.

6. The system of claim 1 , wherein the XR interface comprises an augmented reality (AR) interface.

7. A method, comprising:

generating an XR interface using a model of a room and a plurality of furniture models corresponding to a plurality of pieces of furniture;

displaying, via the XR interface, a first furniture model of the plurality of furniture models;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface in the model of the room;

displaying, via the XR interface, the first furniture model placed on the first surface;

generating, via an XR object tracking system, information indicative of a location of a real-world object that corresponds to the first furniture model in the model of the room;

detecting, via the XR object tracking system, movement of the real-world object using the information indicative of the location of the real-world object; and

moving the corresponding first furniture model in the model of the room based on the detected movement of the real-world object.

8. The method of claim 7 , further comprising:

identifying a flat surface of a second furniture model in the model of the room; and

permitting, based on at least one placement constraint, placement of the first furniture model onto the flat surface of the second furniture model in the XR interface.

9. The method of claim 7 , further comprising:

receiving a plurality of texture models corresponding to a plurality of textures, wherein the XR interface is generated using the plurality of texture models;

displaying, via the XR interface, at least some of the plurality of texture models;

detecting, via at least one XR control device, manipulation of a texture model of the at least some of the plurality of texture models; and

applying the texture model to the first furniture model responsive to manipulation of the texture model.

10. The method of claim 7 , further comprising:

displaying, via the XR interface, at least one configurable element to change a scale of the model of the room;

detecting, via at least one XR control device, manipulation of the at least one configurable element; and

changing the scale of the model of the room responsive to detecting manipulation of the at least one configurable element.

11. The method of claim 7 , further comprising:

receiving, via a texture selection device, input from a user comprising an indication of a texture model from a plurality of texture models to apply to the first furniture model in the model of the room; and

applying the texture model to the first furniture model in the model of the room responsive to receiving the input.

12. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method comprising:

generating an XR interface using a model of a room, a plurality of furniture models corresponding to a plurality of pieces of furniture, and a plurality of texture models corresponding to a plurality of textures;

displaying, via the XR interface, a first furniture model of the plurality of furniture models;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface in the model of the room that meets at least one placement constraint;

displaying, via the XR interface, the first furniture model placed on the first surface;

displaying, via the XR interface, a texture display comprising at least some of the plurality of texture models;

detecting manipulation of a first texture model in the texture display; and

applying the first texture model to the first furniture model responsive to manipulation of the first texture model in the texture display.

13. The at least one non-transitory computer-readable storage medium of claim 12 , wherein the method further comprises:

identifying a flat surface of a second furniture model in the model of the room; and

permitting, based on the at least one placement constraint, placement of the first furniture model onto the flat surface of the second furniture model in the XR interface.

14. The at least one non-transitory computer-readable storage medium of claim 12 , wherein the method further comprises:

detecting manipulation of a second texture model in the texture display, wherein the second texture model is different than the first texture model; and

applying the second texture model to the first furniture model responsive to manipulation of the second texture model in the texture display.

15. The at least one non-transitory computer-readable medium of claim 12 , wherein the method further comprises:

displaying, via the XR interface, at least one configurable element to change a scale of the model of the room;

detecting, via at least one XR control device, manipulation of the at least one configurable element; and

changing the scale of the model of the room responsive to detecting manipulation of the at least one configurable element.

16. The at least one non-transitory computer-readable medium of claim 12 , wherein the method further comprises:

generating, via a XR object tracking system, information indicative of a location of a real-world object that corresponds to the first furniture model in the model of the room;

detecting, via the XR object tracking system, movement of the real-world object using the information indicative of the location of the real-world object; and

moving the corresponding first furniture model in the model of the room based on the detected movement of the real-world object.

17. The at least one non-transitory computer-readable medium of claim 12 , wherein:

detecting manipulation of the first texture model in the texture display comprises receiving, via a texture selection device, input from a user indicating a selection of the first texture model to apply to the first furniture model in the model of the room; and

applying the first texture model comprises applying the first texture model to the first furniture model in the model of the room responsive to receiving the input.

18. The at least one non-transitory computer-readable medium of claim 12 , wherein the method further comprises:

receiving an altered design of the model of the room, the altered design comprising one or more of: a change to the first furniture model, a change to a location of the first furniture model in the model of the room, and an addition of a second furniture model in the model of the room; and

displaying, via the XR interface, the altered design of the model of the room.

19. The at least one non-transitory computer-readable medium of claim 12 , wherein the method further comprises:

displaying, via the XR interface, a second furniture model of the plurality of furniture models;

detecting manipulation of a second texture model in the texture display; and

applying the second texture model to the second furniture model responsive to manipulation of the second texture model in the texture display.

20. The at least one non-transitory computer-readable medium of claim 12 , wherein:

displaying, via the XR interface, the texture display comprises displaying, via the XR interface, the texture display comprising images of the at least some of the plurality of texture models; and

detecting manipulation of the first texture model in the texture display comprises detecting manipulation of an image of the first texture model in the texture display.

21. A system, comprising:

at least one hardware processor; and

at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform:

generating an extended reality (XR) interface using a model of a room and a plurality of furniture models corresponding to a plurality of pieces of furniture;

displaying, via the XR interface, a first furniture model of the plurality of furniture models;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface in the model of the room;

displaying, via the XR interface, the first furniture model placed on the first surface;

generating, via an XR object tracking system communicably coupled to the at least one hardware processor, information indicative of a location of a real-world object that corresponds to the first furniture model in the model of the room;

detecting, via the XR object tracking system, movement of the real-world object using the information indicative of the location of the real-world object; and

moving the corresponding first furniture model in the model of the room based on the detected movement of the real-world object.

22. The system of claim 21 , further comprising:

an XR display device communicably coupled to the at least one hardware processor and configured to display the XR interface to a user.

23. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method comprising:

generating an extended reality (XR) interface using a model of a room and a plurality of furniture models corresponding to a plurality of pieces of furniture;

displaying, via the XR interface, a first furniture model of the plurality of furniture models;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface in the model of the room;

displaying, via the XR interface, the first furniture model placed on the first surface;

generating, via an XR object tracking system, information indicative of a location of a real-world object that corresponds to the first furniture model in the model of the room;

detecting, via the XR object tracking system, movement of the real-world object using the information indicative of the location of the real-world object; and

moving the corresponding first furniture model in the model of the room based on the detected movement of the real-world object.

24. A system, comprising:

at least one hardware processor; and

at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform:

generating an extended reality (XR) interface using a model of a room, a plurality of furniture models corresponding to a plurality of pieces of furniture, and a plurality of texture models corresponding to a plurality of textures;

displaying, via the XR interface, a first furniture model of the plurality of furniture models;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface in the model of the room that meets at least one placement constraint;

displaying, via the XR interface, the first furniture model placed on the first surface;

displaying, via the XR interface, a texture display comprising at least some of the plurality of texture models;

detecting manipulation of a first texture model in the texture display; and

applying the first texture model to the first furniture model responsive to manipulation of the first texture model in the texture display.

25. The system of claim 24 , further comprising:

an XR display device communicably coupled to the at least one hardware processor and configured to display the XR interface to a user.

26. A method, comprising:

generating an extended reality (XR) interface using a model of a room, a plurality of furniture models corresponding to a plurality of pieces of furniture, and a plurality of texture models corresponding to a plurality of textures;

displaying, via the XR interface, a first furniture model of the plurality of furniture models;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface in the model of the room that meets at least one placement constraint;

displaying, via the XR interface, the first furniture model placed on the first surface;

displaying, via the XR interface, a texture display comprising at least some of the plurality of texture models;

detecting manipulation of a first texture model in the texture display; and

applying the first texture model to the first furniture model responsive to manipulation of the first texture model in the texture display.

Assignments (6)
SECURITY AGREEMENT Recorded May 20, 2026
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 075591/0399 →
SECURITY INTEREST Recorded Nov 10, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 073514/0326 →
SECURITY AGREEMENT Recorded Mar 13, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 070513/0542 →
SECURITY AGREEMENT Recorded Oct 10, 2024
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 069143/0399 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2021
From: SCHENCK, MICHAEL PHILIP; SADALGI, SHRENIK; FESTA, MICHAEL SILVIO
To: WAYFAIR LLC
Reel/Frame 057586/0106 →
SECURITY AGREEMENT Recorded Mar 24, 2021
From: WAYFAIR LLC
To: CITIBANK, N.A.
Reel/Frame 055708/0832 →
Continuity (4)
Continuation 16271714 · Feb 8, 2019
Provisional Application 62743019 · Oct 9, 2018
Provisional Application 62629627 · Feb 12, 2018
Related Publication 20210019041A1 · Jan 21, 2021