IP Library Granted Patent US 10,838,600
Granted Patent B2
US 10,838,600 · App. 16/271,714 · Granted Nov 17, 2020

Systems and methods for providing an extended reality interface

Inventors: Michael Philip Schenck (Malden, MA); Shrenik Sadalgi (Cambridge, MA); Michael Silvio Festa (Wakefield, MA)
Assignee: Wayfair LLC
G06F3/04845G01P13/00G01S5/16G06F3/0482G06F3/04815G06F16/53G06F3/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,838,600
App. No.
16/271,714
Granted
Nov 17, 2020
Kind
B2
Abstract

Some embodiments include a system comprising an extended reality (XR) display device configured to display an XR interface to a user; at least one hardware processor communicatively coupled to the XR display device and configured to perform: receiving a model of a room; receiving a plurality of furniture models corresponding to a plurality of pieces of furniture; providing the XR interface using the model of the room and the plurality of furniture models at least in part by: displaying, via the XR display device, a furniture display comprising at least some of the plurality of furniture models and a search field to permit entry of text; detecting entry of a text string into the search field; identifying, using the text string, at least one furniture model from the plurality of furniture models; and displaying, via the XR display device, the at least one furniture model in the furniture display.

Claims (87)

1. A system, comprising:

an extended reality (XR) display device configured to display an XR interface to a user;

at least one hardware processor communicatively coupled to the XR display device; and

at least one non-transitory computer-readable storage medium storing processor executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform:

receiving a model of a room;

receiving a plurality of furniture models corresponding to a plurality of pieces of furniture;

generating the XR interface using the model of the room and the plurality of furniture models and displaying the XR interface via the XR display device;

displaying, via the XR interface, a furniture display comprising at least some of the plurality of furniture models and a search field to permit entry of text;

detecting entry of a text string into the search field;

identifying, using the text string, at least one furniture model from the plurality of furniture models;

displaying, via the XR interface, the at least one furniture model in the furniture display;

detecting manipulation of a first furniture model of the at least one furniture model in the furniture display;

identifying at least one placement criteria responsive to detecting the manipulation of the first furniture model, the at least one placement criteria indicative of one or more surfaces in the model of the room on which the first furniture model may be placed and/or one or more surfaces in the model of the room on which the first furniture model may not be placed;

adding the first furniture model to the XR interface by placing the first furniture model on a first surface that meets the at least one placement criteria; and

displaying, via the XR interface, the first furniture model placed on the first surface.

2. The system of claim 1 , wherein the processor-executable instructions further cause the at least one hardware processor to perform:

identifying a flat surface of a second furniture model in the model of the room; and

permitting, based on the at least one placement criteria, placement of the first furniture model onto the flat surface of the second furniture model in the XR interface.

3. The system of claim 1 , wherein the processor-executable instructions further cause the at least one hardware processor to perform receiving a plurality of texture models corresponding to a plurality of textures and wherein the XR interface is generated using the plurality of texture models.

4. The system of claim 3 , further comprising:

at least one XR control device configured to receive input from the user in the XR interface; and

wherein the processor-executable instructions further cause the at least one hardware processor to perform:

displaying, via the XR interface, a texture display comprising at least some of the plurality of texture models;

detecting, via the at least one XR control device, manipulation of a texture model in the texture display; and

applying the texture model in the texture display to the first furniture model in the model of the room responsive to manipulation of the texture model in the texture display.

5. The system of claim 1 , further comprising:

at least one XR control device configured to receive input from the user in the XR interface;

wherein the processor-executable instructions further cause the at least one hardware processor to perform:

displaying, via the XR interface, at least one configurable element to change a scale of the model of the room;

detecting, via the at least one XR control device, manipulation of the at least one configurable element; and

changing the scale of the model of the room responsive to detecting manipulation of the at least one configurable element.

6. The system of claim 1 , further comprising a XR object tracking system communicatively coupled to the at least one hardware processor and configured to generate information indicative of a location of a real-world object that corresponds to the first furniture model in the model of the room.

7. The system of claim 6 , wherein the XR object tracking system comprises:

a plurality of infrared (IR) detectors that are attached to the real-world object; and

at least one light source configured to emit IR light.

8. The system of claim 6 , wherein the processor-executable instructions further cause the at least one hardware processor to perform:

detecting, via the XR object tracking system, movement of the real-world object using the information indicative of the location of the real-world object; and

moving the corresponding first furniture model in the model of the room based on the detected movement of the real-world object.

9. The system of claim 1 , further comprising:

a texture selection device configured to receive input from the user comprising an indication of a texture model from a plurality of texture models to apply to the first furniture model in the model of the room, the texture selection device comprising a plurality of texture selection elements each being associated with one texture model of the plurality of texture models.

10. A method, comprising:

receiving a model of a room;

receiving a plurality of furniture models corresponding to a plurality of pieces of furniture;

generating an XR interface using the model of the room and the plurality of furniture models and displaying the XR interface via an XR display device;

displaying, via the XR interface, a furniture display comprising at least some of the plurality of furniture models and a search field to permit entry of text;

detecting entry of a text string into the search field;

identifying, using the text string, at least one furniture model from the plurality of furniture models;

displaying, via the XR interface, the at least one furniture model in the furniture display;

detecting manipulation of a first furniture model of the at least one furniture model in the furniture display;

identifying at least one placement criteria responsive to detecting the manipulation of the first furniture model, the at least one placement criteria indicative of one or more surfaces in the model of the room on which the first furniture model may be placed and/or one or more surfaces in the model of the room on which the first furniture model may not be placed;

adding the first furniture model to the XR interface by placing the first furniture model on a surface that meets the at least one placement criteria; and

displaying, via the XR interface, the first furniture model placed on the first surface.

11. The method of claim 10 , further comprising:

identifying a flat surface of a second furniture model in the model of the room; and

permitting, based on the at least one placement criteria, placement of the first furniture model onto the flat surface of the second furniture model in the XR interface.

12. The method of claim 10 , further comprising:

receiving a plurality of texture models corresponding to a plurality of textures and wherein the XR interface is generated using the plurality of texture models.

13. The method of claim 12 , further comprising:

displaying, via the XR interface, a texture display comprising at least some of the plurality of texture models;

detecting, via at least one XR control device, manipulation of a texture model in the texture display; and

applying the texture model in the texture display to the first furniture model in the model of the room responsive to manipulation of the texture model in the texture display.

14. The method of claim 10 , further comprising:

displaying, via the XR interface, at least one configurable element to change a scale of the model of the room;

detecting, via at least one XR control device, manipulation of the at least one configurable element; and

changing the scale of the model of the room responsive to detecting manipulation of the at least one configurable element.

15. The method of claim 10 , further comprising generating, via a XR object tracking system, information indicative of a location of a real-world object that corresponds to the first furniture model in the model of the room.

16. The method of claim 15 , further comprising:

detecting, via the XR object tracking system, movement of the real-world object using the information indicative of the location of the real-world object; and

moving the corresponding first furniture model in the model of the room based on the detected movement of the real-world object.

17. The method of claim 10 , further comprising:

receiving, via a texture selection device, input from the user comprising an indication of a texture model from a plurality of texture models to apply to the first furniture model in the model of the room; and

applying the texture model to the first furniture model in the model of the room responsive to receiving the input.

18. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform:

receiving a model of a room;

receiving a plurality of furniture models corresponding to a plurality of pieces of furniture;

generating an XR interface using the model of the room and the plurality of furniture models and displaying the XR interface via an XR display device;

displaying, via the XR interface, a furniture display comprising at least some of the plurality of furniture models and a search field to permit entry of text;

detecting entry of a text string into the search field;

identifying, using the text string, at least one furniture model from the plurality of furniture models;

displaying, via the XR interface, the at least one furniture model in the furniture display;

detecting manipulation of a first furniture model of the at least one furniture model in the furniture display;

identifying at least one placement criteria responsive to detecting the manipulation of the first furniture model, the at least one placement criteria indicative of one or more surfaces in the model of the room on which the first furniture model may be placed and/or one or more surfaces in the model of the room on which the first furniture model may not be placed;

adding the first furniture model to the XR interface by placing the first furniture model on a surface that meets the at least one placement criteria; and

displaying, via the XR interface, the first furniture model placed on the first surface.

19. The method of claim 10 , further comprising:

receiving an altered design of the model of the room, the altered design comprising one or more of: a change to the first furniture model, a change to a location of the first furniture model in the model of the room, and an addition of a second furniture model in the model of the room; and

displaying, via the XR interface, the altered design of the model of the room.

Assignments (6)
SECURITY AGREEMENT Recorded May 20, 2026
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 075591/0399 →
SECURITY INTEREST Recorded Nov 10, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 073514/0326 →
SECURITY AGREEMENT Recorded Mar 13, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 070513/0542 →
SECURITY AGREEMENT Recorded Oct 10, 2024
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 069143/0399 →
SECURITY AGREEMENT Recorded Mar 24, 2021
From: WAYFAIR LLC
To: CITIBANK, N.A.
Reel/Frame 055708/0832 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2019
From: SCHENCK, MICHAEL PHILIP; SADALGI, SHRENIK; FESTA, MICHAEL SILVIO
To: WAYFAIR LLC
Reel/Frame 048549/0060 →
Continuity (3)
Provisional Application 62743019 · Oct 9, 2018
Provisional Application 62629627 · Feb 12, 2018
Related Publication 20190250802A1 · Aug 15, 2019