IP Library Granted Patent US 10,599,708
Granted Patent B2
US 10,599,708 · App. 15/663,027 · Granted Mar 24, 2020

Multiple partial-image compositional searching

Inventors: Kimberly H. Cady (Raleigh, NC); Scott B. Greer (Essex Junction, VT); Andrew J. Lavery (Austin, TX); Sarah R. Plantenberg (San Francisco, CA)
Assignee: Wayfair LLC
G06F16/532G06F16/51G06F16/5838G06F16/5854G06F16/5866G06K9/46G06K9/6202G06Q30/0643G06K2009/4666
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,599,708
App. No.
15/663,027
Granted
Mar 24, 2020
Kind
B2
Abstract

Partial-image search criteria are derived that include a combination of multiple partial-image user selections of portions of at least one image. Visual search results are returned responsive to a search for images that correspond to the derived partial-image search criteria. The visual search results include at least one identified image that includes features that correspond to the derived partial-image search criteria that include the combination of the multiple partial-image user selections.

Claims (57)

1. A method, comprising:

deriving, by a processor, partial-image search criteria that comprise a combination of multiple image portions captured from at least one image responsive to partial-image user selections of the respective image portions; and

returning, responsive to a search for images that correspond to the derived partial-image search criteria, visual search results that comprise at least one identified image that comprises features that correspond to the derived partial-image search criteria that comprise the combination of the multiple image portions.

2. The method of claim 1 , further comprising:

providing a graphical multiple partial-image compositional search interface;

allowing, via the graphical multiple partial-image compositional search interface, a user to visually mash up a partial-image search selection set comprising the multiple image portions; and

receiving the multiple image portions from the graphical multiple partial-image compositional search interface.

3. The method of claim 1 , further comprising:

detecting partial-image search selection set editing by a user, comprising one of:

detecting a user adjustment of relative image positions of the multiple image portions; and

detecting a user deletion of at least one of the multiple image portions; and

refining the derived partial-image search criteria based upon the detected partial-image search selection set editing by the user.

4. The method of claim 1 , further comprising displaying each of the multiple image portions in a sequence within a partial-image search display area based upon an order of selection, by a user, of the respective image portions of the at least one image.

5. The method of claim 4 , further comprising:

detecting a user reordering of the displayed sequence of the multiple image portions within the partial-image search display area; and

adjusting an ordering of the derived partial-image search criteria based upon a combination of the user reordered displayed sequence of the multiple image portions.

6. The method of claim 1 , further comprising displaying the derived partial-image search criteria as text in association with the multiple image portions.

7. The method of claim 1 , where each of the multiple image portions of the at least one image comprises a two-dimensional partial-image user selected area of one image portion of the at least one image.

8. A system, comprising:

a display; and

a processor programmed to:

derive partial-image search criteria that comprise a combination of multiple image portions captured from at least one image responsive to partial-image user selections of the respective image portions; and

return, via the display responsive to a search for images that correspond to the derived partial-image search criteria, visual search results that comprise at least one identified image that comprises features that correspond to the derived partial-image search criteria that comprise the combination of the multiple image portions.

9. The system of claim 8 , where the processor is further programmed to:

provide a graphical multiple partial-image compositional search interface;

allow, via the graphical multiple partial-image compositional search interface, a user to visually mash up a partial-image search selection set comprising the multiple image portions; and

receive the multiple image portions from the graphical multiple partial-image compositional search interface.

10. The system of claim 8 , where the processor is further programmed to:

detect partial-image search selection set editing by a user, comprising the processor being programmed to one of:

detect a user adjustment of relative image positions of the multiple image portions; and

detect a user deletion of at least one of the multiple image portions; and

refine the derived partial-image search criteria based upon the detected partial-image search selection set editing by the user.

11. The system of claim 8 , where the processor is further programmed to:

display, via the display, each of the multiple image portions in a sequence within a partial-image search display area based upon an order of selection, by a user, of the respective image portions of the at least one image;

detect a user reordering of the displayed sequence of the multiple image portions within the partial-image search display area; and

adjust an ordering of the derived partial-image search criteria based upon a combination of the user reordered displayed sequence of the multiple image portions.

12. The system of claim 8 , where the processor is further programmed to display, via the display, the derived partial-image search criteria as text in association with the multiple image portions.

13. The system of claim 8 , where each of the multiple image portions of the at least one image comprises a two-dimensional partial-image user selected area of one image portion of the at least one image.

14. A computer program product, comprising:

a computer readable storage medium having computer readable program code embodied therewith, where the computer readable program code when executed on a computer causes the computer to:

derive partial-image search criteria that comprise a combination of multiple image portions captured from at least one image responsive to partial-image user selections of the respective image portions; and

return, responsive to a search for images that correspond to the derived partial-image search criteria, visual search results that comprise at least one identified image that comprises features that correspond to the derived partial-image search criteria that comprise the combination of the multiple image portions.

15. The computer program product of claim 14 , where the computer readable program code when executed on the computer further causes the computer to:

provide a graphical multiple partial-image compositional search interface;

allow, via the graphical multiple partial-image compositional search interface, a user to visually mash up a partial-image search selection set comprising the multiple image portions; and

receive the multiple image portions from the graphical multiple partial-image compositional search interface.

16. The computer program product of claim 14 , where the computer readable program code when executed on the computer further causes the computer to:

detect partial-image search selection set editing by a user, comprising causing the computer to one of:

detect a user adjustment of relative image positions of the multiple image portions; and

detect a user deletion of at least one of the multiple image portions; and

refine the derived partial-image search criteria based upon the detected partial-image search selection set editing by the user.

17. The computer program product of claim 14 , where the computer readable program code when executed on the computer further causes the computer to display each of the multiple image portions in a sequence within a partial-image search display area based upon an order of selection, by a user, of the respective image portions of the at least one image.

18. The computer program product of claim 17 , where the computer readable program code when executed on the computer further causes the computer to:

detect a user reordering of the displayed sequence of the multiple image portions within the partial-image search display area; and

adjust an ordering of the derived partial-image search criteria based upon a combination of the user reordered displayed sequence of the multiple image portions.

19. The computer program product of claim 14 , where the computer readable program code when executed on the computer further causes the computer to display the derived partial-image search criteria as text in association with the multiple image portions.

20. The computer program product of claim 14 , where each of the multiple image portions of the at least one image comprises a two-dimensional partial-image user selected area of one image portion of the at least one image.

Assignments (7)
SECURITY AGREEMENT Recorded May 20, 2026
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 075591/0399 →
SECURITY INTEREST Recorded Nov 10, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 073514/0326 →
SECURITY AGREEMENT Recorded Mar 13, 2025
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 070513/0542 →
SECURITY AGREEMENT Recorded Oct 10, 2024
From: WAYFAIR LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 069143/0399 →
SECURITY AGREEMENT Recorded Mar 24, 2021
From: WAYFAIR LLC
To: CITIBANK, N.A.
Reel/Frame 055708/0832 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: WAYFAIR LLC
Reel/Frame 050867/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2017
From: CADY, KIMBERLY H.; GREER, SCOTT B.; LAVERY, ANDREW J.; PLANTENBERG, SARAH R.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 043132/0325 →
Continuity (3)
Continuation 14641151 · Mar 6, 2015
Continuation 14253176 · Apr 15, 2014
Related Publication 20170329805A1 · Nov 16, 2017