IP Library Granted Patent US 12,608,357
Granted Patent B2
US 12,608,357 · App. 18/412,686 · Granted Apr 21, 2026

Visual design system for generating a visual data structure associated with a semantic composition based on a hierarchy of components

Inventors: Roni Ben-Aharon (Tel Aviv, IL); Nadav Abrahami (Tel Aviv, IL); Uri Dromy (Tel Aviv, IL); Barak Igal (Kfar Yehoshua, IL); Daphna Ofek (Ginaton, IL)
Assignee: Wix.com Ltd.
G06F16/2246G06F3/00G06F3/0481G06F3/0486G06F8/24G06F16/9577G06F16/958G06F40/106G06F40/143G06F40/186G06F16/88G06F40/154G06F40/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,608,357
App. No.
18/412,686
Granted
Apr 21, 2026
Kind
B2
Abstract

A system for a visual design system (VDS) includes storing at least one layout and an associated layout signature where the associated layout signature represents a hierarchical composition of the semantic types of the components; a unit to analyze components of an existing layout provided by a user of the VDS, to determine a component set signature, to compare it with at least one stored associated layout signature and to find a set of candidate layouts which are visually diverse and semantically similar to the existing layout; where the unit presents the set of candidate layouts to the user, updates the existing layout according to a user selected layout. It also includes an experiment system to create, run and analyze the results of at least one experiment using at least one of: A/B and multivariate testing on user selected layouts to provide information on user preferred layouts for the VDS.

Claims (43)

1 . A visual design system (VDS), the VDS comprising:

a processor;

a database to store at least one layout and an associated layout signature wherein said associated layout signature represents a hierarchical composition of semantic component types of its components;

a unit running on said processor determine a component set signature for an existing layout, to compare said component set signature with at least one associated layout signature of at least one layout from said database to find a set of candidate layouts for said existing layout;

wherein said unit comprises:

a signature extractor to extract said component set signature from said existing layout by performing at least one of: semantic type mapping of components of said existing layout, dividing sematic types according to visual properties of said components and generating signature elements according to component semantic types;

a page analyzer to analyze at least said semantic types and to generate said component set signature, said page analyzer comprising at least a layout splitter to divide said existing layout according to at least one of: geometrical considerations, semantic links and dynamic layout anchors;

a layout rater to determine a score for a candidate layout as a function of at least a layout rater learning system, trained on layouts selected and applied by users of said VDS, layouts tested by users of said VDS and discarded, feedback from users of said VDS and actual page viewing/rating information of implemented layouts, wherein said layout rater recalculates said score according to said learning system; and

a ranker to rank candidate layouts according to said qulity score to produce a final set of candidate layouts;

which are visually diverse and semantically similar to said existing layout; and

an experiment system to create and run at least one experiment using at least one of: A/B and multivariate testing on said final set of candidate layouts to gather information on user preferred layouts to present to said user; and

an adapter and applier to adapt at least attributes, component types and content of said existing layout to a user selected preferred quality layout.

2 . The system according to claim 1 and wherein said experiment system comprises:

an experiment manger to coordinate said at least one experiment;

an experiment creator to receive said final set of candidate layouts and to present said final set of candidate layouts to said user for selection as part of said at least one experiment; and

an experiment analyzer to analyze user selected layouts to provide said information on user preferred layouts for said VDS.

3 . The system according to claim 1 wherein said at least one experiment is according to at least one of: a visual quality of said user selected layouts, an explicit user metric, an implicit user metric and a system use metric.

4 . The system according to claim 1 and wherein said page analyzer comprises:

at least one of:

a component splitter to split at least one component of said existing layout according to the content of said at least one component;

a component filter to filter out unsuitable components for said signature extractor; a component merger to unite at least two components for layout processing and signature extraction by said signature extractor; and

a container handler to reduce the amount of different component set signatures for said existing layout by performing at least one of: using hierarchical signatures, container flattening, container flattening and reconstruction, single component container replacement; dominant type selection and recursive implementation.

5 . The system according to claim 1 and wherein said VDS is a website building system.

6 . A method for a visual design system (VDS), the method comprising:

storing in a database, at least one layout and an associated layout signature wherein said associated layout signature represents a hierarchical composition of semantic component types of its components

determining a component set signature for an existing layout wherein said determining a component set signature comprises: extracting said component set signature from said existing layout by performing at least one of: semantic type mapping of components of said existing layout, dividing sematic types according to visual properties of said components and generating signature elements according to component semantic types;

analyzing at least said semantic types and generating said component set signature, said analyzing comprising at least dividing said existing layout according to at least one of: geometrical considerations, semantic links and dynamic layout anchors; comparing said component set signature with at least one associated layout signature of at least one layout from said database to find a set of candidate layouts for said existing layout;

determining a score for a candidate layout as a function of at least a layout rater learning system trained on layouts selected and applied by users of said VDS, layouts tested by users of said VDS and discarded, feedback from users of said VDS and actual page viewing/rating information of implemented layouts, wherein said layout rater recalculates said score according to said learning system; and

ranking candidate layouts according to said score to produce a final set of candidate layouts which are visually diverse and semantically similar to said existing layout;

creating and running the results of at least one experiment using at least one of: A/B and multivariate testing on said final set of candidate layouts to gather information on user preferred layouts to present to said user; and

adapting said existing layout to a user selected preferred layout.

7 . The method according to claim 6 wherein said running at least one of: A/B and multivariate testing comprises:

coordinating said at least one experiment;

receiving said final set of candidate layouts and presenting said final set of candidate layouts to said user for selection as part of said at least one experiment; and

analyzing user selected layouts to provide said information on preferred layouts for said VDS.

8 . The method according to claim 6 wherein said at least one experiment is according to at least one of: a visual quality of said user selected layouts, an explicit user metric, an implicit user metric and a system use metric.

9 . The method according to claim 6 and wherein said analyzing at least said semantic types comprises:

at least one of:

splitting at least one component of said existing layout according to the content of said at least one component;

filtering out unsuitable components for said extracting; and

uniting at least two components for layout processing and signature extraction by said extracting; and

reducing the amount of different component set signatures for said existing layout by performing at least one of: using hierarchical signatures, container flattening, container flattening and reconstruction, single component container replacement; dominant type selection and recursive implementation.

10 . The method according to claim 6 wherein said VDS is a website building system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2024
From: BEN-AHARON, RONI; ABRAHAMI, NADAV
To: WIX.COM LTD.
Reel/Frame 066191/0624 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2024
From: BEN-AHARON, RONI; DROMY, URI; IGAL, BARAK; OFEK, DAPHNA
To: WIX.COM LTD.
Reel/Frame 066191/0634 →
Continuity (20)
Continuation 17536155 · Nov 29, 2021
Continuation 16000907 · Jun 6, 2018
Continuation 15224579 · Jul 31, 2016
Continuation In Part 14926007 · Oct 29, 2015
Continuation In Part 14699828 · Apr 29, 2015
Continuation In Part 14207761 · Mar 13, 2014
Continuation In Part 14176166 · Feb 10, 2014
Continuation In Part 13959759 · Aug 6, 2013
Continuation In Part 13771119 · Feb 20, 2013
Provisional Application 62367151 · Jul 27, 2016
Provisional Application 62342955 · May 29, 2016
Provisional Application 62247766 · Oct 29, 2015
Provisional Application 62198725 · Jul 30, 2015
Provisional Application 62072460 · Oct 30, 2014
Provisional Application 61985489 · Apr 29, 2014
Provisional Application 61781866 · Mar 14, 2013
Provisional Application 61762902 · Feb 10, 2013
Provisional Application 61679814 · Aug 6, 2012
Provisional Application 61600726 · Feb 20, 2012
Related Publication 20240160615A1 · May 16, 2024
References Cited (73)
US 5623418A · Rostoker · 1997 [cited by examiner]
US 5956737A · King · 1999 [cited by applicant]
US 6604099B1 · Chung · 2003 [cited by applicant]
US 8091036B1 · Pavek · 2012 [cited by examiner]
US 8134575B2 · Wong · 2012 [cited by examiner]
US 8531398B1 · Gopi · 2013 [cited by examiner]
US 8713072B2 · Stolte · 2014 [cited by examiner]
US 8788935B1 · Hirsch · 2014 [cited by applicant]
US 9195640B1 · Donneau-Golencer · 2015 [cited by applicant]
US 9280752B2 · Pandrangi · 2016 [cited by applicant]
US 9513771B2 · Abrahami · 2016 [cited by applicant]
US 20020156929A1 · Hekmatpour · 2002 [cited by examiner]
US 20040205461A1 · Kaufman · 2004 [cited by applicant]
US 20040243593A1 · Stolte · 2004 [cited by examiner]
US 20060015494A1 · Keating · 2006 [cited by applicant]
US 20060055670A1 · Castrucci · 2006 [cited by examiner]
US 20060066905A1 · Takashima · 2006 [cited by applicant]
US 20060200759A1 · Agrawala · 2006 [cited by examiner]
US 20070079236A1 · Schrier · 2007 [cited by examiner]
US 20070256053A1 · Torgerson · 2007 [cited by examiner]
US 20070266307A1 · Panditharadhya · 2007 [cited by examiner]
US 20080034292A1 · Brunner · 2008 [cited by examiner]
US 20080126020A1 · Hoguet · 2008 [cited by examiner]
US 20080163069A1 · Eilers · 2008 [cited by applicant]
US 20090019111A1 · Emmelmann · 2009 [cited by examiner]
US 20090044126A1 · Wyler · 2009 [cited by applicant]
US 20090177959A1 · Chakrabarti · 2009 [cited by examiner]
US 20100083215A1 · Bogl · 2010 [cited by examiner]
US 20100194753A1 · Robotham · 2010 [cited by applicant]
US 20100217566A1 · Wayne · 2010 [cited by examiner]
US 20110077048A1 · Busch · 2011 [cited by applicant]
US 20110276874A1 · Dejean · 2011 [cited by applicant]
US 20120042240A1 · Oliveira · 2012 [cited by applicant]
US 20120084656A1 · Garroch · 2012 [cited by examiner]
US 20120084689A1 · Ledet · 2012 [cited by examiner]
US 20120185805A1 · Louch · 2012 [cited by examiner]
US 20120254733A1 · Tucovic · 2012 [cited by examiner]
US 20120278704A1 · Ying · 2012 [cited by applicant]
US 20130014008A1 · Damera-Venkata · 2013 [cited by applicant]
US 20130124968A1 · Dontcheva · 2013 [cited by examiner]
US 20130219263A1 · Abrahami · 2013 [cited by applicant]
US 20130275892A1 · Li · 2013 [cited by applicant]
US 20140101533A1 · Imrich · 2014 [cited by applicant]
US 20140229821A1 · Abrahami · 2014 [cited by applicant]
US 20140282049A1 · Lyon · 2014 [cited by applicant]
US 20140282218A1 · Kaufman · 2014 [cited by applicant]
US 20140331124A1 · Downs · 2014 [cited by applicant]
US 20150074516A1 · Ben-Aharon · 2015 [cited by applicant]
US 20150100406A1 · Klimetschek · 2015 [cited by applicant]
US 20150161585A1 · Huster · 2015 [cited by applicant]
US 20150206169A1 · Ye · 2015 [cited by applicant]
US 20160092419A1 · Farouki · 2016 [cited by applicant]
US 20160124839A1 · Mordo · 2016 [cited by applicant]
US 20170032050A1 · Kol · 2017 [cited by applicant]
US 20190332861A1 · Biswas · 2019 [cited by applicant]
JP 2009230260A · 2009 [cited by applicant]
WO WO2004068320A2 · 2004 [cited by examiner]
WO WO2005098757A2 · 2005 [cited by examiner]
WO WO2007081766A1 · 2007 [cited by examiner]
WO WO2009114216A1 · 2009 [cited by examiner]
WO WO2009154484A2 · 2009 [cited by examiner]
Ian Vollick et al., “Specifying label layout style by example”, UIST '07: Proceedings of the 20th annual ACM symposium on User interface software and technology pp. 221-230. [cited by examiner]
Jia Deng et al., “Hierarchical semantic indexing for large scale image retrieval”, CVPR 2011, Conference Location: Colorado Springs, CO, USA, Jun. 2011, pp. 1-8. [cited by examiner]
Huiqin Huang et al., “The application analysis of visual elements in the graphic design”, 2009 IEEE 10th International Conference on Computer-Aided Industrial Design & Conceptual Design (2009, pp. 1727-1730). [cited by examiner]
Yanan Huang et al., “A Visual Interface Design Method for Virtual Heritage Based on User Participation”, Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007) (2007, pp. 242-247). [cited by examiner]
Christian K. Shin et al., “Classification of document page images based on visual similarity of layout structure”, Center for Automation Research, University of Maryland, 1999. [cited by applicant]
Danai Koutra et al., “Algorithms for Graph Similarity and Subgraph Matching”, Machine Learning Department, Carnegie Mellon University, Dec. 2011. [cited by applicant]
Gisii R. Hjaltason et al., “Contractive embedding methods for similarity searching in metric spaces”, Center for Automation Research, University of Maryland, Jan. 2000. [cited by applicant]
International Search Report for corresponding PCT application PCT/IB2016/054602 dated Dec. 8, 2016. [cited by applicant]
International Search Report for corresponding PCT application to the parent application PCT/IB2015/053126 dated Aug. 14, 2015. [cited by applicant]
Marcos R. Vieira et al., “On query result diversification”, 2011. [cited by applicant]
Supplementary European Search Report for corresponding European application 16 82 9947.7 dated Apr. 4, 2019. [cited by applicant]
Xianjun Sam Zheng et al., “Correlating low-level image statistics with users' rapid aesthetic and affective judgments of web pages”, International Conference on Human Factors in Computing Systems (SIGCHI), Apr. 2009. [cited by applicant]