IP Library › Granted Patent US 12,639,052
Granted Patent B2
US 12,639,052 · App. 18/462,116 · Granted May 26, 2026

Generating and editing user interfaces via chat

Inventors: Nikolas Louis Ciminelli (Buffalo, NY); Tom Zeev Jacob Palny (Tel Aviv-Yaffo, IL); Ron Zass (Kiryat Tivon, IL)
Assignee: Tweak Commerce Inc.
G06F8/38G06F3/04842G06F3/04845G06F3/04847G06F3/0487G06F8/36G06F8/71G06F9/451G06F40/253G06F40/30G06F40/40G06F40/58G06T11/60G06V30/422H04L67/306H04W4/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,639,052
App. No.
18/462,116
Filed
Sep 6, 2023
Granted
May 26, 2026
Kind
B2
Examiner
ORR, HENRY W
Art Unit
2172
USPC
715/762
Abstract

Systems, methods and non-transitory computer readable media for generating and editing user interfaces via chat and/or sketches are provided. A first textual input and/or sketch associated with a desire to modify a design of a user interface may be received. The first textual input and/or sketch may be analyzed to determine at least one change to the first version of the design. The at least one change may be associated with a level. The determined at least one change may be implemented to generate a second version of the design. The second version may be associated with the level. A second textual input and/or sketch associated with a desire to adjust the level may be received. The second textual input and/or sketch may be analyzed to generate a third version of the design. The third version may be associated with an adjusted level.

Claims (77)

1 . A non-transitory computer readable medium storing computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for generating and editing user interfaces via chat, the operations comprising:

receiving digital data associated with a first version of a design of a user interface;

using the digital data to cause a first presentation of the user interface to an individual, the first presentation is based on the first version of the design;

receiving from the individual a first input in a natural language, the first input is associated with a desire of the individual to modify the design of the user interface;

analyzing the first input to determine at least one change to the first version of the design of the user interface, wherein the at least one change is associated with a level of density of user interface elements of the user interface;

implementing the determined at least one change to generate a second version of the design of the user interface, the second version is associated with the level of density of the user interface elements;

causing a second presentation of the user interface to the individual, the second presentation is based on the generated second version of the design;

receiving from the individual a second input in the natural language, the second input is associated with a desire of the individual to adjust the level of density of the user interface elements;

analyzing the second input to generate a third version of the design of the user interface, the third version is associated with an adjusted level of density of the user interface elements, wherein a numerical value associated with the adjusted level of density is determined by calculating a function of a numerical value associated with the level of density and a mathematical object based on the second input; and

causing a third presentation of the user interface to the individual, the third presentation is based on the generated third version of the design.

2 . The non-transitory computer readable medium of claim 1 , wherein the level is further associated with an opacity of a background of the user interface.

3 . The non-transitory computer readable medium of claim 1 , wherein the second input includes an adjective, the mathematical object is based on the adjective, and the operations further comprise determining whether to increase or decrease the level based on the adjective.

4 . The non-transitory computer readable medium of claim 1 , wherein the second input includes a verb, the mathematical object is based on the verb, and the operations further comprise determining whether to increase or decrease the level based on the verb.

5 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

halting the second presentation of the user interface;

after halting the second presentation of the user interface and presenting the third presentation, receiving from the individual a third input in the natural language, the third input is associated with a desire of the individual to undo the adjustment; and

in response to the third input, halting the third presentation and resuming the presentation of the user interface based on the generated second version of the design to restore the level while maintaining the implemented at least one change.

6 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

receiving from the individual a third input in the natural language, the third input is associated with a desire of the individual to moderate the adjustment;

analyzing the third input to generate a fourth version of the design of the user interface, the fourth version is associated with an intermediate level of density of the user interface elements between the level of density of the user interface elements and the adjusted level of density of the user interface elements, wherein the intermediate level of density is a value distinct from the level of density and the adjusted level of density; and

causing a fourth presentation of the user interface to the individual, the fourth presentation is based on the generated fourth version of the design.

7 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise using a multimodal machine learning model to analyze the first input to determine the at least one change to the first version of the design of the user interface.

8 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

identifying a first mathematical object in a mathematical space, the first mathematical object corresponds to a first word of the first input;

identifying a second mathematical object in the mathematical space, the second mathematical object corresponds to a second word of the first input;

calculating a function of the first mathematical object and the second mathematical object to obtain a third mathematical object in the mathematical space; and

determining the numerical value associated with the level of density based on the third mathematical object.

9 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

identifying a first mathematical object in a mathematical space, the first mathematical object corresponds to a word of the first input;

identifying a second mathematical object in the mathematical space, the second mathematical object corresponds to a word of the second input;

calculating a function of the first mathematical object and the second mathematical object to obtain a third mathematical object in the mathematical space; and

determining the numerical value associated with the adjusted level of density based on the third mathematical object.

10 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise presenting a numerical indication of the level of density of the user interface elements with the second presentation, and presenting a numerical indication of the adjusted level of density of the user interface elements that is automatically determined by the analyzing of the second input with the third presentation.

11 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise;

analyzing the first input to determine the numerical value associated with the level of density;

identifying a first mathematical object in a mathematical space, the first mathematical object corresponds to a word of the second input;

calculating a function of the first mathematical object and the numerical value associated with the level of density to obtain a second mathematical object in the mathematical space; and

determining the numerical value associated with the adjusted level of density based on the second mathematical object.

12 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

receiving a third input in the natural language from the individual after the third presentation, the third input comprising an interjection;

analyzing the interjection to determine a degree of success of the adjusted level of density; and

in response to the degree of success indicating displeasure with the adjusted level of density, automatically generating a fourth version of the design of the user interface.

13 . The non-transitory computer readable medium of claim 1 , wherein the user interface includes a webpage.

14 . The non-transitory computer readable medium of claim 1 , wherein the user interface is a user interface of an app.

15 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

receiving a sketch from the individual, the sketch is associated with the desire of the individual to modify the design of the user interface; and

analyzing the first input and the sketch to determine the numerical value associated with the level of density.

16 . The non-transitory computer readable medium of claim 15 , wherein the sketch includes a plurality of pixel values, and the operations further comprise:

calculating a convolution of at least part of the pixel values of the sketch to obtain a result value;

identifying a first mathematical object in the mathematical space, the first mathematical object corresponds to a word of the first input;

calculating a function of the result value and the first mathematical object to obtain a second mathematical object in the mathematical space; and

basing the determination of the numerical value associated with the level of density on the second mathematical object.

17 . The non-transitory computer readable medium of claim 1 , wherein the at least one change is associated with an additional level, and the operations further comprise:

analyzing the second input to determine whether to adjust the additional level; and

basing the generation of the third version of the design of the user interface on the determination of whether to adjust the additional level, wherein when the determination is to adjust the additional level, the third version is associated with the adjusted level and an adjusted additional level, and when the determination is not to adjust the additional level, the third version is associated with the adjusted level and the additional level, wherein the determination not to adjust the additional level is based on identifying that the second input specifically identifies an attribute associated with the level and does not identify an attribute associated with the additional level.

18 . The non-transitory computer readable medium of claim 17 , wherein the second input includes an adjective, the adjective identifies an attribute associated with the level, and the determination not to adjust the additional level is based on the adjective identifying an attribute associated with the level and not identifying an attribute associated with the additional level.

19 . The non-transitory computer readable medium of claim 17 , wherein the second input includes a noun, the noun identifies an attribute associated with the additional level, and the determination to adjust the additional level is based on the noun is based on the noun identifying the attribute associated with the additional level.

20 . A system for generating and editing user interfaces via chat, the system comprising: at least one processing unit configured to perform operations, the operations comprise:

receiving digital data associated with a first version of a design of a user interface;

using the digital data to cause a first presentation of the user interface to an individual, the first presentation is based on the first version of the design;

receiving from the individual a first input in a natural language, the first input is associated with a desire of the individual to modify the design of the user interface;

analyzing the first input to determine at least one change to the first version of the design of the user interface, wherein the at least one change is associated with a level of density of user interface elements of the user interface;

implementing the determined at least one change to generate a second version of the design of the user interface, the second version is associated with the level of density of the user interface elements;

causing a second presentation of the user interface to the individual, the second presentation is based on the generated second version of the design;

receiving from the individual a second input in the natural language, the second input is associated with a desire of the individual to adjust the level of density of the user interface elements;

analyzing the second input to generate a third version of the design of the user interface, the third version is associated with an adjusted level of density of the user interface elements, wherein a numerical value associated with the adjusted level of density is determined by calculating a function of a numerical value associated with the level of density and a mathematical object based on the second input; and

causing a third presentation of the user interface to the individual, the third presentation is based on the generated third version of the design.

21 . A method for generating and editing user interfaces via chat, the method comprising:

receiving digital data associated with a first version of a design of a user interface;

using the digital data to cause a first presentation of the user interface to an individual, the first presentation is based on the first version of the design;

receiving from the individual a first input in a natural language, the first input is associated with a desire of the individual to modify the design of the user interface;

analyzing the first input to determine at least one change to the first version of the design of the user interface, wherein the at least one change is associated with a level of density of user interface elements of the user interface;

implementing the determined at least one change to generate a second version of the design of the user interface, the second version is associated with the level of density of the user interface elements;

causing a second presentation of the user interface to the individual, the second presentation is based on the generated second version of the design;

receiving from the individual a second input in the natural language, the second input is associated with a desire of the individual to adjust the level of density of the user interface elements;

analyzing the second input to generate a third version of the design of the user interface, the third version is associated with an adjusted level of density of the user interface elements, wherein a numerical value associated with the adjusted level of density is determined by calculating a function of a numerical value associated with the level of density and a mathematical object based on the second input; and

causing a third presentation of the user interface to the individual, the third presentation is based on the generated third version of the design.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: PALNY, TOM ZEEV JACOB; CIMINELLI, NIKOLAS LOUIS; ZASS, RON
To: TWEAK COMMERCE INC.
Reel/Frame 065485/0695 →
Continuity (8)
Provisional Application 63534747 · Aug 25, 2023
Provisional Application 63444841 · Feb 10, 2023
Provisional Application 63441097 · Jan 25, 2023
Provisional Application 63439080 · Jan 14, 2023
Provisional Application 63436639 · Jan 2, 2023
Provisional Application 63426748 · Nov 19, 2022
Provisional Application 63405417 · Sep 10, 2022
Related Publication 20230418632A1 · Dec 28, 2023
References Cited (136)
US 4305131A · Best · 1981 [cited by applicant]
US 6077085A · Parry · 2000 [cited by applicant]
US 6778252B2 · Moulton et al. · 2004 [cited by applicant]
US 8140322B2 · Simonsen et al. · 2012 [cited by applicant]
US 9280973B1 · Soyannwo et al. · 2016 [cited by applicant]
US 9747282B1 · Baker et al. · 2017 [cited by applicant]
US 9864933B1 · Cosic · 2018 [cited by applicant]
US 10360716B1 · van der Meulen et al. · 2019 [cited by applicant]
US 10423999B1 · Doctor · 2019 [cited by applicant]
US 10467792B1 · Roche · 2019 [cited by applicant]
US 10607134B1 · Cosic · 2020 [cited by applicant]
US 10827024B1 · Schissel et al. · 2020 [cited by applicant]
US 11024194B1 · Beigman Klebanov · 2021 [cited by applicant]
US 11030255B1 · Tory · 2021 [cited by examiner]
US 11140459B2 · Ingel · 2021 [cited by applicant]
US 11159597B2 · Ingel · 2021 [cited by applicant]
US 11202131B2 · Zass · 2021 [cited by applicant]
US 11232645B1 · Roche et al. · 2022 [cited by applicant]
US 11244385B1 · Fraser · 2022 [cited by applicant]
US 11314817B1 · Tory · 2022 [cited by examiner]
US 11520079B2 · Zass · 2022 [cited by applicant]
US 11599086B2 · Jacobs, II · 2023 [cited by examiner]
US 11966688B1 · Ehrlich · 2024 [cited by applicant]
US 12147790B2 · Singh · 2024 [cited by examiner]
US 20020087317A1 · Lee et al. · 2002 [cited by applicant]
US 20020161578A1 · Saindon et al. · 2002 [cited by applicant]
US 20020161579A1 · Saindon et al. · 2002 [cited by applicant]
US 20040068410A1 · Mohamed et al. · 2004 [cited by applicant]
US 20040172257A1 · Liqin et al. · 2004 [cited by applicant]
US 20040186712A1 · Coles et al. · 2004 [cited by applicant]
US 20050255431A1 · Baker · 2005 [cited by applicant]
US 20050272013A1 · Knight · 2005 [cited by applicant]
US 20060285654A1 · Nesvadba et al. · 2006 [cited by applicant]
US 20070124166A1 · Van Luchene · 2007 [cited by applicant]
US 20070130529A1 · Shrubsole · 2007 [cited by applicant]
US 20070208569A1 · Subramanian et al. · 2007 [cited by applicant]
US 20070220575A1 · Cooper et al. · 2007 [cited by applicant]
US 20080015968A1 · Van Luchene et al. · 2008 [cited by applicant]
US 20080195386A1 · Proidl · 2008 [cited by applicant]
US 20080295130A1 · Worthen · 2008 [cited by applicant]
US 20090037179A1 · Liu et al. · 2009 [cited by applicant]
US 20090175596A1 · Hirai · 2009 [cited by applicant]
US 20100082326A1 · Bangalore · 2010 [cited by applicant]
US 20100100907A1 · Chang · 2010 [cited by applicant]
US 20100238179A1 · Kelly · 2010 [cited by applicant]
US 20110064388A1 · Brown et al. · 2011 [cited by applicant]
US 20110076992A1 · Chou · 2011 [cited by applicant]
US 20110078564A1 · Almodovar Herr Iz · 2011 [cited by examiner]
US 20120054619A1 · Spooner et al. · 2012 [cited by applicant]
US 20130038737A1 · Yehezkel et al. · 2013 [cited by applicant]
US 20130110513A1 · Jhunja et al. · 2013 [cited by applicant]
US 20130188862A1 · Lievens · 2013 [cited by applicant]
US 20140142918A1 · Dotterer et al. · 2014 [cited by applicant]
US 20140164507A1 · Tesch et al. · 2014 [cited by applicant]
US 20140303958A1 · Lee et al. · 2014 [cited by applicant]
US 20140358518A1 · Wu et al. · 2014 [cited by applicant]
US 20150092007A1 · Koborita et al. · 2015 [cited by applicant]
US 20150319518A1 · Wilson · 2015 [cited by applicant]
US 20150356967A1 · Byron et al. · 2015 [cited by applicant]
US 20160005436A1 · Axen et al. · 2016 [cited by applicant]
US 20160021334A1 · Rossano et al. · 2016 [cited by applicant]
US 20160042766A1 · Kummer · 2016 [cited by applicant]
US 20160049146A1 · Chang · 2016 [cited by applicant]
US 20160132578A1 · Allen · 2016 [cited by applicant]
US 20160254795A1 · Ballard · 2016 [cited by applicant]
US 20160328391A1 · Choi · 2016 [cited by applicant]
US 20160365087A1 · Freud · 2016 [cited by applicant]
US 20170004820A1 · Lv et al. · 2017 [cited by applicant]
US 20170011745A1 · Navaratnam · 2017 [cited by applicant]
US 20170075877A1 · Lepeltier · 2017 [cited by applicant]
US 20170076749A1 · Kanevsky · 2017 [cited by applicant]
US 20170255616A1 · Yun et al. · 2017 [cited by applicant]
US 20170308571A1 · McCurley · 2017 [cited by examiner]
US 20180143809A1 · Zang et al. · 2018 [cited by applicant]
US 20180174577A1 · Jothilingam et al. · 2018 [cited by applicant]
US 20180174595A1 · Dirac et al. · 2018 [cited by applicant]
US 20180253992A1 · Koul et al. · 2018 [cited by applicant]
US 20180260448A1 · Osotio et al. · 2018 [cited by applicant]
US 20180322875A1 · Adachi · 2018 [cited by applicant]
US 20180357215A1 · Austin et al. · 2018 [cited by applicant]
US 20180374461A1 · Serletic · 2018 [cited by applicant]
US 20190065478A1 · Tsujikawa et al. · 2019 [cited by applicant]
US 20190114302A1 · Bequet · 2019 [cited by examiner]
US 20190147043A1 · Moskowitz · 2019 [cited by examiner]
US 20190164533A1 · Lawrenson et al. · 2019 [cited by applicant]
US 20190166176A1 · Jain et al. · 2019 [cited by applicant]
US 20190250891A1 · Kumar et al. · 2019 [cited by applicant]
US 20190317739A1 · Turek · 2019 [cited by examiner]
US 20190354592A1 · Musham et al. · 2019 [cited by applicant]
US 20200005796A1 · Ziv et al. · 2020 [cited by applicant]
US 20200007946A1 · Olkha · 2020 [cited by applicant]
US 20200042601A1 · Doggett · 2020 [cited by applicant]
US 20200043112A1 · Brinkley, II · 2020 [cited by applicant]
US 20200051566A1 · Shin · 2020 [cited by applicant]
US 20200058289A1 · Gabryjelski et al. · 2020 [cited by applicant]
US 20200066304A1 · Chen · 2020 [cited by applicant]
US 20200105245A1 · Gupta · 2020 [cited by applicant]
US 20200111474A1 · Kumar et al. · 2020 [cited by applicant]
US 20200143813A1 · Nakagawa · 2020 [cited by applicant]
US 20200150981A1 · Westberg et al. · 2020 [cited by applicant]
US 20200159862A1 · Kleiner et al. · 2020 [cited by applicant]
US 20200174776A1 · Vinod et al. · 2020 [cited by applicant]
US 20200221176A1 · Hwang et al. · 2020 [cited by applicant]
US 20200296510A1 · Li et al. · 2020 [cited by applicant]
US 20200311120A1 · Zhao et al. · 2020 [cited by applicant]
US 20210019373A1 · Freitag · 2021 [cited by applicant]
US 20210042110A1 · Basyrov et al. · 2021 [cited by applicant]
US 20210063363A1 · Kaminski et al. · 2021 [cited by applicant]
US 20210081101A1 · Speare et al. · 2021 [cited by applicant]
US 20210097976A1 · Chicote et al. · 2021 [cited by applicant]
US 20210182468A1 · Co et al. · 2021 [cited by applicant]
US 20210192824A1 · Chen · 2021 [cited by applicant]
US 20210224319A1 · Ingel · 2021 [cited by applicant]
US 20210225365A1 · Sinha et al. · 2021 [cited by applicant]
US 20210232759A1 · Schick et al. · 2021 [cited by applicant]
US 20210264369A1 · Zass · 2021 [cited by applicant]
US 20210271815A1 · Li et al. · 2021 [cited by applicant]
US 20210279822A1 · Bellaish · 2021 [cited by applicant]
US 20210287150A1 · Zass · 2021 [cited by applicant]
US 20210303318A1 · Raghavan · 2021 [cited by applicant]
US 20210397418A1 · Nikumb et al. · 2021 [cited by applicant]
US 20210400101A1 · Ingel · 2021 [cited by applicant]
US 20220070550A1 · Ingel · 2022 [cited by applicant]
US 20220156994A1 · Adato · 2022 [cited by examiner]
US 20220382524A1 · Ansari et al. · 2022 [cited by applicant]
US 20230048149A1 · Zass · 2023 [cited by applicant]
US 20230049015A1 · Zass · 2023 [cited by applicant]
US 20230052442A1 · Zass · 2023 [cited by applicant]
US 20230057835A1 · Zass · 2023 [cited by applicant]
US 20230069088A1 · Zass · 2023 [cited by applicant]
US 20230095089A1 · Kaliyaperumal et al. · 2023 [cited by applicant]
US 20230115185A1 · Huang et al. · 2023 [cited by applicant]
US 20230145463A1 · Bayomi · 2023 [cited by examiner]
US 20230252224A1 · Tran · 2023 [cited by applicant]
US 20240220521A1 · Ehrlich · 2024 [cited by applicant]
US 20240220714A1 · Ehrlich · 2024 [cited by applicant]