IP Library Granted Patent US 12,737,784
Granted Patent B2
US 12,737,784 · App. 18/120,406 · Granted Sep 15, 2026

Method, computer readable storage media, and system for generating and determining additional content and products based on product-tokens

Inventors: Robert Beaver (San Francisco, CA); Leslie Young Harvill (Olympia, WA); Matthew DiFonzo (Belmont, CA); Brent Burgess (Winchester, GB)
Assignee: Zazzle Inc.
G06Q30/0627G06Q30/0621G06Q30/0643
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,737,784
App. No.
18/120,406
Granted
Sep 15, 2026
Kind
B2
Abstract

In some embodiments, a computer-implemented method comprises: using a client application executing on a user device, generating a user interface configured to receive one or more user characteristics; wherein the one or more user characteristics have been associated with one or more corresponding graph of transform invariant features product-tokens (GTIF product-tokens); receiving, by the client application executing on the user device, via the user interface, a particular characteristic of the one or more user characteristics; determining, by the client application, a particular GTIF product-token associated with the particular characteristic of the one or more user characteristics; determining whether the particular GTIF product-token, associated with the particular characteristic, matches a particular pair of a set of GTIF product-token pairs; in response to determining that the particular GTIF product-token matches the particular pair, determining particular additional content based on the particular pair, and displaying the particular additional content on the user device.

Claims (126)

1 . A method comprising:

using a client application executing on a user device, generating a user interface configured to receive one or more user characteristics of a custom product;

wherein the one or more user characteristics have been associated with one or more corresponding graph of transform invariant features product-tokens (GTIF product-tokens);

receiving, by the client application executing on the user device, via the user interface, a particular characteristic of the one or more user characteristics;

determining, by the client application, a particular GTIF product-token associated with the particular characteristic of the one or more user characteristics;

wherein the particular GTIF product-token is generated to comprise social relationship data of a product creator, using one or more of:

a scale-invariant feature transform feature recognition method (SIFT),

a simultaneous localization and mapping feature recognition method (SLAM), or

a speed up robust features feature recognition method (SURF);

wherein the social relationship data of the product creator is a link that is between the product creator and another user, and that is used to assign the product creator and another user to a sub-group of attendees that are participating in a specific event;

determining whether the particular GTIF product-token, associated with the particular characteristic, matches a particular pair of a set of GTIF product-token pairs;

wherein the set of GTIF product-token pairs comprises one or more of:

a pair comprising a known GTIF product-token and a location data determined for a location of a user device,

a pair comprising known GTIF product-token associated with a user of the user device and one or more social relationships defined for the user,

a pair comprising known time based data associated with one or more events defined for the user and the one or more events,

a pair comprising a known GTIF product-token and a representation of a physical object detected by a camera or sensors and communicated to the user device, or

a pair comprising a known GTIF product-token and a representation of a digital object provided by the user device;

in response to determining that the particular GTIF product-token matches the particular pair:

determining particular additional content based on the particular pair, and displaying the particular additional content on the user device;

generating manufacturing instructions for manufacturing a physical product corresponding to the custom product including the particular additional content;

encoding information about the particular GTIF product-token in the manufacturing instructions;

transmitting the manufacturing instructions, having the information about the particular GTIF product-token encoded in the manufacturing instructions, to a manufacturer;

causing the manufacturer to:

generate a physical product-token based on the information about the particular GTIF product-token encoded in the manufacturing instructions; and

embed the physical product-token onto the physical product.

2 . The method of claim 1 , wherein the one or more user characteristics comprise a user characteristic retrieved from a user profile associated with a user;

wherein the user profile stores information about the user and includes one or more of: a user location, a user preference, a user address, a username, a user age, user favorites, a user purchase history, or user travel destinations.

3 . The method of claim 1 , wherein the one or more user characteristics comprise a geographic location of a user;

wherein the geographic location of the user is determined using a Global Positioning System (GPS) installed in any of a user smartphone, a user car, or a user computing device.

4 . The method of claim 1 , wherein a GTIF product-token, of one or more corresponding GTIF product-tokens, is a complex data structure that is generated using advanced computer-based techniques that include one or more: encoding spatial representations of certain features identified in the product or determining a set of invariant features that are specific to the product;

wherein the set of invariant features includes features that remain invariant of any 2D transformation performed on the features of the product.

5 . The method of claim 1 , wherein a GTIF product-token for a product, of a pair of the set of GTIF product-token pairs, represents one or more of:

one or more of relationships between a plurality of transform-invariant features identified for the product, or

one or more relationships between the plurality of transform-invariant features identified for the product and other transform-invariant features identified for other products.

6 . The method of claim 1 , wherein the product has a plurality transform invariant features and a corresponding plurality of GTIF product-tokens;

wherein a GTIF product-token is used to determine whether the GTIF product-token matches a particular pair of the set of GTIF product-token pairs;

wherein a GTIF product-token pair comprises additional context data that include one or more of:

location data determined based on GPS location data obtained from one or more of: the location of the user device, a photo, an address of an event, or an address of customers or users;

social relationship data of a creator or a recipient of the product; or

time based data determined based on one or more of: a time of an event, a time when a photo was taken, or a time when a message was sent.

7 . The method of claim 1 , wherein the determining of the particular additional content based on the particular pair is a search that requires comparisons between non-directed graphs having a plurality of nodes, wherein the nodes represent transform invariant features, wherein a time for comparison performed as a series of instructions on computing machinery increases based on a number of comparisons, and wherein a number of transform invariant features exceeds practical limits of user interaction time.

8 . One or more non-transitory computer readable storage media storing one or more instructions which, when executed by one or more processors, cause the one or more processors to perform:

using a client application executing on a user device, generating a user interface configured to receive one or more user characteristics of a custom product;

wherein the one or more user characteristics have been associated with one or more corresponding graph of transform invariant features product-tokens (GTIF product-tokens);

receiving, by the client application executing on the user device, via the user interface, a particular characteristic of the one or more user characteristics;

determining, by the client application, a particular GTIF product-token associated with the particular characteristic of the one or more user characteristics;

wherein the particular GTIF product-token is generated to comprise social relationship data of a product creator, using one or more of:

a scale-invariant feature transform feature recognition method (SIFT),

a simultaneous localization and mapping feature recognition method (SLAM), or

a speed up robust features feature recognition method (SURF);

wherein the social relationship data of the product creator is a link that is between the product creator and another user, and that is used to assign the product creator and another user to a sub-group of attendees that are participating in a specific event;

determining whether the particular GTIF product-token, associated with the particular characteristic, matches a particular pair of a set of GTIF product-token pairs;

wherein the set of GTIF product-token pairs comprises one or more of:

a pair comprising a known GTIF product-token and a location data determined for a location of a user device,

a pair comprising known GTIF product-token associated with a user of the user device and one or more social relationships defined for the user,

a pair comprising known time based data associated with one or more events defined for the user and the one or more events,

a pair comprising a known GTIF product-token and a representation of a physical object detected by a camera or sensors and communicated to the user device, or

a pair comprising a known GTIF product-token and a representation of a digital object provided by the user device;

in response to determining that the particular GTIF product-token matches the particular pair:

determining particular additional content based on the particular pair, and displaying the particular additional content on the user device;

generating manufacturing instructions for manufacturing a physical product corresponding to the custom product including the particular additional content;

encoding information about the particular GTIF product-token in the manufacturing instructions;

transmitting the manufacturing instructions, having the information about the particular GTIF product-token encoded in the manufacturing instructions, to a manufacturer;

causing the manufacturer to:

generate a physical product-token based on the information about the particular GTIF product-token encoded in the manufacturing instructions; and

embed the physical product-token onto the physical product.

9 . The one or more non-transitory computer readable storage media of claim 8 , wherein the one or more user characteristics comprise a user characteristic retrieved from a user profile associated with a user;

wherein the user profile stores information about the user and includes one or more of: a user location, a user preference, a user address, a username, a user age, user favorites, a user purchase history, or user travel destinations.

10 . The one or more non-transitory computer readable storage media of claim 8 , wherein the one or more user characteristics comprise a geographic location of a user;

wherein the geographic location of the user is determined using a Global Positioning System (GPS) installed in any of a user smartphone, a user car, or a user computing device.

11 . The one or more non-transitory computer readable storage media of claim 8 , wherein a GTIF product-token, of one or more corresponding GTIF product-tokens, is a complex data structure that is generated using advanced computer-based techniques that include one or more: encoding spatial representations of certain features identified in the product or determining a set of invariant features that are specific to the product;

wherein the set of invariant features includes features that remain invariant of any 2D transformation performed on the features of the product.

12 . The one or more non-transitory computer readable storage media of claim 8 , wherein a GTIF product-token for a product, of a pair of the set of GTIF product-token pairs, represents one or more of:

one or more of relationships between a plurality of transform-invariant features identified for the product, or

one or more relationships between the plurality of transform-invariant features identified for the product and other transform-invariant features identified for other products.

13 . The one or more non-transitory computer readable storage media of claim 8 , wherein the product has a plurality transform invariant features and a corresponding plurality of GTIF product-tokens;

wherein a GTIF product-token is used to determine whether the GTIF product-token matches a particular pair of the set of GTIF product-token pairs;

wherein a GTIF product-token pair comprises additional context data that include one or more of:

location data determined based on GPS location data obtained from one or more of: the location of the user device, a photo, an address of an event, or an address of customers or users;

social relationship data of a creator or a recipient of the product; or

time based data determined based on one or more of: a time of an event, a time when a photo was taken, or a time when a message was sent.

14 . The one or more non-transitory computer readable storage media of claim 8 , wherein the determining of the particular additional content based on the particular pair is a search that requires comparisons between non-directed graphs having a plurality of nodes, wherein the nodes represent transform invariant features, wherein a time for comparison performed as a series of instructions on computing machinery increases based on a number of comparisons, and wherein a number of transform invariant features exceeds practical limits of user interaction time.

15 . A custom product computer system generator comprising:

a memory unit;

one or more processors; and

a custom product computer storing one or more instructions, which, when executed by one or more processors, cause the one or more processors to perform:

using a client application executing on a user device, generating a user interface configured to receive one or more user characteristics of a custom product;

wherein the one or more user characteristics have been associated with one or more corresponding graph of transform invariant features product-tokens (GTIF product-tokens);

receiving, by the client application executing on the user device, via the user interface, a particular characteristic of the one or more user characteristics;

determining, by the client application, a particular GTIF product-token associated with the particular characteristic of the one or more user characteristics;

wherein the particular GTIF product-token is generated to comprise social relationship data of a product creator, using one or more of:

a scale-invariant feature transform feature recognition method (SIFT),

a simultaneous localization and mapping feature recognition method (SLAM), or

a speed up robust features feature recognition method (SURF);

wherein the social relationship data of the product creator is a link that is between the product creator and another user, and that is used to assign the product creator and another user to a sub-group of attendees that are participating in a specific event;

determining whether the particular GTIF product-token, associated with the particular characteristic, matches a particular pair of a set of GTIF product-token pairs;

wherein the set of GTIF product-token pairs comprises one or more of:

a pair comprising a known GTIF product-token and a location data determined for a location of a user device,

a pair comprising known GTIF product-token associated with a user of the user device and one or more social relationships defined for the user,

a pair comprising known time based data associated with one or more events defined for the user and the one or more events,

a pair comprising a known GTIF product-token and a representation of a physical object detected by a camera or sensors and communicated to the user device, or

a pair comprising a known GTIF product-token and a representation of a digital object provided by the user device;

in response to determining that the particular GTIF product-token matches the particular pair:

determining particular additional content based on the particular pair, and displaying the particular additional content on the user device;

generating manufacturing instructions for manufacturing a physical product corresponding to the custom product including the particular additional content;

encoding information about the particular GTIF product-token in the manufacturing instructions;

transmitting the manufacturing instructions, having the information about the particular GTIF product-token encoded in the manufacturing instructions, to a manufacturer;

causing the manufacturer to:

generate a physical product-token based on the information about the particular GTIF product-token encoded in the manufacturing instructions; and

embed the physical product-token onto the physical product.

16 . The custom product computer system generator of claim 15 , wherein the one or more user characteristics comprise a user characteristic retrieved from a user profile associated with a user;

wherein the user profile stores information about the user and includes one or more of: a user location, a user preference, a user address, a username, a user age, user favorites, a user purchase history, or user travel destinations.

17 . The custom product computer system generator of claim 15 , wherein the one or more user characteristics comprise a geographic location of a user;

wherein the geographic location of the user is determined using a Global Positioning System (GPS) installed in any of a user smartphone, a user car, or a user computing device.

18 . The custom product computer system generator of claim 15 , wherein a GTIF product-token, of one or more corresponding GTIF product-tokens, is a complex data structure that is generated using advanced computer-based techniques that include one or more: encoding spatial representations of certain features identified in the product or determining a set of invariant features that are specific to the product;

wherein the set of invariant features includes features that remain invariant of any 2D transformation performed on the features of the product.

19 . The custom product computer system generator of claim 15 , wherein a GTIF product-token for a product, of a pair of the set of GTIF product-token pairs, represents one or more of:

one or more of relationships between a plurality of transform-invariant features identified for the product, or

one or more relationships between the plurality of transform-invariant features identified for the product and other transform-invariant features identified for other products.

20 . The custom product computer system generator of claim 15 , wherein the product has a plurality transform invariant features and a corresponding plurality of GTIF product-tokens;

wherein a GTIF product-token is used to determine whether the GTIF product-token matches a particular pair of the set of GTIF product-token pairs;

wherein a GTIF product-token pair comprises additional context data that include one or more of:

location data determined based on GPS location data obtained from one or more of: the location of the user device, a photo, an address of an event, or an address of customers or users;

social relationship data of a creator or a recipient of the product; or

time based data determined based on one or more of: a time of an event, a time when a photo was taken, or a time when a message was sent;

wherein the determining of the particular additional content based on the particular pair is a search that requires comparisons between non-directed graphs having a plurality of nodes, wherein the nodes represent transform invariant features, wherein a time for comparison performed as a series of instructions on computing machinery increases based on a number of comparisons, and wherein several transform invariant features exceeds practical limits of user interaction time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2023
From: BEAVER, ROBERT I., III; HARVILL, LESLIE YOUNG; DIFONZO, MATTHEW; BURGESS, BRENT
To: ZAZZLE INC.
Reel/Frame 062965/0972 →
Continuity (1)
Related Publication 20240303709A1 · Sep 12, 2024
References Cited (70)
US 7440587B1 · Bourdev · 2008 [cited by applicant]
US 7505913B2 · Tobin · 2009 [cited by applicant]
US 8589405B1 · Estan · 2013 [cited by applicant]
US 9800473B2 · Ong et al. · 2017 [cited by applicant]
US 11016557B2 · Runnels et al. · 2021 [cited by applicant]
US 11244376B1 · Van Thomme · 2022 [cited by applicant]
US 20110145068A1 · King et al. · 2011 [cited by applicant]
US 20110179021A1 · Wen et al. · 2011 [cited by applicant]
US 20120293542A1 · Iwama et al. · 2012 [cited by applicant]
US 20130073389A1 · Heath · 2013 [cited by applicant]
US 20140100991A1 · Lenahan et al. · 2014 [cited by applicant]
US 20150021356A1 · Witchell · 2015 [cited by examiner]
US 20170019719A1 · Neumeier et al. · 2017 [cited by applicant]
US 20180108054A1 · Doubinski et al. · 2018 [cited by applicant]
US 20180190033A1 · Barnett et al. · 2018 [cited by applicant]
US 20190108292A1 · Bowen · 2019 [cited by examiner]
US 20190141488A1 · Yedvab · 2019 [cited by examiner]
US 20190163982A1 · Block · 2019 [cited by applicant]
US 20190340252A1 · Huyghe et al. · 2019 [cited by applicant]
US 20200104522A1 · Collart · 2020 [cited by applicant]
US 20210192097A1 · Beaver, III et al. · 2021 [cited by applicant]
US 20210279305A1 · Goldston et al. · 2021 [cited by applicant]
US 20210312533A1 · Luo · 2021 [cited by examiner]
US 20220084308A1 · Kuang et al. · 2022 [cited by applicant]
US 20220156465A1 · Crook et al. · 2022 [cited by applicant]
US 20220318874A1 · Beaver, III · 2022 [cited by examiner]
US 20230045071A1 · Kalaldeh et al. · 2023 [cited by applicant]
US 20230075182A1 · Galuten · 2023 [cited by applicant]
US 20230117498A1 · Alcantarilla et al. · 2023 [cited by applicant]
US 20240257018A1 · Todd · 2024 [cited by examiner]
US 20250022037A1 · Luo et al. · 2025 [cited by applicant]
GB 2599947A · 2022 [cited by applicant]
WO 2021203118A1 · 2021 [cited by applicant]
Kannan, A., Givoni, I.E., Agrawal, R. and Fuxman, A., Matching unstructured product offers to structured product specifications, Aug. 2011, In Proceedings of the 17th ACM SIGKDD international conference on Knowledge dis… [cited by examiner]
Pope AR et al: “Learning Object Recognition Models From Images”, Proceedings of the International Conference on Computer Vision. Berlin, May 11-14, 1993; [Proceedings of the International Conference on Computer Vision],… [cited by applicant]
Internet Citation: “Scale-invariant feature transform”, Aug. 22, 2022 (Aug. 22, 2022), pp. 1-18, XP093175854, wikipedia.org Retrieved from the Internet: URL:https://en.wikipedia.org/w/index.php?title=Scale-nvariant_feat… [cited by applicant]
European Search Report dated Jul. 1, 2024 for Application No. 24 151 814.1. [cited by applicant]
Francis Bowen et al: “A novel graph-based 1-10 invariant region descriptor for image matching”, Electro/Information Technology (EIT), 2012 IEEE International Conference on, IEEE, May 6, 2012 (May 6, 2012), pp. 1-6, XP03… [cited by applicant]
EP Search Report dated Jun. 11, 2024 for Application No. EP 24 15 1804. [cited by applicant]
EP Search Report dated Jun. 19, 2024 for Application No. EP 24 15 1819. [cited by applicant]
EP Search Report dated Jun. 18, 2024 for Application No. EP 24 15 1814. [cited by applicant]
EP Search Report dated Feb. 7, 2024 for Application No. EP 24 15 1822. [cited by applicant]
EP Search Report dated Feb. 6, 2024 for Application No. EP 24 15 1818. [cited by applicant]
EP Search Report dated Feb. 6, 2024 for Application No. EP 24 15 1841. [cited by applicant]
Extended European Search Report for European Patent Application No. 24151822.4, dated Feb. 19, 2024. [cited by applicant]
Extended European Search Report for European Patent Application No. 24151841.4, dated Jul. 5, 2024. [cited by applicant]
Extended European Search Report for European Patent Application No. 24151819.0, dated Jul. 5, 2024. [cited by applicant]
Extended European Search Report for European Patent Application No. 24151818.2, dated Feb. 16, 2024. [cited by applicant]
Extended European Search Report for European Patent Application No. 24151804.2, dated Jun. 26, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/120,404, dated May 5, 2025. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/120,407, dated Apr. 28, 2025. [cited by applicant]
Notice of Allowance dated Jul. 28, 2025 for U.S. Appl. No. 18/120,407. [cited by applicant]
Final Office Action dated Sep. 16, 2025 for U.S. Appl. No. 18/120,402. [cited by applicant]
Non-Final Office Action dated Sep. 16, 2025 for U.S. Appl. No. 18/120,404. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/120,402, dated Dec. 22, 2025. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/120,404, dated Dec. 23, 2025. [cited by applicant]
Tokenlearner: Adaptive Space-time Tokenization for Videos, published on Openreview.net (2021) (Year: 2021). [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/120,405, dated Dec. 31, 2025. [cited by applicant]
Final Office Action for U.S. Appl. No. 18/120,403, dated Oct. 30, 2025. [cited by applicant]
Final Office Action for U.S. Appl. No. 18/120,405, dated Sep. 24, 2025. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/120,403, dated May 20, 2025. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/120,405, dated May 19, 2025. [cited by applicant]
Kurt Wagner, Pinterest will now let you search for products using any image you find online—without visiting Pinterest, Mar. 7, 2017, Vox, accessed at https://www.vox.com/2017/3/7/14837702/pinterest-chrome-extension-ima… [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/120,402, dated Jun. 6, 2025. [cited by applicant]
Final Office Action for U.S. Appl. No. 18/120,405, dated Feb. 23, 2026. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/120,404, dated Mar. 27, 2026. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/120,403, dated Mar. 19, 2026. [cited by applicant]
Automatic Creation of Communication Channels Around Detected Events An IP.com Prior Art Database Technical Disclosure Authors et. al.: Disclosed Without Attribution IP.com No. IPCOM000252373D IP.com Electronic Publicati… [cited by applicant]
Final Office Action for U.S. Appl. No. 18/120,402, dated Apr. 7, 2026. [cited by applicant]
Communication pursuant to Article 94(3) EPC for European Patent Application No. 24151819.0-1207, dated Apr. 10, 2026. [cited by applicant]