System and method for maintaining metadata correctness
A method is disclosed. The method includes a relationship server receiving a discovery service request from a client computer, the relationship server comparing metadata provided in the discovery service request against a database and a crawler retrieving updated metadata from a commerce server for if the metadata provided in the discovery service request does not match the metadata stored in the database column.
1. A method of operating a computing system, the method comprising:
receiving, with one or more computing devices and from an end user browser, a copy of metadata describing an item on a webpage;
comparing the metadata with further metadata of the webpage stored in a database;
determining whether the metadata differs from the further metadata;
based on determining the metadata differs from the further metadata, placing an identifier for the webpage in a validation queue;
fetching at a later time a copy of the webpage using the identifier;
extracting updated metadata from the copy of the webpage; and
overwriting existing values of the further metadata with the updated metadata.
2. The method of claim 1 , wherein the identifier is a uniform resource locator (URL).
3. The method of claim 1 , wherein the identifier is a database primary key.
4. The method of claim 1 , wherein the fetching of the copy of the webpage is performed using a crawler process.
5. A non-transitory computer readable medium storing instructions, that when executed by one or more processors of a computing system, perform operations comprising:
receiving, from an end user browser, a copy of metadata describing an item on a webpage;
comparing the metadata with further metadata of the webpage stored in a database;
determining whether the metadata differs from the further metadata;
based on determining the metadata differs from the further metadata, placing an identifier for the webpage in a validation queue;
fetching at a later time a copy of the webpage using the identifier;
extracting updated metadata from the copy of the webpage; and
overwriting existing values of the further metadata with the updated metadata.
6. The non-transitory computer readable medium of claim 5 , wherein the identifier is a uniform resource locator (URL).
7. The non-transitory computer readable medium of claim 5 , wherein the identifier is a database primary key.
8. The non-transitory computer readable medium of claim 5 , wherein the fetching of the copy of the webpage is performed using a crawler process.
9. A computing system comprising:
a memory storing instructions; and
one or more processors, coupled to the memory, configured to process the stored instructions to perform operations comprising:
receiving, from an end user browser, a copy of metadata describing an item on a webpage;
comparing the metadata with further metadata of the webpage stored in a database;
determining whether the metadata differs from the further metadata;
based on determining the metadata differs from the further metadata, placing
an identifier for the webpage in a validation queue;
fetching at a later time a copy of the webpage using the identifier;
extracting updated metadata from the copy of the webpage; and
overwriting existing values of the further metadata with the updated metadata.
10. The computing system of claim 9 , wherein the identifier is a uniform resource locator (URL).
11. The computing system of claim 9 , wherein the identifier is a database primary key.
12. The computing system of claim 9 , wherein the fetching of the copy of the webpage is performed using a crawler process.