Search and retrieval of keyed data maintained using a keyed database
This document describes a digital component deduplication system for generating packetized data with encryption tokens for transmittal over one or more packetized networks. A packetized data search determines that an encryption token is included with the packetized data. The encryption token includes keyed data representing a first digital component. The packetized data search engine searches the keyed database to identify contents, in the keyed database, of one or more entries that includes the keyed data representing the first digital component. A list of candidate digital components is generated. For candidate digital components associated with a data interface for requesting an eligibility value from a second client device associated with the candidate digital component, a security server generates, using the data interface, additional packetized data comprising i) a request for the eligibility value from the second client device, and ii) the encryption token.
1. A method for digital component deduplication, the method comprising:
receiving, from a first client device, (i) a request for a digital component and (ii) encryption token data representing a first digital component that has already been transmitted to the first client device;
determining that the first digital component has already been provided to the client device in response to a previous request for a digital component based on identifying a match between the encryption token data received from the first client device and a stored identifier of the first digital component;
disqualifying the first digital component from consideration and removing the first digital component from a list of candidate digital components that are eligible to be served to the first client device based on (i) the encryption token data being received from the first client device and (ii) the determination that the first digital component has already been transmitted to the first client device based on the identified match between the stored identifier of the first digital component and the encryption token data;
selecting, from the list of candidate digital components from which the first digital component that has already been transmitted to the first client device was removed, a second digital component for transmission to the first client device in response to the request for the digital component, wherein selecting the second digital component for transmission to the first client device comprises:
determining that a particular candidate digital component of the list is associated with an interface for requesting an eligibility value for the particular candidate digital component from a second client device associated with the particular candidate digital component;
obtaining the eligibility value for the particular digital component from the second client device using the interface; and
selecting, from the list of candidate digital components, the second digital component for transmission to the first client device based at least in part on the eligibility value, wherein the second digital component is different than the first digital component; and
transmitting the second digital component to the first client device.
2. The method of claim 1 , wherein obtaining the eligibility value for the particular digital component from the second client device using the interface comprises:
generating a request for the eligibility value;
transmitting the request for the eligibility value to the second client device using the interface; and
receiving the eligibility value from the second client device.
3. The method of claim 2 , wherein the request for the eligibility value includes the data representing the first digital component that has already been transmitted to the first client device.
4. The method of claim 1 , further comprising:
receiving an encryption key from the second client device; and
using the encryption key to decrypt the encryption token representing the first digital component that has already been transmitted to the first client device.
5. The method of claim 4 , wherein the encryption key comprises a private key of the second client device.
6. The method of claim 1 , wherein the encryption token comprises keyed data representing the first digital component that has already been transmitted to the first client device, wherein generating the list of candidate digital components that excludes the first digital component that has already been transmitted to the first client device comprises:
searching a keyed database storing keyed data, with each item of keyed data representing a particular digital component, to identify contents of one or more entries in the keyed database that includes keyed data representing the first digital component.
7. The method of claim 6 , wherein the keyed data of the encryption token uniquely identifies the first digital component that has already been transmitted to the first client device, and when the keyed data is decrypted, the keyed data matches an identifier of the first digital component that has already been transmitted to the first client device.
8. The method of claim 1 , further comprising transmitting, to the first client device, an encryption token representing the second digital component.
9. A system comprising:
one or more computers; and
one or more storage devices communicatively coupled to the one or more computers, wherein the one or more storage devices store instructions that, when executed by the one or more computers, cause the one or more computers to perform operations for digital component deduplication, the operations comprising:
receiving, from a first client device, (i) a request for a digital component and (ii) encryption token data representing a first digital component that has already been transmitted to the first client device;
determining that the first digital component has already been provided to the client device in response to a previous request for a digital component based on identifying a match between the encryption token data received from the first client device and a stored identifier of the first digital component;
excluding the first digital component from a list of candidate digital components that are eligible to be served to the first client device based on (i) the encryption token data being received from the first client device and (ii) the determination that the first digital component has already been transmitted to the first client device based on the identified match between the stored identifier of the first digital component and the encryption token data;
selecting, from the list of candidate digital components that excludes the first digital component that has already been transmitted to the first client device, a second digital component for transmission to the first client device in response to the request for the digital component, wherein selecting the second digital component for transmission to the first client device comprises:
determining that a particular candidate digital component of the list is associated with an interface for requesting an eligibility value for the particular candidate digital component from a second client device associated with the particular candidate digital component;
obtaining the eligibility value for the particular digital component from the second client device using the interface; and
selecting, from the list of candidate digital components, the second digital component for transmission to the first client device based at least in part on the eligibility value, wherein the second digital component is different than the first digital component; and
transmitting the second digital component to the first client device.
10. The system of claim 9 , wherein obtaining the eligibility value for the particular digital component from the second client device using the interface comprises:
generating a request for the eligibility value;
transmitting the request for the eligibility value to the second client device using the interface; and
receiving the eligibility value from the second client device.
11. The system of claim 10 , wherein the request for the eligibility value includes the data representing the first digital component that has already been transmitted to the first client device.
12. One or more non-transitory computer storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations for digital component deduplication, the operations comprising:
receiving, from a first client device, (i) a request for a digital component and (ii) encryption token data representing a first digital component that has already been transmitted to the first client device;
determining that the first digital component has already been provided to the client device in response to a previous request for a digital component based on identifying a match between the encryption token data received from the first client device and a stored identifier of the first digital component;
excluding the first digital component from a list of candidate digital components that are eligible to be served to the first client device based on (i) the encryption token data being received from the first client device and (ii) the determination that the first digital component has already been transmitted to the first client device based on the identified match between the stored identifier of the first digital component and the encryption token data;
selecting, from the list of candidate digital components that excludes the first digital component that has already been transmitted to the first client device, a second digital component for transmission to the first client device in response to the request for the digital component, wherein selecting the second digital component for transmission to the first client device comprises:
determining that a particular candidate digital component of the list is associated with an interface for requesting an eligibility value for the particular candidate digital component from a second client device associated with the particular candidate digital component;
obtaining the eligibility value for the particular digital component from the second client device using the interface; and
selecting, from the list of candidate digital components, the second digital component for transmission to the first client device based at least in part on the eligibility value, wherein the second digital component is different than the first digital component; and
transmitting the second digital component to the first client device.
13. The one or more non-transitory computer storage media of claim 12 , wherein obtaining the eligibility value for the particular digital component from the second client device using the interface comprises:
generating a request for the eligibility value;
transmitting the request for the eligibility value to the second client device using the interface; and
receiving the eligibility value from the second client device.
14. The one or more non-transitory computer storage media of claim 13 , wherein the request for the eligibility value includes the data representing the first digital component that has already been transmitted to the first client device.