Infringement detection system
Concepts and technologies are disclosed herein for an infringement detection system that obtains images of products and images of proprietary objects, and analyzes the images to make coarse matches. An image comparison engine may transform or augment the data for comparison for coarse and refined matching. The outputs of the image comparison engine are initial infringement predictions that are further evaluated using refined matching including shape fitting. The detection system outputs refined infringement predictions, which may be optionally confirmed as counterfeit based on various considerations (e.g., known inauthentic products, suspect sales history, text and image anomalies, etc.). Upon a refined match or confirmation, the detection system records potential infringements and associated metadata into a database to initiate an optional response action. Multiple response actions are possible for transmission over a computer network to one or more receiving electronic addresses, computer servers, network system gateways or mobile/fixed devices.
1 . A system comprising:
a noninvasive scanning device that comprises an image sensing device that is configured to capture images of a container and an emitter that is configured to emit energy toward the container;
a processor that is coupled to the noninvasive scanning device; and
a memory that stores computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising
generating the images of the container using the noninvasive scanning device, wherein the images of the container comprise a representation of an object;
obtaining, from an intellectual property data source, an intellectual property asset image that is included in an intellectual property asset;
performing, using a neural network, a coarse match operation to identify a coarse match comprising an image pair, the image pair comprising one image of the images of the container and the intellectual property asset image;
applying an image modification operation to one of the intellectual property asset image or the one image of the images of the container to obtain an augmented intellectual property asset image or an augmented image of the container associated with the object;
creating, using the neural network and based on the coarse match, a refined match comprising one of:
a first pairing of the augmented intellectual property asset image and the one image of the images of the container,
a second pairing of the intellectual property asset image and the augmented image of the container, or
a third pairing of the augmented intellectual property asset image and the augmented image of the container; and
in response to creating the refined match, communicating predicted infringement data to a recipient device via an application programming interface.
2 . The system of claim 1 , wherein the computer-executable instructions, when executed by the processor, cause the processor to perform operations further comprising:
identifying a domain of interest associated with the object, wherein the domain of interest comprises a type associated with the object; and
determining, based on the domain of interest, an intellectual property classification associated with the type, the intellectual property classification comprising a class and a subclass, wherein the intellectual property asset is identified from a plurality of intellectual property assets in the class and the subclass.
3 . The system of claim 1 , wherein the intellectual property asset image comprises a patent drawing from a patent, a photograph from a patent, an image from a trademark registration, a trade dress drawing, or a mask work from a copyright registration.
4 . The system of claim 1 , wherein communicating the predicted infringement data to the recipient device comprises communicating the predicted infringement data to a recipient device controller, wherein the recipient device is configured to actuate a component of the recipient device in response to receiving the predicted infringement data.
5 . The system of claim 1 , wherein communicating the predicted infringement data to the recipient device comprises communicating a predicted infringement notice prompt to a chatbot.
6 . The system of claim 1 , wherein the neural network is trained using an independent loss function to learn intellectual property classification information, and wherein a portion of the intellectual property classification information and the intellectual property asset image are determined based on an intellectual property record.
7 . The system of claim 1 , wherein communicating the predicted infringement data to the recipient device comprises communicating a predicted infringement notice alert to a recipient device controller, wherein the recipient device is configured to actuate a component of the recipient device in response to receiving the predicted infringement notice alert.
8 . The system of claim 1 , wherein the noninvasive scanning device comprises a luggage scanner or a shipping container scanner.
9 . A device comprising:
a noninvasive scanning device that comprises an image sensing device that is configured to capture images of a container and an emitter that is configured to emit energy toward the container;
a processor that is coupled to the noninvasive scanning device; and
a memory that stores computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising
generating the images of the container using the noninvasive scanning device, wherein the images of the container comprise a representation of an object;
obtaining, from an intellectual property data source, an intellectual property asset image that is included in an intellectual property asset;
performing, using a neural network, a coarse match operation to identify a coarse match comprising an image pair, the image pair comprising one image of the images of the container and the intellectual property asset image;
applying an image modification operation to one of the intellectual property asset image or the one image of the images of the container to obtain an augmented intellectual property asset image or an augmented image of the container associated with the object;
creating, using the neural network and based on the coarse match, a refined match comprising one of:
a first pairing of the augmented intellectual property asset image and the one image of the images of the container,
a second pairing of the intellectual property asset image and the augmented image of the container, or
a third pairing of the augmented intellectual property asset image and the augmented image of the container; and
in response to creating the refined match, communicating predicted infringement data to a recipient device via an application programming interface.
10 . The device of claim 9 , wherein the intellectual property asset image comprises a patent drawing from a patent, a photograph from a patent, an image from a trademark registration, a trade dress drawing, or a mask work from a copyright registration.
11 . The device of claim 9 , wherein communicating the predicted infringement data to the recipient device comprises communicating the predicted infringement data to a recipient device controller, wherein the recipient device is configured to actuate a component of the recipient device in response to receiving the predicted infringement data.
12 . The device of claim 9 , wherein communicating the predicted infringement data to the recipient device comprises communicating a predicted infringement notice prompt to a chatbot.
13 . The device of claim 12 , wherein communicating the predicted infringement data to the recipient device comprises communicating a predicted infringement notice alert to a recipient device controller, wherein the recipient device is configured to actuate a component of the recipient device in response to receiving the predicted infringement notice alert.
14 . The device of claim 9 , wherein the computer-executable instructions, when executed by the processor, cause the processor to perform operations further comprising:
identifying a domain of interest associated with the object, wherein the domain of interest comprises a type associated with the object; and
determining, based on the domain of interest, an intellectual property classification associated with the type, wherein the intellectual property asset is identified from a plurality of intellectual property assets in the intellectual property classification.
15 . A non-invasive scanning device comprising:
an image sensing device that is configured to capture images of a container;
an emitter that is configured to emit energy toward the container;
a processor; and
a memory that stores computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising
generating the images of the container using the image sensing device and the emitter, wherein the images of the container comprise a representation of an object;
obtaining, from an intellectual property data source, an intellectual property asset image that is included in an intellectual property asset;
performing, using a neural network, a coarse match operation to identify a coarse match comprising an image pair, the image pair comprising one image of the images of the container and the intellectual property asset image;
applying an image modification operation to one of the intellectual property asset image or the one image of the images of the container to obtain an augmented intellectual property asset image or an augmented image of the container that is associated with the object;
creating, using the neural network and based on the coarse match, a refined match comprising one of:
a first pairing of the augmented intellectual property asset image and the one image of the images of the container,
a second pairing of the intellectual property asset image and the augmented image of the container, or
a third pairing of the augmented intellectual property asset image and the augmented image of the container; and
in response to creating the refined match, communicating predicted infringement data to a recipient device via an application programming interface.
16 . The non-invasive scanning device of claim 15 , wherein the intellectual property asset image comprises a patent drawing from a patent, a photograph from a patent, an image from a trademark registration, a trade dress drawing, or a mask work from a copyright registration.
17 . The non-invasive scanning device of claim 15 , wherein communicating the predicted infringement data to the recipient device comprises communicating the predicted infringement data to a recipient device controller, wherein the recipient device is configured to actuate a component of the recipient device in response to receiving the predicted infringement data.
18 . The non-invasive scanning device of claim 15 , wherein communicating the predicted infringement data to the recipient device comprises communicating a predicted infringement notice prompt to a chatbot.
19 . The non-invasive scanning device of claim 15 , wherein communicating the predicted infringement data to the recipient device comprises communicating a predicted infringement notice alert to a recipient device controller, wherein the recipient device is configured to actuate a component of the recipient device in response to receiving the predicted infringement notice alert.
20 . The non-invasive scanning device of claim 15 , wherein the neural network is trained using an independent loss function to learn intellectual property classification information, and wherein the neural network is trained using a shared loss function to learn image similarity, and wherein the shared loss function uses contrastive or triplet loss for shared loss.