Systems and methods for detecting image recapture

1. A system for detecting image recapture, the system comprising:

a hardware processor;

an image capture sensor;

one or more other sensors; and

a system encoded with instructions executable by the hardware processor to perform operations comprising:

extracting one or more features from an image captured by the image capture sensor;

generating a first score based on the extracted one or more features;

obtaining metadata generated by the one or more other sensors;

generating a second score based on performing a first analysis that comprises comparing the metadata with fingerprints of known image manipulation software; and

generating a probability that the image is a recapture of an original image based on the first score and the second score.

2. The system of claim 1 , wherein a portion of the instructions comprises a recapture detection application, the recapture detection application comprising:

a content analysis component configured to perform a second analysis of the extracted one or more features; and

a metadata analysis component configured to perform the first analysis;

wherein the operations further comprise:

generating the first score based on the second analysis.

3. The system of claim 2 , wherein performing the second analysis comprises identifying one or more recapture characteristics.

4. The system of claim 2 , wherein performing the second analysis comprises performing a discrete cosine transform of the image.

5. The system of claim 2 , wherein performing the second analysis comprises applying the extracted one or more features as input to a trained machine learning model, wherein the trained machine learning model outputs the first score based on the extracted one or more features.

6. The system of claim 2 , wherein performing the second analysis comprises at least one of:

detecting that a surface is flat or two-dimensional;

detecting pixel color profiles and edges;

detecting muted color distributions;

detecting aliasing; or

detecting Moiré pattern.

7. The system of claim 2 , wherein performing the first analysis comprises identifying one or more potential indicators of recapture.

8. The system of claim 2 , wherein performing the first analysis comprises at least one of:

determining whether a focal distance used by an image capture device to capture the image aligns with visual content of the image;

determining whether intrinsic and distortion coefficients of the image capture device accurately undistort the image; or

determining whether position and orientation sensors of the image capture device imply that the device was pointing in a direction consistent with visual content of the image.

9. A method for detecting image recapture, the method comprising:

extracting one or more features from an image captured by an image capture sensor;

generating a first score based on the extracted one or more features;

obtaining metadata generated by one or more other sensors;

generating a second score based on performing a first analysis that comprises comparing the metadata with fingerprints of known image manipulation software; and

generating a probability that the image is a recapture of an original image based on the first score and the second score.

10. The method of claim 9 , further comprising:

performing a second analysis of the extracted one or more features; and

generating the first score based on the second analysis.

11. The method of claim 10 , wherein performing the second analysis comprises identifying one or more recapture characteristics.

12. The method of claim 10 , wherein performing the second analysis comprises performing a discrete cosine transform of the image.

13. The method of claim 10 , wherein performing the second analysis comprises applying the extracted one or more features as input to a trained machine learning model, wherein the trained machine learning model outputs the first score based on the extracted one or more features.

14. The method of claim 10 , wherein performing the second analysis comprises at least one of:

detecting that a surface is flat or two-dimensional;

detecting pixel color profiles and edges;

detecting muted color distributions;

detecting aliasing; or

detecting Moiré pattern.

15. The method of claim 10 , wherein performing the first analysis comprises identifying one or more potential indicators of recapture.

16. The method of claim 10 , wherein performing the first analysis comprises at least one of:

determining whether a focal distance used by an image capture device to capture the image aligns with visual content of the image;

determining whether intrinsic and distortion coefficients of the image capture device accurately undistort the image; or

determining whether position and orientation sensors of the image capture device imply that the device was pointing in a direction consistent with visual content of the image.

17. A system for detecting image recapture, the system comprising:

a hardware processor; and

a system encoded with instructions executable by the hardware processor to perform operations comprising:

extracting one or more features from an image;

generating a first score based on the extracted one or more features;

obtaining metadata of the image;

generating a second score based on the metadata of the image; and

generating a probability that the image is a recapture of an original image based on the first score and the second score;

wherein a portion of the instructions comprises a recapture detection application, the recapture detection application comprising:

a content analysis component configured to perform a first analysis of the extracted one or more features; and

a metadata analysis component configured to perform a second analysis of the metadata, wherein performing the second analysis comprises comparing the metadata with fingerprints of known image manipulation software; and

wherein the operations further comprise:

generating the first score based on the first analysis, and

generating the second score based on the second analysis.