IP Library Granted Patent US 11,646,896
Granted Patent B1
US 11,646,896 · App. 17/231,377 · Granted May 9, 2023

Systems and methods for verification and authentication of remote sensing imagery

Inventors: Sean Michael Crosby (Albuquerque, NM); William Marchetto, II (Albuquerque, NM); Kurt Daniel Brenning (Albuquerque, NM)
Assignee: National Technology & Engineering Solutions of Sandia, LLC
H04L9/3247H04L9/3278H04N1/32144H04N7/183
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,646,896
App. No.
17/231,377
Granted
May 9, 2023
Kind
B1
Abstract

A system for generating and authenticating remote sensing imagery includes a remote sensing platform. The remote sensing platform includes an imaging sensor and a hardware logic device that is directly coupled to the imaging sensor. The hardware logic device receives image data from the imaging sensor and generates a cryptographic signature based upon the image data. The hardware logic device outputs a signed image that includes the image data and the cryptographic signature. A computing device operated by a downstream user receives the signed image and can determine whether the image data has been modified from its original content based upon the cryptographic signature.

Claims (47)

1. A system, comprising:

a hardware logic device included in an airborne vehicle, wherein the hardware logic device is directly coupled to an imaging sensor, the hardware logic device configured to perform acts comprising:

receiving image data from the imaging sensor, the image data indicative of a scene in a field-of-view (FOV) of an objective coupled to the imaging sensor;

in response to receiving the image data, providing input to a physical unclonable function (PUF) that is included in the hardware logic device, wherein the PUF generates an output bases upon the input;

generating a cryptographic signature based upon the image data and a private key, wherein the private key is based upon the output of the PUF; and

outputting a signed image for transmission to a remote computing system, the signed image depicting the scene, wherein the signed image includes the cryptographic signature, and further wherein the signed image is authenticatable as a genuine image of the scene based upon the cryptographic signature.

2. The system of claim 1 , further comprising the imaging sensor and the objective, wherein the hardware logic device, the imaging sensor, and the objective are mounted on the airborne vehicle.

3. The system of claim 2 , wherein the airborne vehicle is a spacecraft.

4. The system of claim 3 , further comprising a transceiver, the acts further comprising:

responsive to receiving a first communication from the transceiver, the first communication received from a ground station by the transceiver, generating a second communication by signing the first communication based upon the private key; and

outputting the second communication to the transceiver, whereupon the transceiver transmits the second communication to the ground station, wherein the ground station authenticates that the hardware logic device is mounted on the platform based upon the second communication.

5. The system of claim 1 , further comprising a sensor mounted included in the airborne vehicle, wherein the cryptographic signature is based further upon sensor data output by the sensor.

6. The system of claim 5 , wherein the sensor comprises at least one of a gravimeter, an inertial measurement unit (IMU), an accelerometer, a temperature sensor, or a pressure sensor.

7. The system of claim 5 , wherein the hardware logic device and the sensor are disposed within a tamper-evident container.

8. The system of claim 1 , the acts further comprising extracting a feature from the image data, wherein generating the cryptographic signature is based upon the extracted feature.

9. The system of claim 1 , wherein the output of the PUF is the private key.

10. The system of claim 1 , the acts further comprising generating the private key based upon the output of the PUF.

11. The system of claim 1 , wherein generating the cryptographic signature comprises executing a cryptographic function over data that includes the image data.

12. The system of claim 1 , the image data comprising a plurality of analog signals output by light-sensitive pixel cells (LSPCs) included on the imaging sensor, the acts further comprising digitally sampling the analog signals to generate digital image data, wherein generating the cryptographic signature is based upon the digital image data.

13. A method performed by a hardware logic device that is included in an airborne vehicle, the method; comprising:

receiving, from an imaging sensor and at a hardware logic device that is directly coupled to the imaging sensor, image data that is indicative of a scene in a field-of-view (FOV) of an imaging objective;

in response to receiving the image from the imaging sensor, providing an input to a physical unclonable function (PUF), wherein the PUF generates an output bases upon the input;

generating a cryptographic signature based upon the image data and a cryptographic key, wherein the cryptographic key is based upon the output generated by the PUF; and

outputting, by way of the hardware logic device, a signed image that depicts the scene, wherein the signed image is output for transmission to a remote computer device, the signed image comprising the image data and the cryptographic signature, and further wherein the signed image is authenticatable as a genuine image of the scene based upon the cryptographic signature.

14. The method of claim 13 , further comprising extracting a feature from the image data, wherein generating the cryptographic signature comprises executing a cryptographic function over the extracted feature.

15. A system included in an airborne vehicle, the system comprising:

an image sensor that generates an image of a portion of a surface of the earth;

an inertial sensor;

a clock; and

a hardware logic device that is directly coupled to the image sensor and is in communication with the inertial sensor and the clock, wherein the hardware logic device includes memory that stores an input, the hardware logic device includes a physical unclonable function (PUF), and further wherein the hardware logic device is configured to perform acts comprising:

receiving the image generated by the image sensor;

in response to receiving the image:

obtaining a sensor output generated by the inertial sensor;

obtaining a time value output by the clock;

appending the sensor output and the time value to the image to form image data;

providing the PUF with the input stored in the memory, wherein the PUF generates an output based upon the input;

generating a cryptographic signature for the image based upon the image data and a cryptographic key, wherein the cryptographic key is based upon the output generated by the PUF;

generating an image file, where the image file includes the image generated by the image sensor and the cryptographic signal; and

outputting the image file for transmission to a ground-based remote computing system, wherein the image is authenticatable by the ground-based remote computing system based upon the cryptographic signature.

16. The system of claim 15 , wherein the output of the PUF is the cryptographic key.

17. The system of claim 15 , the acts further comprising:

providing the output of the PUF to a key generator algorithm, wherein the key generator algorithm outputs the cryptographic key based upon the output of the PUF.

18. The system of claim 15 , wherein the hardware logic device, the sensor, and the clock are included in a tamper-evident container that separates the hardware logic device, the sensor, and the clock from the image sensor.

19. The system of claim 18 , wherein the tamper-evident container ports, wherein the ports consist of:

an input port, wherein the hardware logic device is directly coupled to the image sensor by way of the input port; and

an output port, wherein the hardware logic device is directly coupled to a transceiver by way of the output port.

20. The system of claim 15 , wherein the inertial sensor is a gravimeter.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2022
From: CROSBY, SEAN MICHAEL; MARCHETTO, WILLIAM, II; BRENNING, KURT DANIEL
To: NATIONAL TECHNOLOGY & ENGINEERING SOLUTIONS OF SANDIA, LLC
Reel/Frame 059674/0509 →
CONFIRMATORY LICENSE Recorded Apr 18, 2022
From: NATIONAL TECHNOLOGY & ENGINEERING SOLUTIONS OF SANDIA, LLC
To: U.S. DEPARTMENT OF ENERGY
Reel/Frame 059625/0707 →
Cited By (2)
US 12,418,527 US 12,444,027