IP Library Granted Patent US 12,198,219
Granted Patent B1
US 12,198,219 · App. 17/740,921 · Granted Jan 14, 2025

Synesthesia-based encryption systems

Inventors: Peter L. Fuhr (Oak Ridge, TN); Gary Hahn (Oak Ridge, TN); Margaret M. Morganti (Oak Ridge, TN); Jason K. Richards (Oak Ridge, TN); William H. Monday (Oak Ridge, TN)
Assignee: UT-Battelle, LLC
G06T1/0021G06T11/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,198,219
App. No.
17/740,921
Granted
Jan 14, 2025
Kind
B1
Abstract

A synesthesia-based encryption system and method (referred to as a system) includes a camera that captures an image and a transceiver communicatively coupled to the camera and a video-only network. The system includes a sensor that monitors a location and generates a sensor message. The sensor message include information that represents a state, a measurement, and/or a detection at that location. The system's processor maps colors to characters from the sensor message to generate a replacement image. In some systems, the sensor is encrypted first. The processor integrates the replacement image within the original image or some or all of the video frames captured by the camera to form a combined image(s) and causes a transceiver to transmit the combined image(s) across the video-only network to a destination.

Claims (47)

1. An apparatus operated at a utility substation that is remote from a central station, the apparatus comprising:

a camera configured to capture an image at a substation;

a transceiver communicatively coupled to a destination over a video feed network;

a sensor configured to:

sense a physical property at the substation, and

output a sensor message that includes characters indicative of the physical property; and

a hardware processor configured to:

map a plurality of colors from a color palette to characters from the sensor message to form a replacement image from a plurality of mapped colors,

integrate the replacement image within the image captured by the camera to form a combined image, and

cause the transceiver to transmit the combined image to the central station over the video feed network.

2. The apparatus of claim 1 , where the hardware processor is configured to append the replacement image over the image captured by the camera at an anchor location to render the combined image.

3. The apparatus of claim 1 , wherein the replacement image comprises a color string defined by a vector.

4. The apparatus of claim 3 , wherein the vector is positioned between corresponding vertices of an offset cube.

5. The apparatus of claim 1 , wherein the hardware processor is configured to

overlay the replacement image over a plurality of images captured sequentially by the camera to form a sequence of combined images in real-time, and

instruct the transceiver to transmit the sequence of combined images.

6. The apparatus of claim 1 , where

the sensor is configured to output two or more sensor messages, and

the hardware processor is configured to

form a plurality of corresponding replacement images from the sensor messages through a color cipher processing the color palette,

overlay the plurality of corresponding replacement images over a plurality of different images captured by the camera to render a plurality of combined images, and

cause the transceiver to transmit the plurality of combined images.

7. The apparatus of claim 6 , where the hardware processor is configured to overlay the plurality of corresponding replacement images over the plurality of different images captured by the camera at different anchor locations in the plurality of combined images.

8. The apparatus of claim 6 , where the hardware processor is configured to overlay the plurality of corresponding replacement images across the different captured images at anchor locations using different replacement-image orientations.

9. The apparatus of claim 1 , where

the sensor is configured to output two or more sensor messages, and

the hardware processor is configured to

form a plurality of replacement images from the sensor messages by processing the color palette through a color cipher, and

overlay the plurality of replacement images over a static image captured by the camera to form the combined image.

10. The apparatus of claim 9 , where the hardware processor is configured to overlay the plurality of replacement images over the captured image using a plurality of coordinate orientations.

11. The apparatus of claim 9 , where the hardware processor is configured to integrate the plurality of replacement images over the captured image by replacing a least significant bit of each byte of a data structure that comprises the plurality of replacement images.

12. The apparatus of claim 11 , where the hardware processor is configured to integrate the plurality of replacement images over the captured image by replacing a least significant bit of each byte of a data structure that comprises the plurality of replacement image.

13. The apparatus of claim 12 , where the hardware processor is configured to compensate for the replacing of the least significant bit by modifying of other lesser significant bits of the data structure to render a substantially identical statistical profile of the plurality of replacement images.

14. The apparatus of claim 1 , where an integration of the replacement image is rendered by the hardware processor by combining a plurality of pixel values of the captured image with pixel values of the replacement image.

15. The apparatus of claim 1 , where an integration of the replacement image comprises overlaying the replacement image over the image captured by the camera by a replacement of pixel values.

16. The apparatus of claim 1 , where the hardware processor is configured to:

extract a representation of the sensor message from the combined image, and

map the plurality of colors from the color palette to the representation of the sensor message.

17. The apparatus of claim 1 , where the utility substation is configured to communicate across a supervisory control and a data acquisition architecture.

18. The apparatus of claim 1 , further comprising:

a second transceiver communicatively coupled with the transceiver across the video feed network to receive the combined image; and

a second processor configured to, for each received combined image,

extract the replacement image from the combined image,

execute reverse comparison using the color palette to extract the characters that form a ciphered text; and

decrypt the ciphered text based on a decryption key.

19. The apparatus of claim 18 , where the second processor extracts the replacement image using a key based on a block size generated by a color cipher and a selection of the video feed network.

20. The apparatus of claim 1 , where the replacement image is embedded in a vector designated by the hardware processor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2022
From: FUHR, PETER L.; HAHN, GARY; MORGANTI, MARGARET M.; RICHARDS, JASON K.; MONDAY, WILLIAM H.
To: UT-BATTELLE, LLC
Reel/Frame 061106/0800 →
CONFIRMATORY LICENSE Recorded Aug 24, 2022
From: UT-BATTELLE, LLC
To: U. S. DEPARTMENT OF ENERGY
Reel/Frame 060882/0411 →
Continuity (1)
Provisional Application 63192151 · May 24, 2021
References Cited (5)
US 20070180251A1 · Carr et al. · 2007 [cited by applicant]
US 20090136087A1 · Oren · 2009 [cited by examiner]
US 20140297206A1 · Silverman · 2014 [cited by examiner]
CN 105306215A · 2016 [cited by examiner]
Schneider Electric. (2013). Sepam DNP3 communication for Sepam series 20/40/60/80 User's manual. Andover, MA: Author (64 pages). [cited by applicant]