Method and system for combining fiber optic link hierarchical stream metadata with internet protocol metadata
Physical Layer and Data-Link Layer data are connected with Networking through Application Layer data/information to enable searching, sorting, and identification of novel relationships between signal sources and their contents. Metadata can be used at the Physical Layer in an optical fiber network, connecting with metadata generated at the Data Link Layer, connected to metadata generated at the Network to Application Layer. The Physical Layer metadata is obtained from configuration and provisioning data within an Intelligent Optical System. The Data-Link Layer metadata is obtained from a signal processing device. The Network through Application Metadata is obtained from a packet capture or flow capture probe. The metadata from all layers are linked in a data store such that the network traffic, passing through stream(s) in optical fiber(s) layer data are combined. The effect of that combination enables security, intelligence, surveillance, or network analysts to separate application and network information by original source.
1. A system comprising:
an optical switch configured to extract Physical Layer (Layer 1) metadata from one or more data streams passing through one or more optical fibers;
a signal processor configured to extract Data Link Layer (Layer 2) metadata from a data stream passing from the optical switch to the signal processor;
a probe configured to extract Network Layer (Layer 3) metadata, Transport Layer (Layer 4), Session Layer (Layer 5) metadata, Presentation Layer (Layer 6) metadata, and Application Layer (Layer 7) metadata from a data stream passing from the signal processor to the probe; and
a data store configured to store records that map the Physical Layer (Layer 1) metadata to the Data Link Layer (Layer 2) metadata and to the Layer 3 through Layer 7 metadata;
wherein the one or more data streams are carried by signals having wavelengths within an unbounded range of wavelengths, including a first wavelength that differs from a second wavelength.
2. The system of claim 1 , wherein:
the records indicate at least one relationship between a particular fiber of the one or more optical fibers, a circuit, a protocol, an address, and an application.
3. The system of claim 1 , wherein:
the optical switch, the signal processor, and the probe are controlled by a particular application.
4. The system of claim 1 , wherein:
connections of the optical switch are automatically changeable based on pre-set conditions that satisfy criteria derived from extracted items of data.
5. A method comprising:
receiving, at an optical switch, a first data stream passing through an optical fiber;
extracting, at the optical switch, Physical Layer (Layer 1) metadata from the first data stream;
sending, from the optical switch to a signal processor, a second data stream comprising data from the first data stream;
receiving the second data stream at the signal processor;
extracting, at the signal processor, Data Link Layer (Layer 2) metadata from the second data stream;
sending, from the signal processor to a probe, a third data stream comprising data from the second data stream;
receiving the third data stream at the probe;
extracting, at the probe, Network Layer (Layer 3) metadata, Transport Layer (Layer 4), Session Layer (Layer 5) metadata, Presentation Layer (Layer 6) metadata, and
Application Layer (Layer 7) metadata from the third data stream; and
storing, in a data store, records that map the Physical Layer (Layer 1) metadata to the Data Link Layer (Layer 2) metadata and to the Layer 3 through Layer 7 metadata.
6. The method of claim 5 , wherein:
the records indicate at least one relationship between the optical fiber, a circuit, a protocol, an address, and an application.
7. The method of claim 5 , wherein:
the optical switch, the signal processor, and the probe are controlled by a particular application.
8. A method comprising:
extracting multiple items of data from a data stream;
determining associations between the extracted items of data;
determining proxies for known physical locations based on the associations and the extracted items of data; and
generating a physical network mapping, including associated network equipment, based on the proxies, the associations, and the extracted items of data.
9. The method of claim 8 , further comprising:
determining that pre-set conditions satisfy criteria derived from the extracted items of data; and
in response to determining that the pre-set conditions satisfy the criteria, automatically changing, based on the pre-set conditions, connections of an optical switch through which the data stream passed.
10. The method of claim 9 , wherein:
the pre-set conditions specify a SONET overhead.
11. The method of claim 9 , wherein:
the pre-set conditions specify a particular address being moved from one fiber to another fiber.
12. The method of claim 8 , wherein extracting multiple items of data from a data stream comprises:
extracting circuit metadata from the data stream.
13. The method of claim 8 , wherein extracting multiple items of data from a data stream comprises:
extracting a machine-to-machine communication protocol from the data stream.
14. The method of claim 8 , wherein extracting multiple items of data from a data stream comprises:
extracting flow data from the data stream.
15. The method of claim 8 , wherein extracting multiple items of data from a data stream comprises:
extracting network telemetry data from the data stream.
16. The method of claim 8 , wherein extracting multiple items of data from a data stream comprises:
capturing packets from end users.