Homography through satellite image matching
View Patent ↗Provided is a method and system that includes an imaging device to be disposed in a lighting fixture to capture images, a remote computing device in communication with the imaging device, and comprising at least one processor. The processor is capable of processing data related to images from the at least one imaging device and from a satellite imagery system, performing comparison operation by detecting a first set of points of interest in an image from the at least one imaging device and corresponding second set of points of interest in an image of a same area from the satellite imagery system, and calculating a homography matrix by matching the first set of points of interests in the image from the at least one imaging device and the second set of points of interest in the image from the satellite imagery system, to determine latitude and longitude coordinates of the image from the imaging device.
1. A system comprising:
at least one imaging device to be disposed in a lighting fixture within an area to be monitored, and configured to capture one or more images and video of the area;
a remote computing device in communication with the at least one imaging device, and comprising at least one processor configured to:
(i) process data related to images from the at least one imaging device and from a satellite imagery system,
(ii) perform comparison operation by detecting a first set of points of interest in an image from the at least one imaging device and corresponding second set of points of interest in an image of a same area from the satellite imagery system, wherein each point of interest from the first set of points of interest corresponds to a respective point of interest from the second set of points of interest, and the first set of points of interest and the second set of points of interest are each represented as a three-valued vector, wherein the first set of points of interest are represented as c=[x,y,1] and the second set of points of interest are represented as g=[latitude, longitude,1], and
(iii) calculating a homography matrix using the following equation: g*H=k*c, wherein k is a normalization scalar, and by matching the first set of points of interests in the image from the at least one imaging device and the second set of points of interest in the image from the satellite imagery system, to determine latitude and longitude coordinates of the image from the at least one imaging device.
2. The system of claim 1 , wherein upon calculating the homography matrix, the processor is further configured to transform the image at the at least one imaging device into a top/down view using the latitude and longitude coordinates determined.
3. The system of claim 1 , wherein upon calculating the homography matrix, the homography matrix is sent to the lighting fixture and a processor disposed within the lighting fixture transforms the image from the at least one imaging device into a top/down view using the latitude and longitude coordinates determined.
4. The system of claim 1 , wherein the system further comprises:
a software module application accessible via a user device, and configured to control the system and display image data thereon;
a transmitter/receiver in communication with the at least one imaging device, within the lighting fixture, and configured to receive and transmit data to and from the remote computing device and the user device via the software module application; and
a storage device in the lighting fixture configured to store the processed data.
5. The system of claim 4 , wherein the remote computing device is configured to wirelessly communicate with the at least one imaging device in real-time to obtain the data, and to retrieve historical data to be used to obtain the first set of points of interests and the second set of points of interests.
6. The system of claim 1 , wherein the remote computing device is configured to manipulate the first set of points of interests and the second set of points of interests into a specific shape using the software module application.
7. The system of claim 1 , wherein upon calculating the homography matrix, the processor at the remote computing device is further configured to transform the image from the at least one imaging device into a top-down image, to obtain the latitude and longitude coordinates thereof and to be displayed at the user device.
8. A method to be performed by a system in communication with a lighting fixture, comprising:
capturing one or more images via at least one imaging device to be disposed in a lighting fixture within an area to be monitored;
processing, via a processor of a remote computing device in communication with the at least one imaging device, data related to the one or more images;
comparing, a first set of points of interest in an image from the at least one imaging device and corresponding second set of points of interest in an image of a same area from a satellite imagery system, wherein each point of interest from the first set of points of interest corresponds to a respective point of interest from the second set of points of interest, and the first set of points of interest and the second set of points of interest are each represented as a three-valued vector, wherein the first set of points of interest are represented as c=[x,y,1] and the second set of points of interest are represented as g=latitude, longitude,1]; and
calculating a homography matrix using the following equation: g*H=k*c, wherein k is a normalization scalar, and by matching the first set of points of interests in the image from the at least one imaging device and the second set of points of interest in the image from the satellite imagery system, to determine latitude and longitude coordinates of the image from the at least one imaging device.
9. The method of claim 8 , further comprising:
controlling, via a software module application accessible at a user device, the system and display data thereon;
receiving and transmitting, via a transmitter/receiver at the lighting fixture, data to and from the remote computing device and the user device via the software module; and
storing the processed data in a storage device in the lighting fixture.
10. The method of claim 8 , further comprising:
obtaining data, at the remote computing device, wirelessly in real-time from the at least one imaging device and historical data to be used to obtain the first set of points of interests and the second set of points of interests.
11. The method of claim 10 , further comprising:
manipulating via the remote computing device, the first set of points of interests and the second set of points of interests into a specific shape using the software module application.
12. The method of claim 10 , wherein upon calculating the homography matrix, performing the image transform, via the processor at the remote computing device, on the image from the at least one imaging device into the image from the satellite view, to obtain the latitude and longitude coordinates thereof and to be displayed at the user device.
13. The method of claim 10 , wherein upon calculating the homography matrix, performing the image transform locally at the lighting fixture to calculate vehicle velocity and determine latitude and longitude of objects or pedestrians detected by video analytics.