IP Library Granted Patent US 11,770,506
Granted Patent B2
US 11,770,506 · App. 17/304,699 · Granted Sep 26, 2023

Multi-source 3-dimensional detection and tracking

Inventors: Julia Florence Kerst (Richardson, TX); Thomas Nicholas Zogakis (Richardson, TX); Rachel Ann Rivera (Murphy, TX); Michael Wade Martin (Royse City, TX); Joseph Evan Harris (Carrollton, TX); Adam Earl Scott (Carrollton, TX); Jonathan Edward Ray (Murphy, TX)
Assignee: Innovative Signal Analysis, Inc.
H04N7/188H04N7/181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,770,506
App. No.
17/304,699
Granted
Sep 26, 2023
Kind
B2
Abstract

An object detection system includes a first camera having a first field of view and a second camera having a second field of view that overlaps with the first field of view. The object detection system includes object detection logic configured to receive a first image from the first camera and a second image from the second camera and identify an object in both the first and second image. The object detection system further includes object mapping logic configured to identify a location of the object based on the first and second image. The object detection system also includes display logic configured to display the location of the object.

Claims (63)

1. An object detection system comprising:

a first camera having a first field of view;

a second camera having a second field of view that overlaps with the first field of view;

object detection logic configured to receive a first image from the first camera and a second image from the second camera and identify an object in both the first and second image;

object mapping logic configured to identify a location of the object based on the first and second image;

display logic configured to display the location of the object;

wherein the display logic is configured to display the location of the object in a three-dimensional representation;

wherein the object is a moving object, and wherein the location of the moving object is represented as a movement path in the three-dimensional representation; and

wherein the display logic is configured to display a location of an additional moving object, and wherein the location of the additional moving object is represented as an additional movement path in the three-dimensional representation.

2. The system of claim 1 , wherein the first camera and the second camera are broad-range video cameras having a field of view of at least 90 degrees.

3. The system of claim 1 , further comprising error determination logic configured to estimate an error margin for the identified location.

4. The system of claim 3 , wherein the display logic displays a representation of the error margin on a display.

5. The system of claim 4 , wherein the error margin is represented as a first error ellipse relative to the first camera and a second error ellipse relative to the second camera.

6. The system of claim 1 , further comprising pruning logic configured to compare the object to a criterion and responsively discard the object if it does not meet the criterion.

7. The system of claim 6 , wherein the criterion is an FOV check.

8. A method of determining an estimated location of at least one moving object, the method comprising:

detecting a change in a stream of images from a first camera and a second camera indicative of the at least one moving object;

identifying the at least one moving object based on the detected change in the stream of images, wherein identifying includes determining a pixel location of the at least one moving object;

calculating a bearing and an elevation of the at least one moving object based on the pixel location relative to the stream of images;

calculating an intersection of a ray from the first camera and a ray from the second camera, the intersection being indicative of the estimated location of the at least one moving object;

providing the estimated location as an output to a display device; and

wherein the at least one moving object comprises a plurality of moving objects, and wherein calculating the intersection comprises looping through each moving object such that an intersection is calculated for each moving object.

9. The method of claim 8 , wherein the intersection of the ray from the first camera and the ray from the second camera correlates the at least one moving object from the first camera to the second camera to indicate the location of the at least one moving object.

10. The method of claim 8 , further comprising:

pruning the calculated bearing and elevation of the at least one moving object, wherein pruning includes comparing the at least one moving object to at least one criteria.

11. The method of claim 10 , further comprising:

discarding the at least one moving object if it fails to meet the at least one criteria.

12. The method of claim 8 , wherein calculating the intersection includes producing a confidence metric based on the calculated intersection, the confidence metric being indicative of the accuracy of the estimated location.

13. The method of claim 12 , wherein providing the estimated location as an output to a display device comprises providing the estimated location and the confidence metric as an output if the confidence metric meets a threshold.

14. The method of claim 8 , wherein the output of the estimated location includes a movement path of the at least one moving object.

15. The method of claim 8 , wherein the output of the estimated location comprises:

a latitude and longitude pairing;

an altitude; and

an error margin.

16. An object detection system comprising:

a first camera having a first field of view;

a second camera having a second field of view that overlaps with the first field of view;

object detection logic configured to receive a first image from the first camera and a second image from the second camera and identify an object in both the first and second image;

object mapping logic configured to identify a location of the object based on the first and second image;

display logic configured to display the location of the object;

error determination logic configured to estimate an error margin for the identified location; and

wherein the display logic displays a representation of the error margin on a display.

17. An object detection system comprising:

a first camera having a first field of view;

a second camera having a second field of view that overlaps with the first field of view;

object detection logic configured to receive a first image from the first camera and a second image from the second camera and identify an object in both the first and second image;

object mapping logic configured to identify a location of the object based on the first and second image;

display logic configured to display the location of the object;

pruning logic configured to compare the object to an FOV check and responsively discard the object if it does not meet the FOV check.

18. A method of determining an estimated location of at least one moving object, the method comprising:

detecting a change in a stream of images from a first camera and a second camera indicative of the at least one moving object;

identifying the at least one moving object based on the detected change in the stream of images, wherein identifying includes determining a pixel location of the at least one moving object;

calculating a bearing and an elevation of the at least one moving object based on the pixel location relative to the stream of images;

calculating an intersection of a ray from the first camera and a ray from the second camera, the intersection being indicative of the estimated location of the at least one moving object;

providing the estimated location as an output to a display device; and

wherein calculating the intersection includes producing a confidence metric based on the calculated intersection, the confidence metric being indicative of the accuracy of the estimated location.

19. A method of determining an estimated location of at least one moving object, the method comprising:

detecting a change in a stream of images from a first camera and a second camera indicative of the at least one moving object;

identifying the at least one moving object based on the detected change in the stream of images, wherein identifying includes determining a pixel location of the at least one moving object;

calculating a bearing and an elevation of the at least one moving object based on the pixel location relative to the stream of images;

calculating an intersection of a ray from the first camera and a ray from the second camera, the intersection being indicative of the estimated location of the at least one moving object; and

pruning the calculated bearing and elevation of the at least one moving object, wherein pruning includes comparing the at least one moving object to at least one criteria,

providing the estimated location as an output to a display device.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded May 22, 2026
From: FIRST-CITIZENS BANK & TRUST COMPANY
To: INNOVATIVE SIGNAL ANALYSIS, INC.
Reel/Frame 074742/0992 →
RELEASE OF SECURITY INTEREST Recorded May 22, 2026
From: FIRST-CITIZENS BANK & TRUST COMPANY
To: INNOVATIVE SIGNAL ANALYSIS, INC.
Reel/Frame 074744/0676 →
SECURITY INTEREST Recorded May 20, 2026
From: INNOVATIVE SIGNAL ANALYSIS, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 074709/0419 →
SECURITY INTEREST Recorded Feb 13, 2026
From: INNOVATIVE SIGNAL ANALYSIS, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 073787/0165 →
SECURITY INTEREST Recorded Feb 13, 2026
From: INNOVATIVE SIGNAL ANALYSIS, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 073787/0276 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2022
From: KERST, JULIA FLORENCE; ZOGAKIS, THOMAS NICHOLAS; RIVERA, RACHEL ANN; MARTIN, MICHAEL WADE; HARRIS, JOSEPH EVAN; SCOTT, ADAM EARL; RAY, JONATHAN EDWARD
To: INNOVATIVE SIGNAL ANALYSIS, INC.
Reel/Frame 061954/0544 →
Continuity (2)
Provisional Application 63044213 · Jun 25, 2020
Related Publication 20210409655A1 · Dec 30, 2021
Cited By (1)
US 12,626,514