IP Library Granted Patent US 11,611,707
Granted Patent B2
US 11,611,707 · App. 17/328,582 · Granted Mar 21, 2023

Auto-focus tracking for remote flying targets

Inventors: Brian Marcin Camacho (Irvine, CA); Calvin Michael Hareng (Newport Beach, CA); Corey Martin Hass (Costa Mesa, CA); Forrest Nelson Iandola (San Jose, CA); Gokul Ganesh Subramanian (Watertown, MA); Nadav Ben-Haim (Newport Beach, CA); Adnan Esmail (Los Angeles, CA); Kevin Michael Christensen (Irvine, CA)
Assignee: Anduril Industries, Inc.
H04N5/23299G01S13/66G01S13/867G03B13/36G06T7/207H04N5/23296H04N5/232127
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,611,707
App. No.
17/328,582
Granted
Mar 21, 2023
Kind
B2
Abstract

A system for automatically maintaining focus while tracking remote flying objects includes an interface and processor. The interface is configured to receive two or more images. The processor is configured to determine a bounding box for an object in the two or more images; determine an estimated position for the object in a future image; and determine an estimated focus setting and an estimated pointing direction for a lens system.

Claims (51)

1. A system, comprising:

an interface configured to:

receive two or more images; and

a processor configured to:

determine a bounding box for an object in the two or more images;

determine an estimated position for the object in a future image; and

determine an estimated focus setting and an estimated pointing direction for a lens system, comprising to:

generate one or more focus curves based on one or more images of a test target under a variety of operating conditions, wherein the one or more focus curves include a continuous plot of focus quality and focal setting, and wherein the variety of operating conditions include one or more of the following: a plurality of distances over a monitoring range, a plurality of temperatures appropriate to an operating environment of the system, and/or a plurality of radar cross sections and camera zoom settings appropriate to a selected camera and radar units of the system;

create a lookup table based on the one or more focus curves; and

determine the estimated focus setting using the lookup table, comprising to:

determine a linear relationship based on an ideal focus motor offset and a temperature of the operating environment of the system;

identify a correct focus motor offset based on the linear relationship and a current temperature of the operating environment of the system; and

add the correct focus motor offset to the estimated focus setting to obtain a corrected estimated focus setting, wherein the estimated focus setting is determined based on the lookup table.

2. The system of claim 1 , wherein determining the estimated position includes determining a prior estimated position.

3. The system of claim 2 , wherein the prior estimated position is evaluated with respect to a prior actual position in an image of the two or more images.

4. The system of claim 1 , further comprising determining an estimated zoom setting for the lens setting.

5. The system of claim 4 , further comprising receiving a radar data.

6. The system of claim 5 , wherein the estimated focus setting is based at least in part on the radar data.

7. The system of claim 5 , wherein the estimated zoom setting is based at least in part on the radar data.

8. The system of claim 7 , wherein the estimated zoom setting is based at least in part on a radar cross section of the object from the radar data.

9. The system of claim 1 , wherein in response to an object not being identifiable in a recent image of the two or more images over a period of time, change to tracking a next priority object.

10. The system of claim 1 , wherein in response to an object not being identifiable in a recent image of the two or more images and the object being identifiable in a radar data, indicate to reacquire tracking.

11. The system of claim 10 , wherein reacquiring tracking includes changing a zoom setting outward.

12. The system of claim 11 , wherein changing the zoom setting outward occurs in response to a range of the object being less than a threshold range.

13. The system of claim 10 , wherein reacquiring tracking includes not changing a zoom setting outward.

14. The system of claim 13 , wherein not changing the zoom setting outward occurs in response to a range of the object being more than or equal to a threshold range.

15. The system of claim 1 , wherein in response to an object being identifiable in a recent image of the two or more images and the object not being identifiable in a radar data, indicate to maintain tracking.

16. The system of claim 15 , wherein maintaining tracking includes indicating range data is suspect due to loss of the object in the radar data.

17. The system of claim 1 , further comprising providing the estimated focus setting and the estimated pointing direction to the lens system.

18. A method, comprising:

receiving two or more images; and

determining, using a processor, a bounding box for an object in the two or more images;

determining an estimated position for the object in a future image; and

determining an estimated focus setting and an estimated pointing direction for a lens system, comprising:

generating one or more focus curves based on one or more images of a test target under a variety of operating conditions, wherein the one or more focus curves include a continuous plot of focus quality and focal setting, and wherein the variety of operating conditions include one or more of the following: a plurality of distances over a monitoring range, a plurality of temperatures appropriate to an operating environment of the system, and/or a plurality of radar cross sections and camera zoom settings appropriate to a selected camera and radar units of the system;

creating a lookup table based on the one or more focus curves; and

determining the estimated focus setting using the lookup table, comprising:

determining a linear relationship based on an ideal focus motor offset and a temperature of the operating environment of the system;

identifying a correct focus motor offset based on the linear relationship and a current temperature of the operating environment of the system; and

adding the correct focus motor offset to the estimated focus setting to obtain a corrected estimated focus setting wherein the estimated focus setting is determined based on the lookup table.

19. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:

receiving two or more images; and

determining, using a processor, a bounding box for an object in the two or more images;

determining an estimated position for the object in a future image; and

determining an estimated focus setting and an estimated pointing direction for a lens system, comprising:

generating one or more focus curves based on one or more images of a test target under a variety of operating conditions, wherein the one or more focus curves include a continuous plot of focus quality and focal setting, and wherein the variety of operating conditions include one or more of the following: a plurality of distances over a monitoring range, a plurality of temperatures appropriate to an operating environment of the system, and/or a plurality of radar cross sections and camera zoom settings appropriate to a selected camera and radar units of the system;

creating a lookup table based on the one or more focus curves; and

determining the estimated focus setting using the lookup table, comprising:

determining a linear relationship based on an ideal focus motor offset and a temperature of the operating environment of the system;

identifying a correct focus motor offset based on the linear relationship and a current temperature of the operating environment of the system; and

adding the correct focus motor offset to the estimated focus setting to obtain a corrected estimated focus setting, wherein the estimated focus setting is determined based on the lookup table.

Assignments (2)
SECURITY INTEREST Recorded Aug 9, 2024
From: ANDURIL INDUSTRIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 068526/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2021
From: CAMACHO, BRIAN MARCIN; HARENG, CALVIN MICHAEL; HASS, COREY MARTIN; IANDOLA, FORREST NELSON; SUBRAMANIAN, GOKUL GANESH; BEN-HAIM, NADAV; ESMAIL, ADNAN; CHRISTENSEN, KEVIN MICHAEL
To: ANDURIL INDUSTRIES INC.
Reel/Frame 057202/0025 →
Continuity (1)
Related Publication 20220377242A1 · Nov 24, 2022
Cited By (3)
US 12,436,273 US 12,571,909 US 12,613,327