IP Library Granted Patent US 10,872,425
Granted Patent B2
US 10,872,425 · App. 15/926,160 · Granted Dec 22, 2020

System and method to improve object tracking using tracking fingerprints

Inventors: Kyungnam Kim (Oak Park, CA); Changsoo Jeong (Rancho Palos Verdes, CA); Terrell N. Mundhenk (Malibu, CA); Yuri Owechko (Newbury Park, CA)
Assignee: THE BOEING COMPANY
G06T7/251G06T7/248G06T7/292G06T7/74G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,872,425
App. No.
15/926,160
Granted
Dec 22, 2020
Kind
B2
Abstract

A method includes receiving image data at a first tracking system. The image data represents a region in an image of a sequence of images. The method also includes generating a first tracking fingerprint based on the image data. The method further includes comparing the first tracking fingerprint and a second tracking fingerprint. The method also includes providing an output from the first tracking system to a second tracking system based on a result of the comparison of the first tracking fingerprint and the second tracking fingerprint. The output includes an instruction associated with an object model stored at the second tracking system.

Claims (45)

1. A method comprising:

receiving image data at a first tracking system, wherein the image data represents a region in an image of a sequence of images;

generating a first tracking fingerprint based on the image data;

comparing the first tracking fingerprint and a second tracking fingerprint to determine a difference between the first tracking fingerprint and the second tracking fingerprint; and

providing an output from the first tracking system to a second tracking system based on a result of the comparison of the first tracking fingerprint and the second tracking fingerprint, wherein the output comprises an instruction associated with an object model stored at the second tracking system, the instruction selected based on the difference, and wherein the first tracking fingerprint is generated independent of the object model.

2. The method of claim 1 , further comprising:

tracking an object in the sequence of images based on the object model, wherein the object model is generated by the second tracking system based on data representing the object in a first image of the sequence of images; and

selectively modifying the object model based on the output from the first tracking system.

3. The method of claim 1 , wherein the difference is determined based on a distance measurement between the first tracking fingerprint and the second tracking fingerprint.

4. The method of claim 1 , wherein the difference is determined based on a Kullback-Leibler divergence value.

5. The method of claim 1 , wherein the instruction comprises a location update instruction that instructs the second tracking system to set a tracking location based on location information received from the first tracking system.

6. The method of claim 1 , wherein the instruction comprises an object model modification instruction that instructs the second tracking system to modify the object model based on motion-triggered image data.

7. The method of claim 1 , wherein the instruction comprises an object model re-initialization instruction that instructs the second tracking system to generate a new object model based on motion-triggered image data.

8. The method of claim 1 , further comprising storing the second tracking fingerprint in a memory responsive to the difference being less than a threshold value.

9. The method of claim 1 , further comprising:

receiving the image data from a motion detector, wherein the image data includes motion-triggered image data;

determining whether the difference is less than a first threshold value; and

receiving a confidence value from the second tracking system prior to providing the output, wherein the confidence value indicates a likelihood that the second tracking system is correctly tracking an object.

10. The method of claim 9 , further comprising:

determining whether the confidence value is less than a confidence threshold responsive to the difference being less than a first threshold value; and

providing a location update instruction and the motion-triggered image data as the output to the second tracking system responsive to the confidence value being greater than or equal to the confidence threshold.

11. The method of claim 10 , further comprising:

determining whether the difference is less than a second threshold value responsive to the confidence value being greater than the confidence threshold; and

providing an object model re-initialization instruction and the motion-triggered image data as the output to the second tracking system responsive to the difference being less than the second threshold value.

12. The method of claim 9 , further comprising:

determining whether the difference is less than a third threshold value; and

storing the second tracking fingerprint in a memory responsive to the difference being less than the third threshold value.

13. The method of claim 12 , further comprising receiving the image data from the second tracking system prior to the second tracking system modifying the object model based on the image data, wherein comparing the first tracking fingerprint and the second tracking fingerprint comprises determining whether the difference between the first tracking fingerprint and the second tracking fingerprint is less than a fourth threshold value.

14. The method of claim 13 , further comprising providing a model update instruction as the output to the second tracking system when the difference is less than the fourth threshold value, wherein the second tracking system is configured to modify the object model based on receipt of the model update instruction.

15. The method of claim 13 , further comprising providing a prevent update instruction as the instruction to the second tracking system responsive to the difference being greater than or equal to the fourth threshold value, wherein the prevent update instruction instructs the second tracking system to refrain from modifying the object model based on the image data.

16. A tracking system comprising:

one or more processors; and

a memory coupled to the one or more processors, the memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving image data representing a region in an image of a sequence of images;

generating a first tracking fingerprint based on the image data;

comparing the first tracking fingerprint and a second tracking fingerprint to determine a difference between the first tracking fingerprint and the second tracking fingerprint; and

providing an output to a second tracking system based on a result of the comparison of the first tracking fingerprint and the second tracking fingerprint, wherein the output comprises an instruction associated with an object model stored at the second tracking system, the instruction selected based on the difference, and wherein the first tracking fingerprint is generated independent of the object model.

17. The tracking system of claim 16 , wherein the sequence of images is received from an image capture device, and wherein the one or more processors, the memory, and the image capture device are integrated in an autonomous vehicle.

18. The tracking system of claim 17 , wherein the second tracking system is further configured to provide location data to a server, to another system of the autonomous vehicle, or combination thereof.

19. A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving image data at a first tracking system, wherein the image data represents a region in an image of a sequence of images;

generating a first tracking fingerprint based on the image data;

comparing the first tracking fingerprint and a second tracking fingerprint to determine a difference between the first tracking fingerprint and the second tracking fingerprint; and

providing an output from the first tracking system to a second tracking system based on a result of the comparison of the first tracking fingerprint and the second tracking fingerprint, wherein the output comprises an instruction associated with an object model stored at the second tracking system, the instruction selected based on the difference, and wherein the first tracking fingerprint is generated independent of the object model.

20. The non-transitory computer readable medium of claim 19 , wherein the output enables the second tracking system to re-acquire an object in a subsequent image of the sequence of images after the object is at least partially occluded in one or more images of the sequence of images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2018
From: KIM, KYUNGNAM; JEONG, CHANGSOO; MUNDHENK, TERRELL N.; OWECHKO, YURI
To: THE BOEING COMPANY
Reel/Frame 045287/0408 →
Continuity (2)
Continuation 14577983 · Dec 19, 2014
Related Publication 20180218505A1 · Aug 2, 2018