IP Library Granted Patent US 10,452,913
Granted Patent B1
US 10,452,913 · App. 16/359,360 · Granted Oct 22, 2019

Systems and methods for coherent monitoring

Inventors: Daniel Cervelli (Mountain View, CA); Anand Gupta (New York, NY); Andrew Elder (New York, NY); Robert Imig (Austin, TX); Praveen Kumar Ramalingam (Washington, DC); Reese Glidden (Washington, DC); Matthew Fedderly (Baltimore, MD)
Assignee: Palantir Technologies Inc.
G06K9/0063G06F3/04842G06K9/00201G06K9/6267G06T7/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,452,913
App. No.
16/359,360
Granted
Oct 22, 2019
Kind
B1
Abstract

Systems and methods are provided for intelligently monitoring environments, classifying objects within such environments, detecting events within such environments, receiving and propagating input concerning image information from multiple users in a collaborative environment, identifying and responding to situational abnormalities or situations of interest based on such detections and/or user inputs.

Claims (60)

1. A system for intelligently monitoring an environment, comprising:

one or more processors; and

a memory storing instructions that, when executed by the one or more processors, cause the system to:

obtain image information representing an environment;

provide the image information for display on at least one device;

identify, based on the image information, one or more discrete objects observed within the environment;

classify, based on the image information in comparison with an object template, the one or more discrete objects;

generate a graphic representing the one or more discrete objects observed within the environment; and

display the graphic as an overlay on top of the displayed image information, wherein the graphic is provided over a location on the displayed image information corresponding to the location of the discrete object within the environment at the time the image information was captured.

2. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

track one or more of location information, path information, and heat signature information associated with the one or more discrete objects over a period of time; and

determine, based on the tracking, that an event condition associated with the discrete object has been satisfied.

3. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

determine that a notification condition associated with the discrete object has been satisfied; and

modify the graphic based on one or more of the classification and the notification condition determination.

4. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

provide, responsive to a user selection of the graphic, a modified view of a portion of the image information corresponding to a cropped zone within the environment surrounding the identified discrete object.

5. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

estimate a real-world dimensions of a portion of at least one of the identified discrete objects.

6. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

provide, responsive to a user selection of at least two points corresponding to locations within the image information provided for display on a device, an estimated real-world distance between the at least two points.

7. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

provide the image information for display on at least two devices operated by two different users;

receive, from one of the at least two devices, a tagging command corresponding to at least one of the discrete objects identified in the image information;

provide, at the others of the at least to devices, an indication of the tagging command.

8. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

compute a number of discrete objects of a single classification identified within a portion of the image information.

9. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:

compute a confidence score for the classification of the at least one identified discrete objects.

10. The system of claim 1 , wherein the graphic represents a classification of the one or more discrete objects observed within the environment.

11. The system of claim 1 , wherein the graphic comprises a visual attribute providing an indication of a confidence score associated with the identified discrete object.

12. A method being implemented by a computing system including one or more physical processors and storage media storing machine-readable instructions, the method comprising:

obtaining image information representing an environment;

providing the image information for display on at least one device;

identifying, based on the image information, one or more discrete objects observed within the environment;

classifying, based on the image information in comparison with an object template, the one or more discrete objects;

generating a graphic representing the one or more discrete objects observed within the environment; and

displaying the graphic as an overlay on top of the displayed image information, wherein the graphic is provided over a location on the displayed image information corresponding to the location of the discrete object within the environment at the time the image information was captured.

13. The method of claim 12 , further comprising:

tracking one or more of location information, path information, and heat signature information associated with the one or more discrete objects over a period of time; and

determining, based on the tracking, that an event condition associated with the discrete object has been satisfied.

14. The method of claim 12 , further comprising:

determining that a notification condition associated with the discrete object has been satisfied; and

modifying the graphic based on one or more of the classification and the notification condition determination.

15. The method of claim 12 , further comprising:

providing, responsive to a user selection of the graphic, a modified view of a portion of the image information corresponding to a cropped zone within the environment surrounding the identified discrete object.

16. The method of claim 12 , further comprising:

estimating a real-world dimensions of a portion of at least one of the identified discrete objects.

17. The method of claim 12 , further comprising:

providing, responsive to a user selection of at least two points corresponding to locations within the image information provided for display on a device, an estimated real-world distance between the at least two points.

18. The method of claim 12 , further comprising:

providing the image information for display on at least two devices operated by two different users;

receiving, from one of the at least two devices, a tagging command corresponding to at least one of the discrete objects identified in the image information;

providing, at the others of the at least to devices, an indication of the tagging command.

19. The method of claim 12 , further comprising:

computing a number of discrete objects of a single classification identified within a portion of the image information.

20. The method of claim 12 , further comprising:

computing a confidence score for the classification of the at least one identified discrete objects.

21. The method of claim 12 , wherein the graphic represents a classification of the one or more discrete objects observed within the environment.

22. The method of claim 12 , wherein the graphic comprises a visual attribute providing an indication of a confidence score associated with the identified discrete object.

Assignments (8)
ASSIGNMENT OF INTELLECTUAL PROPERTY SECURITY AGREEMENTS Recorded Jul 3, 2022
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: WELLS FARGO BANK, N.A.
Reel/Frame 060572/0640 →
SECURITY INTEREST Recorded Jul 3, 2022
From: PALANTIR TECHNOLOGIES INC.
To: WELLS FARGO BANK, N.A.
Reel/Frame 060572/0506 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY LISTED PATENT BY REMOVING APPLICATION NO. 16/832267 FROM THE RELEASE OF SECURITY INTEREST PREVIOUSLY RECORDED ON REEL 052856 FRAME 0382. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Aug 26, 2021
From: ROYAL BANK OF CANADA
To: PALANTIR TECHNOLOGIES INC.
Reel/Frame 057335/0753 →
SECURITY INTEREST Recorded Jun 4, 2020
From: PALANTIR TECHNOLOGIES INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 052856/0817 →
RELEASE OF SECURITY INTEREST Recorded Jun 4, 2020
From: ROYAL BANK OF CANADA
To: PALANTIR TECHNOLOGIES INC.
Reel/Frame 052856/0382 →
SECURITY INTEREST Recorded Jan 27, 2020
From: PALANTIR TECHNOLOGIES INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS ADMINISTRATIVE AGENT
Reel/Frame 051713/0149 →
SECURITY INTEREST Recorded Jan 27, 2020
From: PALANTIR TECHNOLOGIES INC.
To: ROYAL BANK OF CANADA, AS ADMINISTRATIVE AGENT
Reel/Frame 051709/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2019
From: CERVELLI, DANIEL; GUPTA, ANAND; ELDER, ANDREW; IMIG, ROBERT; RAMALINGAM, PRAVEEN KUMAR; GLIDDEN, REESE; FEDDERLY, MATTHEW
To: PALANTIR TECHNOLOGIES INC.
Reel/Frame 048960/0097 →
Cited By (4)
US 12,211,269 US 12,229,692 US 12,260,737 US 12,541,287