IP Library Granted Patent US 11,800,064
Granted Patent B2
US 11,800,064 · App. 17/530,572 · Granted Oct 24, 2023

Event recognition methods

Inventors: Mark T. Thompson (League City, TX); Stephen C. Tatton (Spring, TX)
Assignee: JBT AeroTech Corporation
H04N7/181G06T7/20G06T7/70G06V20/41H04N21/4316H04N21/47H04N23/54H04N23/66H04N23/90B64F1/305G05D1/101G06V20/44H04L67/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,800,064
App. No.
17/530,572
Granted
Oct 24, 2023
Kind
B2
Abstract

Event recognition methods include executing, with a controller, an algorithm which receives image data as an input and recognizes a first equipment object and a second equipment object in the image data; recognizing an event involving the first equipment object and the second equipment object based upon the image data using the controller; executing an event procedure based upon the event, wherein the event procedure includes controlling the first equipment object using the controller; and transmitting the image data to a network-based client based upon the event.

Claims (40)

1. An event recognition method, comprising:

executing, with a controller comprising a processor and logic, an algorithm which receives image data as an input and recognizes a first equipment object and a second equipment object in the image data;

recognizing, using the controller, an event involving the first equipment object and the second equipment object based upon the image data containing the recognized first equipment object and the recognized second equipment object;

executing an event procedure based upon the event, wherein the event procedure comprises controlling the first equipment object using the controller; and

transmitting the image data to a network-based client based upon the event.

2. The event recognition method of claim 1 , wherein recognizing the event is based upon a signal received by the controller from a sensor of at least one of the first equipment object and the second equipment object.

3. The event recognition method of claim 1 , wherein controlling the first equipment object includes at least one of braking, steering, and moving the first equipment object.

4. The event recognition method of claim 1 , wherein recognizing the event comprises recognizing an identity of the first equipment object in the image data.

5. The event recognition method of claim 1 , wherein recognizing the event comprises:

determining, from the image data, a parameter of the first data set, the parameter being selected from the group consisting of: a size of the second equipment object, a shape of the second equipment object, a position of the second equipment object, a physical condition of the second equipment object, a trajectory of the second equipment object, a travel path of the second equipment object, a velocity of the second equipment object, an acceleration or a deceleration of the second equipment object, a distance of the second equipment object from the first equipment object, and a registration marker of the second equipment object, and

comparing the parameter of the first data set with a corresponding second parameter of a second data set, wherein the corresponding second parameter is retrieved from a reference source,

wherein recognizing the event is based upon the parameter of the first data set deviating from the corresponding second parameter of the second data set.

6. The event recognition method of claim 5 , wherein the first equipment object is selected from the group consisting of: a passenger boarding bridge, a pre-conditioned air unit, a ground power unit, and a ground support equipment, and wherein the second equipment object is an aircraft or a rotorcraft.

7. The event recognition method of claim 1 , further comprising displaying the image data in a first window and a second window of a user interface of the network-based client.

8. The event recognition method of claim 7 , wherein displaying the image data comprises displaying the image data in the first window and displaying operating information related to the first equipment object in the second window.

9. The event recognition method of claim 1 , wherein the event procedure comprises at least one of: capturing additional image data with a camera; instructing the camera to follow a pre-defined path; manipulating an industrial device; manipulating an electronic device; manipulating a physical gateway; activating an alarm; or communicating with a remote system.

10. The event recognition method of claim 1 , wherein the image data comprises image data of a first perspective of the second equipment object captured with a first camera and image data of a second perspective of the second equipment object captured with a second camera.

11. The event recognition method of claim 1 , wherein controlling the first equipment object comprises controlling the first equipment object via the network-based client.

12. The event recognition method of claim 1 , further comprising:

recognizing a second event involving the second equipment object based upon the image data, and

recognizing a third event based upon the event and the second event.

13. The event recognition method of claim 1 , wherein recognizing the event is based upon a signal received from a sensor mounted on the first equipment object.

14. The event recognition method of claim 1 , further comprising:

simultaneously recognizing a second event involving the second equipment object based upon the image data.

15. The event recognition method of claim 1 , wherein recognizing the event includes identifying a type of event, including at least one of a safety event, an event involving contact between the first equipment object and the second equipment object, and a time of the event.

16. The event recognition method of claim 1 , further comprising continuously performing the following steps as a feedback loop:

executing, with a controller comprising a processor and logic, an algorithm which receives image data as an input and recognizes a first equipment object and a second equipment object in the image data;

recognizing, using the controller, an event involving the first equipment object and the second equipment object based upon the image data containing the recognized first equipment object and the recognized second equipment object;

executing an event procedure based upon the event, wherein the event procedure comprises controlling the first equipment object using the controller; and

transmitting the image data to a network-based client based upon the event.

17. An event recognition method, comprising:

executing, with a controller comprising a processor and logic, an algorithm which receives image data as an input and recognizes a first equipment object and a second equipment object in the image data;

computing a first data set based on the image data containing the recognized first equipment object and the recognized second equipment object;

determining, from the image data, a parameter of the first data set, the parameter being selected from the group consisting of: a size of the second equipment object, a shape of the second equipment object, a position of the second equipment object, a physical condition of the second equipment object, a trajectory of the second equipment object, a travel path of the second equipment object, a velocity of the second equipment object, an acceleration or a deceleration of the second equipment object, a distance of the second equipment object from the first equipment object, and a registration marker of the second equipment object;

comparing the parameter of the first data set with a corresponding parameter of a second data set, wherein the corresponding parameter of the second data set is retrieved from a reference source;

recognizing, using the controller, an event involving the first equipment object and the second equipment object based upon at least one of:

the image data containing the recognized first equipment object and the recognized second equipment object; and

the parameter of the first data set deviating from the corresponding parameter of the second data set;

executing an event procedure based upon the event, wherein the event procedure comprises controlling the first equipment object using the controller; and

transmitting the image data to a network-based client based upon the event.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2024
From: JBT AEROTECH CORPORATION
To: OSHKOSH AEROTECH, LLC
Reel/Frame 069105/0362 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2021
From: THOMPSON, MARK T.; TATTON, STEPHEN C.
To: JBT AEROTECH CORPORATION
Reel/Frame 058159/0955 →
Cited By (1)
US 12,581,042