IP Library Granted Patent US 12,659,431
Granted Patent B1
US 12,659,431 · App. 18/818,018 · Granted Jun 16, 2026

Monitoring/alert system for airline gate activities

Inventors: Krunalkumar Patel (Irving, TX); Murali Ande (Flower Mound, TX); James Hill (Fort Worth, TX)
Assignee: AMERICAN AIRLINES, INC.
H04N7/181G06Q10/1097G06T7/62G06V20/52H04N23/90G06T2207/30112G06T2207/30196G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,659,431
App. No.
18/818,018
Granted
Jun 16, 2026
Kind
B1
Abstract

A method of monitoring and reporting aircraft turnaround activities at an airport gate that includes monitoring the airport gate using a first camera that has a first field of view associated with the airport gate; generating, using the first camera, first image data capturing a first activity within the first field of view; receiving, by processor(s), the first image data; identifying, by the processor(s), the first activity captured in the first image data; comparing, using a computer application, aspect(s) of the first activity with a predetermined schedule; and displaying, on a graphical user interface remote from the first camera and using the computer application, an alert indicating that the first activity does not comply with the predetermined schedule; wherein the processor(s) include a machine learning processor.

Claims (85)

1 . A method of monitoring activities at a terminal, the method comprising:

monitoring the terminal using a first camera that has a first field of view associated with the terminal;

wherein the first field of view comprises a safety zone;

generating, using the first camera, first image data capturing a first activity within the first field of view;

receiving, by processor(s), the first image data;

identifying, by the processor(s), the first activity captured in the first image data;

monitoring the terminal using a second camera that has a second field of view associated with the terminal;

wherein the second field of view comprises the safety zone;

generating, using the second camera, second image data capturing the first activity within the second field of view;

receiving, by the processor(s), the second image data;

identifying, by the processor(s), the first activity captured in the second image data;

wherein the identification of the first activity captured in the second image data confirms the identification of the first activity captured in the first image data;

comparing, using a computer application, the first activity with a predetermined schedule;

wherein the predetermined schedule comprises an approved activity and/or a non-approved activity;

determining, by the computer application and when the first activity is not the approved activity and/or is the non-approved activity, that the first activity does not comply with the predetermined schedule; and

displaying, on a graphical user interface remote from the first camera and using the computer application, an alert indicating that the first activity does not comply with the predetermined schedule.

2 . The method of claim 1 , further comprising:

assigning, using the computer application, a confidence level score to the identification of the first activity based on the first image data; and

increasing the confidence level score in response to the identification of the first activity captured in the second image data.

3 . The method of claim 1 ,

wherein the first activity is a person standing in the safety zone; and

wherein the person standing in the safety zone is the non-approved activity.

4 . The method of claim 3 , further comprising identifying, by the computer application, the identity of the person standing in the safety zone;

wherein the graphical user interface remote from the first camera is viewable by the person standing in the safety zone; and

wherein the alert comprises instructions to the person standing in the safety zone to exit the safety zone.

5 . The method of claim 1 , wherein the first activity comprises a presence of a non-human object within the safety zone.

6 . The method of claim 5 , wherein the first activity further comprises a position of the non-human object within the safety zone.

7 . The method of claim 6 ,

wherein the presence of the non-human object within the safety zone is the approved activity; and

wherein the position of the non-human object within the safety zone is the non-approved activity.

8 . The method of claim 7 ,

wherein the non-human object is a vehicle;

wherein the position of the vehicle is a parked location of the vehicle;

wherein the presence of the vehicle in the safety zone is the approved activity; and

wherein the parked location of the vehicle in the safety zone is the non-approved activity.

9 . The method of claim 5 , wherein the presence of the non-human object within the safety zone is the non-approved activity.

10 . The method of claim 1 ,

wherein when the first activity is not the approved activity or is the non-approved activity, then the first activity is considered an unsafe situation; and

wherein the graphical user interface remote from the first camera is associated with a downline system such that the unsafe situation is reported.

11 . The method of claim 10 , wherein the downline system comprise a visual docking guidance system.

12 . A system for monitoring activities at a terminal, the system comprising:

a first camera having a first field of view associated with a safety zone;

a second camera having a second field of view associated the safety zone;

a user device comprising a graphical user interface; and

a non-transitory computer readable medium having stored thereon a plurality of instructions, wherein the instructions are executed with processor(s) so that the following steps are executed:

monitoring the safety zone using the first camera;

generating, using the first camera, first image data capturing a first activity within the safety zone;

receiving, by processor(s), the first image data;

identifying, by the processor(s), the first activity captured in the first image data;

monitoring the safety zone using the second camera;

generating, using the second camera, second image data capturing the first activity within the safety zone;

receiving, by the processor(s), the second image data;

identifying, by the processor(s), the first activity captured in the second image data;

wherein the identification of the first activity captured in the second image data confirms the identification of the first activity captured in the first image data;

comparing the first activity with a predetermined schedule;

wherein the predetermined schedule comprises an approved activity and a non-approved activity;

determining, when the first activity is not the approved activity or is the non-approved activity, that the first activity does not comply with the predetermined schedule; and

displaying, on the graphical user interface remote from the first camera and the second camera, an alert indicating that the first activity does not comply with the predetermined schedule.

13 . The system of claim 12 ,

wherein when the instructions are executed the following steps are also executed:

assigning a confidence level score to the identification of the first activity based on the first image data; and

increasing the confidence level score in response to the identification of the first activity captured in the second image data.

14 . The system of claim 12 ,

wherein the first activity is a person standing in the safety zone; and

wherein the person standing in the safety zone is the non-approved activity.

15 . The system of claim 14 ,

wherein when the instructions are executed the following step is also executed:

identifying the identity of the person standing in the safety zone;

wherein the graphical user interface remote from the first camera is viewable by the person standing in the safety zone; and

wherein the alert comprises instructions to the person standing in the safety zone to exit the safety zone.

16 . The system of claim 12 , wherein the first activity comprises a presence of a non-human object within the safety zone.

17 . The system of claim 16 , wherein the first activity further comprises a position of the non-human object within the safety zone.

18 . The system of claim 17 ,

wherein the presence of the non-human object within the safety zone is the approved activity; and

wherein the position of the non-human object within the safety zone is the non-approved activity.

19 . The system of claim 18 ,

wherein the non-human object is a vehicle;

wherein the position of the vehicle is a parked location of the vehicle;

wherein the presence of the vehicle in the safety zone is the approved activity; and

wherein the parked location of the vehicle in the safety zone is the non-approved activity.

20 . The system of claim 16 , wherein the presence of the non-human object within the safety zone is the non-approved activity.

21 . The system of claim 12 ,

wherein when the first activity is not the approved activity or is the non-approved activity, then the first activity is considered an unsafe situation; and

wherein the graphical user interface remote from the first camera is associated with a downline system such that the unsafe situation is reported.

22 . The system of claim 21 , wherein the downline system comprise a visual docking guidance system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2024
From: PATEL, KRUNALKUMAR; ANDE, MURALI; HILL, JAMES
To: AMERICAN AIRLINES, INC.
Reel/Frame 068429/0819 →
Continuity (4)
Continuation 18487400 · Oct 16, 2023
Continuation 17316245 · May 10, 2021
Continuation 16599869 · Oct 11, 2019
Provisional Application 62744931 · Oct 12, 2018
References Cited (4)
US 6418361B2 · Sinex · 2002 [cited by examiner]
US 8284254B2 · Romanowich · 2012 [cited by examiner]
US 10296860B2 · Agrawal · 2019 [cited by examiner]
US 20200013301A1 · Vana · 2020 [cited by examiner]