IP Library › Granted Patent US 11,644,828
Granted Patent B2
US 11,644,828 · App. 17/244,652 · Granted May 9, 2023

Navigation system with camera assist

Inventors: Maurice D. Griffin (San Antonio, TX); Aaron M. Hitchcock (Fort Worth, TX)
Assignee: TEXTRON INNOVATIONS INC.
G05D1/0094G05D1/0011G05D1/102G06T7/292G06V20/13G08G5/0047
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,644,828
App. No.
17/244,652
Granted
May 9, 2023
Kind
B2
Abstract

One embodiment is a navigation system for an aircraft including a positioning system to generate information related to a position of the aircraft, a group of cameras mounted to a body of the aircraft, each camera of the group of cameras to simultaneously capture images of a portion of an environment that surrounds the aircraft, and a processing component coupled to the positioning system and the group of cameras, the processing component to determine a current position of the aircraft based on the information related to the position of the aircraft and the images.

Claims (53)

1. A navigation system for an aircraft, comprising:

a plurality of camera groups, each camera group comprising at least two cameras mounted to a body of the aircraft and directed away from the aircraft, each camera group to capture a set of images of a portion of an environment that surrounds the aircraft, the set of images captured by a given camera group having an overlapping a field of view; and

a processing component coupled to the plurality of camera groups, the processing component to:

receive a set of images from one of the camera groups;

identify an object that appears in each of the set of images;

determine, for each camera in the camera group, a distance from the camera to the object and an angle of the camera relative to the object; and

determine a current position of the aircraft based on the determined distances and angles.

2. The navigation system of claim 1 , wherein the processing component is to:

determine a first distance from the object to a first camera in the camera group and a first angle of the object relative to the first camera based on a first image of the set of images; and

determine a second distance from the object to a second camera in the camera group and a second angle of the object relative to the second camera based on a second image of the set of images.

3. The navigation system of claim 1 , wherein a first camera group of the plurality of camera groups is directed in a first direction, and a second camera group of the plurality of camera groups is directed in a second direction.

4. The navigation system of claim 3 , wherein the first camera group is mounted to a front of the body of the aircraft, and the second camera group is mounted to a back of the aircraft.

5. The navigation system of claim 1 , wherein each camera group is a group of stereoscopic cameras.

6. The navigation system of claim 1 , wherein the processing component is to:

identify a prior location of the aircraft; and

determine a position of the object relative to the aircraft based on the set of images; and

determine the current position of the aircraft based on the prior location of the aircraft and the determined position of the object relative to the aircraft.

7. The navigation system of claim 1 , the processing component further to instruct a camera group of the plurality of camera groups to capture the set of images, the set of images captured simultaneously.

8. The navigation system of claim 1 , wherein the object is a landmark having a known location.

9. The navigation system of claim 1 , wherein the set of images comprises a first image captured by a first camera and a second image captured by a second camera, the first camera and the second camera having an offset distance.

10. The navigation system of claim 9 , wherein a position of the object in the first image is offset from a position of the object in the second image based on the offset distance between the first camera and the second camera.

11. An aircraft, comprising:

a body that includes a fuselage of the aircraft;

a first group of cameras mounted to the body of the aircraft and directed away from the aircraft, the first group of cameras comprising:

a first camera to capture a first image of a portion of an environment that surrounds the aircraft;

a second camera offset from the first camera, the second camera to capture a second image of the portion of the environment, the first image and the second image having an overlapping field of view;

a second group of cameras mounted to the body of the aircraft and directed away from the aircraft; and

a processing component to determine a location of the aircraft, the processing component coupled to the first group of cameras and the second group of cameras, wherein the processing component is to:

identify an object that appears in the first image and the second image; and

utilize the first image and the second image to determine a current location of the based on respective distances of the first camera and the second camera to the object and respective angles of the first camera and the second camera relative to the object.

12. The aircraft of claim 11 , wherein the processing component is to:

determine a first distance between the first camera and the object based on the first image;

determine a first angle of the object relative to the first camera based on the first image;

determine a second distance between the second camera and the object based on the second image;

determine a second angle of the object relative to the second camera based on the second image; and

determine a location of the object relative to the aircraft based on the first distance, the first angle, the second distance, and the second angle.

13. The aircraft of claim 11 , wherein the first camera is a first stereoscopic camera, and the second camera is a second stereoscopic camera.

14. The aircraft of claim 11 , further comprising a global positioning system (GPS) coupled to the processing component, wherein the processing component is to cause the first camera to capture the first image and the second camera to capture the second image in response to a determination that the GPS is unavailable.

15. The aircraft of claim 11 , wherein the second group of cameras are directed to capture images in a different direction from which the first group of cameras is directed to capture images, and wherein the processing component is further to utilize the images captured by the second group of cameras to determine the current location of the aircraft.

16. The aircraft of claim 13 , wherein the first group of cameras are mounted to a front of the body of the aircraft, and wherein the second group of cameras are mounted to a back of the aircraft.

17. A method of determining a current location of an aircraft, comprising:

retrieving, by a processing component, a first image of a portion of an environment from a first camera mounted to a body of the aircraft and directed away from the aircraft;

retrieving, by the processing component, a second image of the portion of the environment from a second camera mounted to the body of the aircraft and directed away from the aircraft, the second camera at an offset location relative to the first camera, the second image captured simultaneously with the first image;

identifying, by the processing component, an object that appears in the first image and the second image;

determining, by the processing component, a position of the object relative to the aircraft based on the first image and the second image, the position of the object relative to the aircraft determined based on respective distances of the first camera and the second camera to the object and respective angles of the first camera and the second camera relative to the object; and

determining, by the processing component, the current location of the aircraft based on the position of the object relative to the aircraft.

18. The method of claim 17 , wherein determining the current location of the aircraft includes:

identifying, by the processing component, a prior location of the aircraft; and

determining, by the processing component, the current location of the aircraft based on the prior location of the aircraft and the position of the object relative to the aircraft.

19. The method of claim 17 , wherein the object is a landmark having a known location, and determining the current location of the aircraft based on the position of the object relative to the aircraft comprises determining the current location of the aircraft based on the known location of the object and the position of the landmark relative to the aircraft.

20. The method of claim 17 , wherein the first camera and the second camera have a camera offset distance, the method further comprising:

determining an image offset distance between a position of the object in the first image and a position of the object in the second image; and

determining the position of the object relative to the aircraft based on the camera offset distance and the image offset distance.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: BELL TEXTRON INC.
To: BELL TEXTRON RHODE ISLAND INC.
Reel/Frame 058936/0111 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: BELL TEXTRON RHODE ISLAND INC.
To: TEXTRON INNOVATIONS INC.
Reel/Frame 058936/0169 →
Continuity (2)
Continuation 16528030 · Jul 31, 2019
Related Publication 20220050459A1 · Feb 17, 2022