IP Library › Granted Patent US 12,456,215
Granted Patent B2
US 12,456,215 · App. 19/040,133 · Granted Oct 28, 2025

Spacecraft system for generating a 3-D map of an object in near real-time under non-ideal lighting condititons

Inventors: Michael Klug (Redondo Beach, CA); Joseph Vermeersch (Hermosa Beach, CA); Justin Pank (El Segundo, CA); Scott Plantenga (El Segundo, CA); Brayamh Lopez (El Segundo, CA); Scott Dow (El Segundo, CA); Adriel Bustamante (Jurupa Valley, CA)
G06T7/579B64G1/66H04N23/20H04N23/695H04N23/74G06T2207/10032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,456,215
App. No.
19/040,133
Granted
Oct 28, 2025
Kind
B2
Abstract

An apparatus for generating a 3D image map comprises a camera, mounted to a spacecraft, configured to capture plurality of images of an object from a plurality of positions about the object. An unstructured light source for illuminating the object to capture the plurality of images of the object. A gimbal mechanism for mounting the camera and the unstructured light source and moving the camera to a plurality of positions. Image processing circuitry configured to process the plurality of images of the object and generate a 3D image map of the of the object responsive to the plurality of image of the object. The image processing circuitry further having a processor configured to implement a shape-from-motion algorithm for generating the 3D image map responsive to the plurality of images of the object.

Claims (33)

1 . An apparatus for generating a 3D image map of an object, comprising:

a high-resolution camera within a spacecraft configured to capture plurality of overlapping images of the object from a plurality of positions about the object;

an unstructured light source within the spacecraft for illuminating the object with light not having a specific pattern or arrangement to capture the plurality of overlapping images of the object; and

image processing circuitry within the spacecraft configured to process the plurality of overlapping images of the object and generate a 3D image map of the of the object responsive to the plurality of overlapping images of the object.

2 . The apparatus of claim 1 further comprising an infrared camera configured to capture the plurality of overlapping images of the object.

3 . The apparatus of claim 1 further comprising a gimble mechanism for mounting the high-resolution camera and the unstructured light source, the gimble mechanism enabling the high-resolution camera and the unstructured light source to be moved to a plurality of camera positions.

4 . The apparatus of claim 3 further comprising a gimble controller configured to control movement of the gimble mechanism to move the high-resolution camera and the unstructured light source to the plurality of positions.

5 . The apparatus of claim 1 further comprising position measurement circuitry configured to determine a position and associated data indicating the position with each of the plurality of overlapping images of the object.

6 . The apparatus of claim 1 , wherein the image processing circuitry further comprises a graphics processor configured to process the plurality of overlapping images of the object.

7 . The apparatus of claim 1 , wherein the image processing circuitry further comprises a processor configured to implement a shape-from-motion algorithm for generating the 3D image map responsive to the plurality of overlapping images of the object.

8 . The apparatus of claim 1 , wherein the high-resolution camera, the unstructured light source and the image processing circuitry are self-contained and do not rely upon data from the spacecraft on which the apparatus is implemented.

9 . An apparatus for generating a 3D image map, comprising:

a high-resolution camera, mounted to a spacecraft, configured to capture a plurality of overlapping images of an object from a plurality of positions about the object;

an unstructured light source, mounted to the spacecraft, for illuminating the object with light not having a specific pattern or arrangement to capture the plurality of overlapping images of the object;

a gimbal mechanism, mounted to the spacecraft, for mounting the high-resolution camera and the unstructured light source, the gimbal mechanism enabling movement of the high-resolution camera and the unstructured light source to a plurality of camera positions; and

image processing circuitry associated with the spacecraft configured to process the plurality of overlapping images of the object and generate a 3D image map of the object responsive to the plurality of overlapping images of the object, wherein the image processing circuitry further comprises a processor configured to implement a shape-from-motion algorithm for generating the 3D image map responsive to the plurality of overlapping images of the object.

10 . The apparatus of claim 9 further comprising an infrared camera configured to capture the plurality of overlapping images of the object.

11 . The apparatus of claim 9 further comprising a gimbal controller configured to control movement of the gimbal mechanism to move the high-resolution camera and the unstructured light source to the plurality of positions.

12 . The apparatus of claim 9 further comprising a position measurement circuitry configured to determine a position and associated data indicating the position with each of the plurality of overlapping images of the object.

13 . The apparatus of claim 9 , wherein the image processing circuitry further comprises a graphics processor configured to process the plurality of overlapping images of the object.

14 . A method for generating a 3D image map for a 3D mapping system mounted to a spacecraft, comprising:

capturing at the spacecraft a plurality of overlapping images of an object from a plurality of positions about the object using a high-resolution camera mounted to the spacecraft;

generating light not having a specific pattern or arrangement from an unstructured light source at the spacecraft;

illuminating the object with the light not having the specific pattern or arrangement to capture the plurality of overlapping images of the object with the unstructured light source; and

processing at the spacecraft the plurality of overlapping images of the object to generate a 3D image map of the of the object responsive to the plurality of overlapping image of the object using image processing circuitry.

15 . The method of claim 14 further comprising capturing further comprises capturing the plurality of overlapping images of the object using an infrared camera.

16 . The method of claim 14 further comprising:

mounting the high-resolution camera and the unstructured light source to a gimbal mechanism; and

moving the high-resolution camera and the unstructured light source between a plurality of camera positions using the gimbal mechanism.

17 . The method of claim 16 further comprising controlling movement of the gimbal mechanism to move the high-resolution camera and the unstructured light source to the plurality of positions using a gimbal controller.

18 . The method of claim 14 further comprising a position measurement circuitry configured to determine a position and associated data indicating the position with each of the plurality of overlapping images of the object.

19 . The method of claim 14 , wherein the step of processing further comprises processing the plurality of overlapping images of the object using a graphics processor.

20 . The method of claim 14 , wherein the step of processing further comprises generating the 3D image map responsive to the plurality of overlapping images of the object using a processor configured to implement a shape-from-motion algorithm.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2025
From: KLUG, MICHAEL; VERMEERSCH, JOSEPH; PANK, JUSTIN; PLANTENGA, SCOTT; LOPEZ, BRAYAMH; DOW, SCOTT; BUSTAMANTE, ADRIEL
To: FALCON EXODYNAMICS, INC.
Reel/Frame 070049/0154 →
Continuity (2)
Provisional Application 63551358 · Feb 8, 2024
Related Publication 20250259324A1 · Aug 14, 2025
References Cited (17)
US 10853942B1 · Boyd · 2020 [cited by examiner]
US 11119478B2 · McArthur · 2021 [cited by examiner]
US 11573544B2 · Henry · 2023 [cited by examiner]
US 20230146926A1 · Gorantla · 2023 [cited by examiner]
US 20230213610A1 · Eberspach · 2023 [cited by examiner]
Volpe R, Sabatini M, Palmerini GB. Pose and shape reconstruction of a noncooperative spacecraft using camera and range measurements. International Journal of Aerospace Engineering. 2017;2017(1):4535316. [cited by examiner]
Opromolla R, Fasano G, Rufino G, Grassi M. A review of cooperative and uncooperative spacecraft pose determination techniques for close-proximity operations. Progress in Aerospace Sciences. Aug. 1, 2017;93:53-72. [cited by examiner]
Lichter MD, Dubowsky S. State, shape, and parameter estimation of space objects from range images. InIEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA'04. 2004 Apr. 26, 2004 (vol. 3, pp. … [cited by examiner]
Wang B, Li S, Mu J, Hao X, Zhu W, Hu J. Research advancements in key technologies for space-based situational awareness. Space: Science & Technology. Jun. 18, 2022. [cited by examiner]
Klionovska K, Ventura J, Benninghoff H, Huber F. Close range tracking of an uncooperative target in a sequence of photonic mixer device (PMD) images. Robotics. Jan. 10, 2018;7(1):5. [cited by examiner]
Schnitzer F, Janschek K, Willich G. Experimental results for image-based geometrical reconstruction for spacecraft rendezvous navigation with unknown and uncooperative target spacecraft. In2012 IEEE/RSJ International Co… [cited by examiner]
Murthy K, Shearn M, Smiley BD, Chau AH, Levine J, Robinson MD. SkySat-1: very high-resolution imagery from a small satellite. InSensors, systems, and next-generation Satellites XVIII Oct. 7, 2014 (vol. 9241, pp. 367-378… [cited by examiner]
Lepcha DC, Goyal B, Dogra A, Goyal V. Image super-resolution: A comprehensive review, recent trends, challenges and applications. Information Fusion. Mar. 1, 2023;91:230-60. [cited by examiner]
Ishiguro M, Nakamura R, Tholen DJ, Hirata N, Demura H, Nemoto E, Nakamura AM, Higuchi Y, Sogame A, Yamamoto A, Kitazato K. The Hayabusa spacecraft asteroid multi-band imaging camera (AMICA). Icarus. Jun. 1, 2010;207(2):… [cited by examiner]
Awad MM. A Morphological Model for Extracting Road Networks from High-Resolution Satellite Images. Journal of Engineering. 2013;2013(1):243021. [cited by examiner]
Xiang A, Zhang L, Fan L. Shadow removal of spacecraft images with multi-illumination angles image fusion. Aerospace Science and Technology. Sep. 1, 2023;140:108453. [cited by examiner]
Maass B. Robust approximation of image illumination direction in a segmentation-based crater detection algorithm for spacecraft navigation. CEAS Space Journal. Dec. 2016;8:303-14. [cited by examiner]