IP Library › Granted Patent US 12,456,295
Granted Patent B2
US 12,456,295 · App. 17/616,406 · Granted Oct 28, 2025

Image processing method and data structure of metadata

Inventors: Naomi Kurahara (Tokyo, JP); Itaru Shimizu (Tokyo, JP); Tetsu Ogawa (Tokyo, JP); Satoshi Ezawa (Tokyo, JP); Kazuo Ishigame (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06V20/13G06T7/70G06V10/762G06T2207/10044G06T2207/30181G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,456,295
App. No.
17/616,406
Granted
Oct 28, 2025
Kind
B2
Abstract

Provided is an image processing method for image processing on a plurality of captured images obtained by operation of a formation flight. A satellite cluster management device and an image analysis server as image processing apparatuses perform predetermined image processing on the basis of satellite specification information for specifying an artificial satellite associated as metadata with a captured image captured by the artificial satellite.

Claims (33)

1. An image processing method, comprising:

receiving, by an image processing apparatus, from an artificial satellite of a plurality of artificial satellites, an image captured by the artificial satellite and metadata associated with the captured image,

wherein the metadata includes:

a satellite cluster identifier that identifies a satellite cluster, wherein the satellite cluster includes the plurality of artificial satellites,

a satellite identifier that identifies the artificial satellite,

first information that indicates a latitude of an imaging target in the captured image and a longitude of the imaging target in the captured image, and

second information that indicates an acceleration of the artificial satellite at a time of the capture of the image; and

performing, by the image processing apparatus, specific image processing on the captured image based on the metadata.

2. The image processing method according to claim 1 , wherein the metadata further includes third information associated with a relative position of each artificial satellite of the plurality of artificial satellites.

3. The image processing method according to claim 2 , wherein the third information includes:

an arrangement sequence of each artificial satellite of the plurality of artificial satellites, and

distances between the plurality of artificial satellites.

4. The image processing method according to claim 1 , further comprising:

receiving, by the image processing apparatus, a plurality of images captured by the plurality of artificial satellites,

wherein the plurality of images includes the image; and

performing, by the image processing apparatus, the specific image processing on the plurality of images based on the metadata.

5. The image processing method according to claim 4 , wherein the specific image processing corresponds to resolution enhancement processing.

6. The image processing method according to claim 4 , wherein the specific image processing corresponds to three-dimensional measurement processing.

7. The image processing method according to claim 4 , wherein

the plurality of images is captured from a same position with a time difference, and

the image processing method further comprises extracting, by the image processing apparatus, a change in an object in the plurality of images.

8. The image processing method according to claim 4 , wherein the plurality of artificial satellites includes a plurality of imaging devices having a same performance.

9. The image processing method according to claim 4 , wherein the plurality of artificial satellites includes a plurality of imaging devices having different performances.

10. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:

receiving, from an artificial satellite of a plurality of artificial satellites, an image captured by the artificial satellite and metadata associated with the captured image,

wherein the metadata includes:

a satellite cluster identifier that identifies a satellite cluster, wherein the satellite cluster includes the plurality of artificial satellites,

a satellite identifier that identifies the artificial satellite,

first information regarding a relative position of each artificial satellite of the plurality of artificial satellites,

second information that indicates a latitude of an imaging target in the captured image and a longitude of the imaging target in the captured image, and

third information that indicates an acceleration of the artificial satellite at a time of the capture of the image; and

performing specific image processing on the captured image based on the metadata.

11. The image processing method according to claim 1 , wherein the specific image processing corresponds to a geometric correction of an orbit position of the artificial satellite.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2022
From: KURAHARA, NAOMI; SHIMIZU, ITARU; OGAWA, TETSU; EZAWA, SATOSHI; ISHIGAME, KAZUO
To: SONY GROUP CORPORATION
Reel/Frame 059500/0456 →
Priority Claims (1)
JP 2019-109282 · Jun 12, 2019 · national
Continuity (1)
Related Publication 20220327820A1 · Oct 13, 2022
References Cited (36)
US 6219617B1 · Dreischer et al. · 2001 [cited by applicant]
US 10250319B2 · Coleman · 2019 [cited by examiner]
US 10839211B2 · Reinstein · 2020 [cited by examiner]
US 10969237B1 · Zhang · 2021 [cited by examiner]
US 20020041328A1 · LeCompte · 2002 [cited by examiner]
US 20090179792A1 · Remondi · 2009 [cited by examiner]
US 20110298923A1 · Mukae · 2011 [cited by examiner]
US 20200028578A1 · Coleman · 2020 [cited by examiner]
US 20210319590A1 · Gulde · 2021 [cited by examiner]
US 20220185506A1 · Kawamura · 2022 [cited by examiner]
CA 2266127A1 · 1999 [cited by applicant]
CN 108008380A · 2018 [cited by applicant]
CN 109635068A · 2019 [cited by applicant]
CN 108008380B · 2020 [cited by examiner]
EP 0887666A1 · 1998 [cited by applicant]
JP 989558A · 1997 [cited by applicant]
JP H0989558A · 1997 [cited by examiner]
JP 11255200A · 1999 [cited by applicant]
JP 2000163673A · 2000 [cited by applicant]
JP 2000235074A · 2000 [cited by applicant]
JP 2009009436A · 2009 [cited by applicant]
JP 2012234374A · 2012 [cited by applicant]
JP 2013129307A · 2013 [cited by applicant]
JP 2017208813A · 2017 [cited by applicant]
JP 2021519089 · 2021 [cited by applicant]
JP 2021525991 · 2021 [cited by applicant]
WO WO2010097921A1 · 2010 [cited by applicant]
WO 2017195858A1 · 2017 [cited by applicant]
WO WO2018231515A1 · 2018 [cited by applicant]
WO WO2019075305A1 · 2019 [cited by examiner]
WO WO2020230252A1 · 2020 [cited by applicant]
WO WO2020250708A1 · 2020 [cited by applicant]
International Search Report and Written Opinion of PCT Application No. PCT/JP2020/021284, issued on Aug. 18, 2020, 11 pages of ISRWO. [cited by applicant]
Doihara, et al., “Working on Imagery in ISO/TC211”, “4.2 Metadata Part 2: Extensions for imagery and gridded data (ISO19115-2:2009)”, Papers and proceedings of the Geographic Information Systems Association, vol. 18, Oc… [cited by applicant]
“Krieger, Gerhard, et al, TanDEM-X: A Satellite Formation for High-Resolution SAR Interferometry”, IEEE Transactions On Geoscience and Remote Sensing, Nov. 30, 2007, vol. 45, No. 11, pp. 3317-3341, DOI: 10.1109/TGRS.200… [cited by applicant]
Moreira, Alberto, et al, “TanDEM-X: A TerraSAR-X Add-On Satellite for Single-Pass SAR Interferometry”, IGARSS2004, 2004 IEEE International Geoscience and Remote Sensing Symposium, Sep. 20, 2004, pp. 1000-1003, DOI: 10.1… [cited by applicant]