Granted Patent B2

US 12,694,490 · App. 18/019,436 · Granted Jul 28, 2026

Inventors: Royston Rodrigues (Tokyo, JP); Masahiro Tani (Tokyo, JP)

Assignee: NEC CORPORATION

G06T5/77G06T3/60G06T7/11G06V10/774G06T2207/10032G06T2207/20081G06T2207/20084G06T2207/20132G06V10/759

Abstract

Claims (36)

1 . An image augmentation apparatus comprising:

at least one processor; and

memory storing instructions,

wherein the at least one processor is configured to execute the instructions to:

acquire an original training dataset including a ground-view image and an original aerial-view image;

perform an image augmentation including a cropping process and a rotation process on the original aerial-view image to generate an augmented aerial-view image, the cropping process being a process by which a target region with a regular polygon shape other than a square is cropped from the original aerial-view image, the rotation process being a process by which the original aerial-view image is rotated, an angle of the rotation being an integer multiple of a center angle of the target region; and

output an augmented training dataset including the ground-view image and the augmented aerial-view image.

2 . The image augmentation apparatus according to claim 1 , wherein the image augmentation further includes generating a plurality of the augmented aerial-view images by cropping a plurality of target regions whose shapes are different from each other, and

wherein the outputting of the augmented training dataset further includes outputting a plurality of the augmented training datasets whose augmented aerial-view images are different from each other.

3 . The image augmentation apparatus according to claim 1 , wherein the image augmentation further includes generating a plurality of the augmented aerial-view images whose angles of rotation are different from each other, and

wherein the outputting of the augmented training dataset includes outputting a plurality of the augmented training datasets whose augmented aerial-view images are different from each other.

4 . The image augmentation apparatus according to claim 1 , wherein the image augmentation further includes generating the augmented aerial-view image having a same size as the original aerial-view image by compensating for discarded pixels through an image inpainting after the cropping process and the rotation process.

5 . The image augmentation apparatus according to claim 1 , wherein the image augmentation further includes performing a circular-shift on the original ground-view image to generate an augmented ground-view image, and

wherein the augmented training dataset includes the augmented ground-view image and the augmented aerial-view image.

6 . A control method performed by a computer, comprising:

acquiring an original training dataset including a ground-view image and an original aerial-view image;

performing an image augmentation including a cropping process and a rotation process on the original aerial-view image to generate an augmented aerial-view image, the cropping process being a process by which a target region with a regular polygon shape other than a square is cropped from the original aerial-view image, the rotation process being a process by which the original aerial-view image is rotated, an angle of the rotation being an integer multiple of a center angle of the target region; and

outputting an augmented training dataset including the ground-view image and the augmented aerial-view image.

7 . The control method according to claim 6 , wherein the image augmentation further includes generating a plurality of the augmented aerial-view images by cropping a plurality of target regions whose shapes are different from each other, and

wherein the outputting of the augmented training dataset further includes outputting a plurality of the augmented training datasets whose augmented aerial-view images are different from each other.

8 . The control method according to claim 6 , wherein the image augmentation further includes generating a plurality of the augmented aerial-view images whose angles of rotation are different from each other, and

wherein the outputting of the augmented training dataset includes outputting a plurality of the augmented training datasets whose augmented aerial-view images are different from each other.

9 . The control method according to claim 6 , wherein the image augmentation further includes generating the augmented aerial-view image having a same size as the original aerial-view image by compensating for discarded pixels through an image inpainting after the cropping process and the rotation process.

10 . The control method according to claim 6 , wherein the image augmentation further includes performing a circular-shift on the original ground-view image to generate an augmented ground-view image, and

wherein the augmented training dataset includes the augmented ground-view image and the augmented aerial-view image.

11 . A non-transitory computer-readable storage medium storing a program that causes a computer to execute to:

acquire an original training dataset including a ground-view image and an original aerial-view image;

perform an image augmentation including a cropping process and a rotation process on the original aerial-view image to generate an augmented aerial-view image, the cropping process being a process by which a target region with a regular polygon shape other than a square is cropped from the original aerial-view image, the rotation process being a process by which the original aerial-view image is rotated, an angle of the rotation being an integer multiple of a center angle of the target region; and

output an augmented training dataset including the ground-view image and the augmented aerial-view image.

12 . The storage medium according to claim 11 , wherein the image augmentation further includes generating a plurality of the augmented aerial-view images by cropping a plurality of target regions whose shapes are different from each other, and

wherein the outputting of the augmented training dataset further includes outputting a plurality of the augmented training datasets whose augmented aerial-view images are different from each other.

13 . The storage medium according to claim 11 , wherein the image augmentation further includes generating a plurality of the augmented aerial-view images whose angles of rotation are different from each other, and

wherein the outputting of the augmented training dataset includes outputting a plurality of the augmented training datasets whose augmented aerial-view images are different from each other.

14 . The storage medium according to claim 11 , wherein the image augmentation further includes generating the augmented aerial-view image having a same size as the original aerial-view image by compensating for discarded pixels through an image inpainting after the cropping process and the rotation process.

15 . The storage medium according to claim 11 , wherein the image augmentation further includes performing a circular-shift on the original ground-view image to generate an augmented ground-view image, and

wherein the augmented training dataset includes the augmented ground-view image and the augmented aerial-view image.

Assignments (1)

Continuity (1)

References Cited (19)