IP Library Granted Patent US 12,146,964
Granted Patent B2
US 12,146,964 · App. 17/663,805 · Granted Nov 19, 2024

Image processing method, image processing apparatus, and image processing program

Inventor: Masashi Kuranoshita (Tokyo, JP)
Assignee: FUJIFILM Corporation
G01S17/894G06T7/194G06T7/521B64U2101/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,146,964
App. No.
17/663,805
Granted
Nov 19, 2024
Kind
B2
Abstract

An image processing method includes a step of acquiring, from an image data acquisition device and a three-dimensional data acquisition device that are calibrated, a plurality of pieces of unit image data in which image data and three-dimensional data are associated with each other, for a target object, for each angle of view of the image data acquisition device; a step of estimating a plane, based on a plurality of pieces of three-dimensional data included in the plurality of pieces of unit image data; a step of acquiring image group data by grouping a plurality of pieces of image data included in a plurality of pieces of unit image data belonging to the estimated plane; and a step of selecting image data necessary to form the plane from among the plurality of pieces of image data included in the image group data. Thus, image data can be reduced.

Claims (29)

1. An image processing method comprising:

acquiring, from an image data acquisition device and a three-dimensional data acquisition device, a plurality of pieces of unit image data including a plurality of pieces of image data and a plurality of pieces of three-dimensional data that are associated with each other, for a target object, for each angle of view of the image data acquisition device;

estimating a plane, based on the plurality of pieces of three-dimensional data included in the plurality of pieces of unit image data;

acquiring image group data by grouping a plurality of pieces of the image data included in a plurality of pieces of the unit image data belonging to the estimated plane; and

selecting image data necessary to form the plane from among the plurality of pieces of image data included in the image group data.

2. The image processing method according to claim 1 , wherein the image data and the three-dimensional data are simultaneously acquired.

3. The image processing method according to claim 1 , wherein the three-dimensional data acquisition device includes one of a stereo camera, a laser scanner, or a time-of-flight camera.

4. The image processing method according to claim 2 , wherein the three-dimensional data acquisition device includes one of a stereo camera, a laser scanner, or a time-of-flight camera.

5. The image processing method according to claim 1 , wherein the plurality of pieces of image data are two-dimensional color image data.

6. The image processing method according to claim 2 , wherein the plurality of pieces of image data are two-dimensional color image data.

7. The image processing method according to claim 3 , wherein the plurality of pieces of image data are two-dimensional color image data.

8. The image processing method according to claim 4 , wherein the plurality of pieces of image data are two-dimensional color image data.

9. The image processing method according to claim 1 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

10. The image processing method according to claim 2 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

11. The image processing method according to claim 3 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

12. The image processing method according to claim 4 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

13. The image processing method according to claim 5 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

14. The image processing method according to claim 6 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

15. The image processing method according to claim 7 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

16. The image processing method according to claim 8 , wherein in estimating a plane, estimating the plane after segmentation of the plurality of pieces of three-dimensional data is included.

17. The image processing method according to claim 1 , wherein in selecting image data, selection based on an overlapping rate of image data for forming the plane is included.

18. The image processing method according to claim 2 , wherein in selecting image data, selection based on an overlapping rate of image data for forming the plane is included.

19. An image processing apparatus comprising:

a processor configured to:

acquire, from an image data acquisition device and a three-dimensional data acquisition device, a plurality of pieces of unit image data including a plurality of pieces of image data and a plurality of pieces of three-dimensional data that are associated with each other, for a target object, for each angle of view of the image data acquisition device;

estimate a plane, based on the plurality of pieces of three-dimensional data included in the plurality of pieces of unit image data;

acquire image group data by grouping a plurality of pieces of the image data included in a plurality of pieces of the unit image data belonging to the estimated plane; and

select image data necessary to form the plane from among the plurality of pieces of image data included in the image group data.

20. A non-transitory computer readable recording medium storing an image processing program for causing a computer to execute the image processing method according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2022
From: KURANOSHITA, MASASHI
To: FUJIFILM CORPORATION
Reel/Frame 059936/0499 →
Priority Claims (1)
JP 2019-221838 · Dec 9, 2019 · national
Continuity (2)
Continuation PCTJP2020041656 · Nov 9, 2020
Related Publication 20220276387A1 · Sep 1, 2022