IP Library Granted Patent US 9,704,040
Granted Patent B2
US 9,704,040 · App. 14/661,360 · Granted Jul 11, 2017

Image processing apparatus for dividing an image based on markers, method thereof and program therefor

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,704,040
App. No.
14/661,360
Granted
Jul 11, 2017
Kind
B2
Abstract

An image processing method includes: retaining marker information including markers, each of the markers having a type which is shape, pattern or color; acquiring images in which at least one of the markers is caught; referring the marker information to detect the type and a position of the marker caught in the image; and dividing the image into a plurality of divided areas on the basis of the positions of one or more markers in the image, the plurality of divided areas having no common area and each including at least one type of the marker.

Claims (37)

1. An image processing apparatus comprising:

electronic storage configured to store marker information including a plurality of types of markers, each type of marker being distinguishable on a basis of one or more of shape, pattern or color; and

computer processing circuitry configured to at least:

acquire one or more images in which a plurality of markers is captured;

detect types and positions of the markers captured in the image according to the marker information; and

divide the image into a plurality of divided areas on a basis of the respective position of each type of marker in the image, so that each divided area includes one type of marker,

wherein the marker information further includes a processing method corresponding to each type of marker, and

the computer processing circuitry is further configured to execute the processing method corresponding to the type of marker in each divided area.

2. The image processing apparatus according to claim 1 , wherein the processing method corresponding to the type of marker in a respective divided area detects a specific object from the respective divided area or detects a luminance change in the respective divided area.

3. The image processing apparatus according to claim 1 , wherein the computer processing circuitry is further configured to obtain similarities of marker points where a plurality of markers are present on the image and a given point on the image, respectively, and to determine that the given point belongs to an area of the marker having the highest similarity.

4. The image processing apparatus according to claim 3 , wherein the computer processing circuitry is further configured to use a distance or a geodesic distance between the position of the marker points and the position of the given point as a scale of the similarity.

5. The image processing apparatus according to claim 3 , wherein the computer processing circuitry is further configured to use an amount of change in luminance value or an RGB value between the marker points and the given point as a scale of the similarity.

6. The image processing apparatus according to claim 3 , wherein the computer processing circuitry is further configured to perform area division by graph-cut by using an edge weight of the given point as a scale of the similarity.

7. The image processing apparatus according to claim 3 , wherein the computer processing circuitry is further configured to perform area division by Watershed method by using the position of the marker points and a luminance gradient of the given point as a scale of the similarity.

8. The image processing apparatus according to claim 3 , wherein the computer processing circuitry is configured to change a scale of the similarity for each marker pair compared in the image.

9. The image processing apparatus according to claim 1 , wherein the computer processing circuitry is configured to form a boundary line of the divided area and to display the divided area and the boundary line on a display.

10. The image processing apparatus according to claim 1 , wherein the processing method corresponding to one type of marker deletes other markers present within a certain range of the one type of marker in the image and processes the deleted markers so as not to be used for division of the area.

11. The image processing apparatus according to claim 10 , wherein the one type of marker is a marker type specific for a deleting process.

12. An image processing method comprising:

storing, in electronic storage, marker information including a plurality of types of markers, each type of marker being distinguishable on the basis of one or more of shape, pattern or color;

acquiring, by computer processing circuitry, one or more images in which a plurality of markers is captured;

detecting, by the computer processing circuitry, the types and positions of the markers captured in the image according to the marker information; and

dividing, by the computer processing circuitry, the image into a plurality of divided areas on the basis of the respective position of each type of marker in the image, so that each divided area includes one type of marker, wherein

the marker information further includes a processing method corresponding to each type of marker, and the method further comprises

executing, by the computer processing circuitry, the processing method corresponding to the type of marker in each divided area.

13. A program stored in a non-transitory computer readable recording medium, the program, when executed, causing a computer comprising computer processing circuitry to perform at least:

acquiring one or more images in which a plurality of markers is captured;

detecting types and positions of the markers captured in the image according to marker information stored in electronic storage accessible to the computer, the marker information including a plurality of types of markers, each type of marker being distinguishable on the basis of one or more of shape, pattern or color; and

dividing the image into a plurality of divided areas on the basis of the respective position of each type of marker in the image, so that each divided area includes one type of marker, wherein

the marker information further includes a processing method corresponding to each type of marker, and the program causes the computer to further perform

executing the processing method corresponding to the type of marker in each divided area.

14. The apparatus according to claim 1 , wherein each divided area includes one or more markers of the same type.

15. The apparatus according to claim 2 , wherein, in the marker information, the type of the marker and the specific object which is detected are stored in the electronic storage in correspondence with each other.

16. The apparatus according to claim 2 , wherein, in the marker information, the type of the marker is stored in the electronic storage in correspondence with an area where the specific object is detected or an area where the specific object is not detected.

17. The apparatus according to claim 1 , wherein a boundary of the divided areas is located between markers of different types.

18. The apparatus according to claim 1 , wherein markers of the same type are included in the same divided area.

19. The apparatus according to claim 1 , wherein each divided area does not overlap any other divided area.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY'S ADDRESS PREVIOUSLY RECORDED ON REEL 048547 FRAME 0187. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNORS INTEREST. Recorded May 6, 2020
From: KABUSHIKI KAISHA TOSHIBA
To: TOSHIBA DIGITAL SOLUTIONS CORPORATION
Reel/Frame 052595/0307 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ADD SECOND RECEIVING PARTY PREVIOUSLY RECORDED AT REEL: 48547 FRAME: 187. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 13, 2019
From: KABUSHIKI KAISHA TOSHIBA
To: KABUSHIKI KAISHA TOSHIBA; TOSHIBA DIGITAL SOLUTIONS CORPORATION
Reel/Frame 050041/0054 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2019
From: KABUSHIKI KAISHA TOSHIBA
To: TOSHIBA DIGITAL SOLUTIONS CORPORATION
Reel/Frame 048547/0187 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2015
From: MARUYAMA, MASAYUKI; YAMAGUCHI, OSAMU; YUASA, MAYUMI; KOZAKAYA, TATSUO; KAWAHARA, TOMOKAZU; PHAM, QUOC VIET
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 035469/0761 →