IP Library Granted Patent US 8,130,385
Granted Patent B2
US 8,130,385 · App. 12/109,073 · Granted Mar 6, 2012

Information processing apparatus and information processing method

Assignee: Canon Kabushiki Kaisha
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,130,385
App. No.
12/109,073
Granted
Mar 6, 2012
Kind
B2
Abstract

An index detection unit ( 110 ) detects the image coordinates of indices from a captured image. An index allocation information updating unit ( 160 ) calculates the position and orientation of an image capturing apparatus using the image coordinates of the indices and allocation information of each of these indices. Furthermore, the index allocation information updating unit ( 160 ) re-calibrates allocation information of an unreliable index having a reliability indicating that the allocation information is unreliable. The index allocation information updating unit ( 160 ) updates allocation information held by an allocation information holding unit ( 140 ) in association with the unreliable index to the re-calibrated allocation information and a reliability indicating that the allocation information is reliable.

Claims (46)

1. An information processing apparatus, comprising:

a holding unit adapted to hold, for each of a plurality of indices allocated on a physical space, allocation information and a reliability thereof;

an acquisition unit adapted to acquire a captured image from an image capturing apparatus which captures the physical space;

a detection unit adapted to detect image coordinates of an index from the captured image;

a calculation unit adapted to calculate a position and orientation of the image capturing apparatus using the image coordinates of the index detected by said detection unit and the allocation information held by said holding unit in association with the index;

a re-calibration unit adapted to re-calibrate allocation information of an unreliable index having a reliability indicating that the allocation information is unreliable; and

an updating unit adapted to update the allocation information and the reliability thereof held by said holding unit in association with the unreliable index to the allocation information re-calibrated by said re-calibration unit and a reliability indicating that the allocation information is reliable.

2. The apparatus according to claim 1 , wherein said calculation unit calculates the position and orientation of the image capturing apparatus using image coordinates of reliable indices having a reliability indicating that the allocation information is reliable from among the image coordinates of the indices detected by said detection unit, and allocation information held by said holding unit in association with each of the reliable indices.

3. The apparatus according to claim 1 , further comprising a unit adapted to calculate a reliability of each index used in calculation processing during the calculation processing by said calculation unit.

4. An information processing apparatus, comprising:

a holding unit adapted to hold, for each of a plurality of indices allocated on a physical space, allocation information and a reliability thereof;

an acquisition unit adapted to acquire a captured image from an image capturing apparatus which captures the physical space;

a detection unit adapted to detect image coordinates of an index from the captured image;

a calculation unit adapted to calculate a position and orientation of the image capturing apparatus using the image coordinates of the index detected by said detection unit and the allocation information held by said holding unit in association with the index; and

a notification unit adapted to notify information associated with an unreliable index having a reliability indicating that the allocation information is unreliable.

5. The apparatus according to claim 4 , wherein said notification unit displays at least one of identification information of the unreliable index, a message indicating that re-calibration of allocation information is necessary, and a marker used to emphasize the unreliable index, at a position near image coordinates of the unreliable index on the captured image.

6. The apparatus according to claim 4 , further comprising:

a unit adapted to calculate image coordinates obtained by projecting allocation information held by said holding unit in association with the unreliable index onto the captured image,

wherein the information associated with the unreliable index is displayed at the projected image coordinates.

7. The apparatus according to claim 6 , wherein the information associated with the unreliable index differs according to a reliability for the unreliable index.

8. The apparatus according to claim 4 , further comprising:

a unit adapted to select an unreliable index, allocation information of which is to be re-calibrated, from indices notified by said notification unit; and

a unit adapted to re-calibrate allocation information held by said holding unit in association with the selected unreliable index.

9. An information processing apparatus comprising:

a holding unit adapted to hold, for each of a plurality of indices allocated on a physical space, allocation information and a reliability thereof;

an acquisition unit adapted to acquire a captured image from an image capturing apparatus which captures the physical space;

a detection unit adapted to detect image coordinates of an index from the captured image; and

a calculation unit adapted to calculate a position and orientation of the image capturing apparatus using image coordinates of an index having a reliability indicating that the allocation information is reliable from among the image coordinates of indices detected by said detection unit, and the allocation information held by said holding unit in association with that index.

10. An information processing method to be executed by an information processing apparatus which comprises a holding unit which holds, for each of a plurality of indices allocated on a physical space, allocation information and a reliability thereof, said method comprising:

an acquisition step of acquiring a captured image from an image capturing apparatus which captures the physical space;

a detection step of detecting image coordinates of an index from the captured image;

a calculation step of calculating a position and orientation of the image capturing apparatus using the image coordinates of the index detected in the detection step and the allocation information held by the holding unit in association with the index;

a re-calibration step of re-calibrating allocation information of an unreliable index having a reliability indicating that the allocation information is unreliable; and

an updating step of updating the allocation information and the reliability thereof held by the holding unit in association with the unreliable index to the allocation information re-calibrated in the re-calibration step and a reliability indicating that the allocation information is reliable.

11. An information processing method to be executed by an information processing apparatus which comprises a holding unit which holds, for each of a plurality of indices allocated on a physical space, allocation information and a reliability thereof, said method comprising:

an acquisition step of acquiring a captured image from an image capturing apparatus which captures the physical space;

a detection step of detecting image coordinates of an index from the captured image;

a calculation step of calculating a position and orientation of the image capturing apparatus using the image coordinates of the index detected in the detection step and the allocation information held by the holding unit in association with the index; and

a notification step of notifying information associated with an unreliable index having a reliability indicating that the allocation information is unreliable.

12. An information processing method to be executed by an information processing apparatus which comprises a holding unit which holds, for each of a plurality of indices allocated on a physical space, allocation information and a reliability thereof, said method comprising:

an acquisition step of acquiring a captured image from an image capturing apparatus which captures the physical space;

a detection step of detecting image coordinates of an index from the captured image; and

a calculation step of calculating a position and orientation of the image capturing apparatus using image coordinates of an index having a reliability indicating that the allocation information is reliable from among the image coordinates of indices detected in the detection step, and the allocation information held by the holding unit in association with that index.

13. A non-transitory computer-readable storage medium containing computer instructions stored therein for executing an information processing method according to claim 10 .

14. A non-transitory computer-readable storage medium containing computer instructions stored therein for executing an information processing method according to claim 11 .

15. A non-transitory computer-readable storage medium containing computer instructions stored therein for executing an information processing method according to claim 12 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2008
From: SATOH, KIYOHIDE; UCHIYAMA, SHINJI
To: CANON KABUSHIKI KAISHA
Reel/Frame 020931/0747 →
Priority Claims (1)
JP 2007-115987 · Apr 25, 2007 · national
Continuity (1)
Related Publication 20080267531A1 · Oct 30, 2008