IP Library Granted Patent US 12,200,411
Granted Patent B2
US 12,200,411 · App. 17/775,489 · Granted Jan 14, 2025

Information processing apparatus and projection system

Inventors: Kensuke Ueda (Chiyoda-ku, JP); Nobutaka Matsushima (Chiyoda-ku, JP)
Assignee: NTT DOCOMO, INC.
H04N9/3194G03B21/00G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,411
App. No.
17/775,489
Granted
Jan 14, 2025
Kind
B2
Abstract

An information processing apparatus includes a recognizer, based on captured image information generated by capturing a region on which a first image including an individual image is projected from a projector, to recognize an obstacle between the region and the projector, an identifier, when the obstacle is recognized, to identify, based on first image information indicating the first image and a recognition result by the recognizer, the individual image of which projection is blocked by the obstacle as a specific image, a decider to decide changing a first position in the region on which the specific image is projected to a second position in the region toward which projection of the specific image is not blocked by the obstacle, and a generator to generate second image information indicating a second image including an auxiliary image teaching association between the specific image located at the second position and the object.

Claims (43)

1. An information processing apparatus for use in a projection system including a projection apparatus, which is configured to project a first image including an individual image toward a projection region, and an image capturing apparatus, which is configured to generate captured image information by capturing the projection region, the individual image indicating information regarding an object existing in the projection region, the information processing apparatus comprising:

an acquirer configured to acquire the captured image information;

a recognizer configured to recognize, based on the captured image information, an obstacle existing between the projection region and the projection apparatus;

an identifier configured to, in response to the recognizer recognizing the obstacle, determine, based on first image information indicative of the first image and a result of recognition by the recognizer, whether projection of the individual image toward the project region is blocked by the obstacle, and to identify the individual image as a specific image in response to a result of the determination being affirmative;

a decider configured to decide changing a first projection position in the projection region, on which the specific image is projected, to a second projection position in the projection region toward which projection of the specific image is not blocked by the obstacle;

a generator configured to generate, based on the first image information, second image information indicative of a second image including the specific image located at the second projection position and an auxiliary image that teaches association between the specific image and the object; and

an outputter configured to output the second image information to the projection apparatus.

2. The information processing apparatus according to claim 1 , wherein the auxiliary image is associated with the specific image.

3. The information processing apparatus according to claim 1 ,

wherein:

the auxiliary image includes a first line segment and a second line segment, and

in plan view from a direction from the projection apparatus toward the projection area, a point of intersection of a straight line, which includes the first line segment in the projection area in a situation in which the second image is projected by the projection apparatus, with a straight line including the second line segment, overlaps the object.

4. The information processing apparatus according to claim 3 , wherein the specific image included in the second image is positioned between the first line segment and the second line segment.

5. The information processing apparatus according to claim 4 ,

wherein:

the auxiliary image is a polygon with four or more sides including two sides that are the first line segment and the second line segment, and

the specific image included in the second image is positioned inside the polygon.

6. The information processing apparatus according to claim 1 , wherein the auxiliary image includes a line segment, which indicates a direction from the second projection position toward a target position associated with a position of the object, and text regarding a distance from the target position to the second projection position.

7. The information processing apparatus according to claim 1 , wherein the individual image indicates a virtual object.

8. An information processing apparatus for use in a projection system including a projection apparatus, which is configured to project a first image including an individual image toward a projection region, and an image capturing apparatus, which is configured to generate captured image information by capturing the projection region, the information processing apparatus comprising:

an acquirer configured to acquire the captured image information;

a recognizer configured to recognize, based on the captured image information, an obstacle existing between the projection region and the projection apparatus;

an identifier configured to, in response to the recognizer recognizing the obstacle, determine, based on first image information indicative of the first image and a result of recognition by the recognizer, whether projection of the individual image toward the project region is blocked by the obstacle, and to identify the individual image as a specific image in response to a result of the determination being affirmative;

a decider configured to decide changing a first projection position in the projection region, on which the specific image is projected, to a second projection position in the projection region toward which projection of the specific image is not blocked by the obstacle;

a generator configured to generate, based on the first image information, second image information indicative of a second image including the specific image located at the second projection position and an auxiliary image that teaches the first projection position; and

an outputter configured to output the second image information to the projection apparatus.

9. The information processing apparatus according to claim 8 , wherein the auxiliary image includes a line segment, which indicates a direction from the second projection position toward the first projection position, and text regarding a distance from the first projection position to the second projection position.

10. A projection system including a projection apparatus, which is configured to project a first image including an individual image toward a projection region, an image capturing apparatus, which is configured to generate captured image information by capturing the projection region, and an information processing apparatus, the individual image indicating information regarding an object existing in the projection region,

the projection system comprising:

an acquirer configured to acquire the captured image information;

a recognizer configured to recognize, based on the captured image information, an obstacle existing between the projection region and the projection apparatus;

an identifier configured to, in response to the recognizer recognizing the obstacle, determine, based on first image information indicative of the first image and a result of recognition by the recognizer, whether projection of the individual image toward the project region is blocked by the obstacle, and to identify the individual image as a specific image in response to a result of the determination being affirmative;

a decider configured to decide changing a first projection position in the projection region, on which the specific image is projected, to a second projection position in the projection region toward which projection of the specific image is not blocked by the obstacle;

a generator configured to generate, based on the first image information, second image information indicative of a second image including the specific image located at the second projection position and an auxiliary image that teaches association between the specific image and the object; and

an outputter configured to output the second image information to the projection apparatus.

11. A projection system including a projection apparatus, which is configured to project a first image including an individual image toward a projection region, and an image capturing apparatus, which is configured to generate captured image information by capturing the projection region,

wherein the information processing apparatus includes:

an acquirer configured to acquire the captured image information,

a recognizer configured to recognize, based on the captured image information, an obstacle existing between the projection region and the projection apparatus,

an identifier configured to, in response to the recognizer recognizing the obstacle, determine, based on first image information indicative of the first image and a result of recognition by the recognizer, whether projection of the individual image toward the project region is blocked by the obstacle, and to identify the individual image as a specific image in response to a result of the determination being affirmative,

a decider configured to decide changing a first projection position in the projection region, on which the specific image is projected, to a second projection position in the projection region toward which projection of the specific image is not blocked by the obstacle,

a generator configured to generate, based on the first image information, second image information indicative of a second image including the specific image located at the second projection position and an auxiliary image that teaches the first projection position, and

an outputter configured to output the second image information to the projection apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2022
From: UEDA, KENSUKE; MATSUSHIMA, NOBUTAKA
To: NTT DOCOMO, INC.
Reel/Frame 059873/0569 →
Priority Claims (1)
JP 2019-206662 · Nov 15, 2019 · national
Continuity (1)
Related Publication 20220400239A1 · Dec 15, 2022
References Cited (10)
US 20120098852A1 · Kuribayashi · 2012 [cited by examiner]
US 20150138236A1 · Koga · 2015 [cited by examiner]
US 20150356760A1 · Hung · 2015 [cited by examiner]
US 20160191868A1 · Fujiune · 2016 [cited by examiner]
US 20160337626A1 · Mima · 2016 [cited by examiner]
US 20170223319A1 · Suzuki · 2017 [cited by examiner]
JP 201298705A · 2012 [cited by applicant]
JP 2013152529A · 2013 [cited by applicant]
Japanese Office Action issued on Apr. 4, 2023 in Japanese Patent Application No. 2021-556119 (with unedited computer-generated English translation), 7 pages. [cited by applicant]
International Search Report mailed on Dec. 22, 2020 in PCT/JP2020/042059 filed on Nov. 11, 2020 (2 pages). [cited by applicant]