IP Library Granted Patent US 10,572,971
Granted Patent B2
US 10,572,971 · App. 15/748,689 · Granted Feb 25, 2020

Projection device, projection method and program storage medium

Inventor: Junichi Tamai (Kanagawa, JP)
Assignee: NEC PLATFORMS, LTD.
G06T3/005G06T5/006G06T5/20G06T7/0002G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,572,971
App. No.
15/748,689
Granted
Feb 25, 2020
Kind
B2
Abstract

To display an image even on a projection surface having complex unevenness similarly to a flat, a projection device includes: a storage unit storing at least a pattern image for detecting distortion depending on a state of the surface, an expected image associated with a displayed image of the pattern image displayed on a flat, and a desired projection image; a projection unit projecting an image including the pattern image and the desired projection image; an image acquisition unit acquiring a displayed image of the pattern image, and extracting a distortion image; a distortion amount calculating unit calculating a distortion parameter for distortion by comparing the expected image with the distortion image; a distortion correction processing unit correcting the projected desired projection image by using the distortion parameter; and an image output unit outputting, to the projection unit, image data including the corrected desired projection image and the pattern image.

Claims (59)

1. A projection device comprising:

storage circuitry that stores at least a pattern image for detecting distortion depending on a surface state of a projection surface, an expected image associated with a displayed image when the pattern image is displayed on a flat surface, and a desired projection image;

a projector that projects, on the projection surface, an image including the pattern image and the desired projection image;

image acquisition circuitry that acquires a displayed image of the pattern image displayed on the projection surface, and extracts a distortion image;

distortion amount calculating circuitry that calculates a distortion parameter relating to distortion of the projection surface by comparing the expected image with the distortion image;

distortion correction processing circuitry that corrects the desired projection image to be projected on the projection surface, by using the distortion parameter; and

image output circuitry that outputs, to the projector, image data including the desired projection image corrected by the distortion correction processing circuitry, and the pattern image

wherein the storage circuitry store the pattern image and the expected image divided into a plurality of areas associated with each other,

the projector projects vertexes of the pattern image successively, and

the distortion amount calculating circuitry calculates, each time vertexes on a displayed image of the pattern image displayed on the projection surface, the distortion parameter for each of the plurality of areas successively.

2. The projection device according to claim 1 , further comprising

a camera that captures the projection surface, and outputs the captured image data to the image acquisition circuitry, wherein

the image acquisition circuitry

extracts a displayed image of the pattern image from the acquired image data, as the distortion image.

3. The projection device according to claim 1 , wherein

the distortion amount calculating circuitry

compares associated areas of the distortion image corresponding to the displayed image of the pattern image, and the expected image, and calculates the distortion parameter.

4. The projection device according to claim 3 , wherein

the distortion amount calculating circuitry

calculates an inverse matrix of a matrix for transforming a triangle constituting the distortion image to a triangle constituting the expected image, as the distortion parameter.

5. The projection device according to claim 3 , wherein

the projector

projects vertexes of a triangle constituting the pattern image successively, and

the distortion amount calculating circuitry

calculates, each time vertexes on a displayed image of the pattern image displayed on the projection surface form a triangle, the distortion parameter relating to a formed triangle successively.

6. The projection device according to claim 2 , wherein

the camera

is disposed at a position where the projection surface is viewed.

7. The projection device according to claim 3 , wherein

the distortion amount calculating circuitry

outputs a command for subdividing a triangle in which distortion equal to or larger than a certain amount occurs, among triangles constituting the distortion image, and

the distortion correction processing circuitry

subdivides a triangle constituting the expected image and being associated with a triangle in which distortion equal to or larger than the certain amount occurs, in response to a command of the distortion amount calculating circuitry.

8. The projection device according to claim 1 , further comprising

end pixel adjusting circuitry that adjusts a display area of an image to be displayed on the projection surface, when a peripheral portion of an image to be displayed on the projection surface is lacked, wherein

the projector

projects a pixel of an end portion of the expected image on the projection surface,

the image acquisition circuitry

acquires a position of a pixel of the end portion displayed on the projection surface,

the end pixel adjusting circuitry

generates a shrunk expected image obtained by shrinking the expected image in such a manner as to be present within an area of an end pixel reference position to be defined from a position of a pixel of the end portion acquired by the image acquisition circuitry,

the image output circuitry

outputs, to the projector, the pattern image shrunk in association with the shrunk expected image,

the projector

projects the shrunk pattern image output by the image output circuitry, on the projection surface, and

the distortion amount calculating circuitry

calculates the distortion parameter by comparing the distortion image corresponding to a displayed image of the shrunk pattern image with the shrunk expected image.

9. A projection method comprising:

projecting vertexes of a pattern image, which is divided into a plurality of areas, for detecting distortion depending on a surface state of a projection surface, on the projection surface successively;

acquiring a displayed image of the pattern image displayed on the projection surface, and extracting a distortion image;

calculating a distortion parameter of the projection surface by comparing an expected image, which is divided into a plurality of areas associated with the plurality of areas of the pattern image, associated with a displayed image when the pattern image is displayed on a flat surface, with the distortion image for each of the plurality of areas successively, each time vertexes on a displayed image of the pattern image displayed on the projection surface;

correcting a desired projection image to be projected on the projection surface, by using the distortion parameter; and

projecting the corrected desired projection image on the projection surface.

10. A non-transitory program storage medium storing a projection program that causes a computer to execute:

processing of projecting vertexes of a pattern image, which is divided into a plurality of areas, for detecting distortion depending on a surface state of a projection surface, on the projection surface successively;

processing of acquiring a displayed image of the pattern image displayed on the projection surface, and extracting a distortion image;

processing of calculating a distortion parameter of the projection surface by comparing an expected image, which is divided into a plurality of areas associated with the plurality of areas of the pattern image, associated with a displayed image when the pattern image is displayed on a flat surface, with the distortion image for each of the plurality of areas successively, each time vertexes on a displayed image of the pattern image displayed on the projection surface;

processing of correcting a desired projection image to be projected on the projection surface, by using the distortion parameter; and

processing of projecting the corrected desired projection image on the projection surface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2018
From: TAMAI, JUNICHI
To: NEC PLATFORMS, LTD.
Reel/Frame 044763/0414 →
Priority Claims (1)
JP 2015-171877 · Sep 1, 2015 · national
Continuity (1)
Related Publication 20190005607A1 · Jan 3, 2019