IP Library › Granted Patent US 10,263,701
Granted Patent B2
US 10,263,701 · App. 15/838,801 · Granted Apr 16, 2019

Display method, non-transitory recording medium, and display device

Inventors: Hideki Aoyama (Osaka, JP); Mitsuaki Oshima (Kyoto, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
H04B10/116B32B37/06G06F17/30G06F17/3028H04B10/1141H04B10/54H04N21/4223H04N21/431
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,263,701
App. No.
15/838,801
Granted
Apr 16, 2019
Kind
B2
Abstract

A display method capable of displaying an image valuable to a user is disclosed. The display method according to an embodiment of the present disclosure includes: Step S 41 of capturing, by an imaging sensor, a still image lit up by a transmitter that transmits a signal by luminance change of light as a subject to obtain a captured image; Step S 42 of decoding the signal from the captured image; and Step S 43 of reading video corresponding to the decoded signal from a memory and superimposing the video on a target region corresponding to the subject in the captured image for display on a display. In Step S 43 , out of a plurality of images included in the video, the plurality of images is sequentially displayed from a leading image identical to the still image.

Claims (57)

1. A display method comprising:

capturing, by an imaging sensor, a still image lit up by a transmitter that transmits a signal by luminance change of light as a subject to obtain a captured image;

decoding the signal from the captured image;

determining whether identification information included in each of a plurality of sets is identical to the decoded signal, the plurality of sets of (i) the identification information and (ii) video being stored in a memory;

reading the video included in each of the sets with the identification information identical to the decoded signal from the memory; and

superimposing the video on a target region corresponding to the subject in the captured image for display on a display,

wherein in the superimposing, out of a plurality of images included in the video, the plurality of images is sequentially displayed from a leading image identical to the still image.

2. The display method according to claim 1 , further comprising:

transmitting the signal to a server; and

receiving the video corresponding to the signal from the server.

3. The display method according to claim 1 , wherein

the still image includes an outer frame of predetermined color,

the display method further comprises recognizing the target region from the captured image by the predetermined color, and

in the superimposing, the video is resized so as to become identical to the target region after recognizing in size, and

the video resized is superimposed on the target region in the captured image and displayed on the display.

4. The display method according to claim 1 , wherein

out of a captured region of the imaging sensor, only an image projected on a display region smaller than the captured region is displayed on the display, and

in the superimposing, when a projection region on which the subject is projected in the captured region is larger than the display region, out of the projection region, an image obtained by a portion exceeding the display region is not displayed on the display.

5. The display method according to claim 4 , wherein

when horizontal and vertical widths of the display region are w1 and h1, respectively, and horizontal and vertical widths of the projection region are w2 and h2, respectively,

in the superimposing, when a larger value of h2/h1 and w2/w1 is equal to or greater than a predetermined value, the video is displayed on an entire screen of the display, and

when the larger value of h2/h1 and w2/w1 is less than the predetermined value, the video is superimposed on the target region in the captured image and displayed on the display.

6. The display method according to claim 5 , further comprising:

turning off, when the video is displayed on the entire screen of the display, operation of the imaging sensor.

7. The display method according to claim 3 , wherein

in the superimposing, when the target region becomes unrecognizable from the captured image due to movement of the imaging sensor, the video is displayed in size identical to size of the target region recognized immediately before the target region becomes unrecognizable.

8. The display method according to claim 1 , wherein

in the superimposing, when only part of the target region is included in a region of the captured image displayed on the display due to movement of the imaging sensor, part of a spatial region of the video corresponding to the part of the target region is superimposed on the part of the target region and displayed on the display.

9. The display method according to claim 8 , wherein

in the superimposing, when the target region becomes unrecognizable from the captured image due to the movement of the imaging sensor, the part of the spatial region of the video corresponding to the part of the target region is continuously displayed, the part of the spatial region of the video being displayed immediately before the target region becomes unrecognizable.

10. The display method according to claim 7 , wherein

in the superimposing, when horizontal and vertical widths in the captured region of the imaging sensor are w0 and h0, respectively, and horizontal and vertical distances between a projection region on which the subject is projected in the captured region and the captured region are dh and dw, respectively, it is determined that the target region is unrecognizable when a smaller value of dw/w0 and dh/h0 is equal to or less than a predetermined value.

11. The display method according to claim 7 , wherein

in the superimposing, it is determined that the target region is unrecognizable, when an angle of view is equal to or less than a predetermined value, the angle of view corresponding to a shorter distance of horizontal and vertical distances between a projection region on which the subject is projected in a captured region of the imaging sensor, and the captured region.

12. A non-transitory recording medium storing thereon a computer program, which when executed by a processor, causes the processor to perform operations including:

capturing, by an imaging sensor, a still image lit up by a transmitter that transmits a signal by luminance change of light as a subject to obtain a captured image;

decoding the signal from the captured image;

determining whether identification information included in each of a plurality of sets is identical to the decoded signal, the plurality of sets of (i) the identification information and (ii) video being stored in a memory;

reading the video included in each of the sets with the identification information identical to the decoded signal from the memory; and

superimposing the video on a target region corresponding to the subject in the captured image for display on a display,

wherein in the superimposing, out of a plurality of images included in the video, the plurality of images is sequentially displayed from a leading image identical to the still image.

13. An apparatus comprising:

an imaging sensor;

a processor; and

a memory storing thereon a computer program, which when executed by the processor, causes the processor to perform operations including:

capturing, by the imaging sensor, a still image lit up by a transmitter that transmits a signal by luminance change of light as a subject to obtain a captured image;

decoding the signal from the captured image;

determining whether identification information included in each of plurality of sets is identical to the decoded signal, the plurality of sets of (i) the identification information and (ii) video being stored in a memory;

reading the video included in each of the sets with the identification information identical to the decoded signal from the memory; and

superimposing the video on a target region corresponding to the subject in the captured image for display on a display,

wherein in the superimposing, out of a plurality of images included in the video, the plurality of images is sequentially displayed from a leading image identical to the still image.

14. The apparatus according to claim 13 , wherein

the imaging sensor includes a plurality of micro mirrors and a photosensor, and

the operations further including:

specifying a region including the signal out of the captured image as a signal region;

controlling an angle of each of the plurality of micro mirrors corresponding to the specified signal region; and

causing the photosensor to receive light reflected by each of the plurality of micro mirrors with the angle being controlled.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2018
From: AOYAMA, HIDEKI; OSHIMA, MITSUAKI
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 044933/0712 →
Priority Claims (5)
JP 2015-222289 · Nov 12, 2015 · national
JP 2015-245738 · Dec 17, 2015 · national
JP 2016-100008 · May 18, 2016 · national
JP 2016-123067 · Jun 21, 2016 · national
JP 2016-145845 · Jul 25, 2016 · national
Continuity (5)
Continuation PCTJP2016004865 · Nov 11, 2016
Provisional Application 62338071 · May 18, 2016
Provisional Application 62276454 · Jan 8, 2016
Provisional Application 62268693 · Dec 17, 2015
Related Publication 20180102846A1 · Apr 12, 2018