IP Library Granted Patent US 9,918,016
Granted Patent B2
US 9,918,016 · App. 15/161,657 · Granted Mar 13, 2018

Information communication apparatus, method, and recording medium using switchable normal mode and visible light communication mode

Inventors: Mitsuaki Oshima (Kyoto, JP); Koji Nakanishi (Kanagawa, JP); Hideki Aoyama (Osaka, JP); Ikuo Fuchigami (Fukuoka, JP); Hidehiko Shin (Osaka, JP); Tsutomu Mukai (Osaka, JP); Yosuke Matsushita (Osaka, JP); Shigehiro Iida (Tokyo, JP); Kazunori Yamada (Aichi, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
H04N5/2353H04B10/11H04B10/116H04B10/1143H04N5/23203H04N5/23245H04N5/3532H04W4/001H04W4/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,918,016
App. No.
15/161,657
Granted
Mar 13, 2018
Kind
B2
Abstract

An apparatus includes a processor and a recording medium having a program, the program causing the processor to execute operations. The operations include providing a normal mode and a visible light communication mode, wherein the normal mode and the visible light communication mode are switchable. In the normal mode, first image data is obtained by image capture with a first exposure time by sequentially starting exposure for a plurality of exposure lines in an image sensor each at a different time and each of the plurality of exposure lines partially overlaps in exposure time an adjacent exposure line. In the visible light communication mode, (i) a second exposure time of the image sensor is set, (ii) a bright line image is obtained, and (iii) information is obtained by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image.

Claims (45)

1. An apparatus, comprising:

a display;

a processor; and

a recording medium having a program, the program causing the processor to execute operations including

executing a normal mode and a visible light communication mode, wherein the normal mode and the visible light communication mode are switchable,

in the normal mode, obtaining first image data by image capture with a first exposure time by sequentially starting exposure for a plurality of exposure lines in an image sensor each at a different time and each of the plurality of exposure lines partially overlaps in exposure time an adjacent exposure line,

in the visible light communication mode,

(i) setting a second exposure time of the image sensor so that, in an image obtained by capturing a subject by the image sensor, a plurality of bright lines corresponding to the plurality of exposure lines included in the image sensor appear according to a change in luminance of the subject,

(ii) obtaining a bright line image including the plurality of bright lines, by capturing the subject changing in luminance by the image sensor with the set second exposure time by sequentially starting exposure for the plurality of exposure lines in the image sensor each at the different time and each of the plurality of exposure lines partially overlaps in exposure time the adjacent exposure line, and

(iii) obtaining information by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image; and

displaying a first image, using the first image data, on the display during a period when the visible light communication mode is executed using the image sensor,

wherein the normal mode and the visible light communication mode are executed alternatively using the image sensor.

2. The apparatus according to claim 1 ,

wherein the first image is obtained before executing the visible light communication mode.

3. The apparatus according to claim 1 ,

wherein the first image is obtained immediately before executing the visible light communication mode.

4. The apparatus according to claim 1 ,

wherein the operations further including obtaining an augmented reality image data specified by the obtained information, and

wherein in the displaying, an augmented reality image is superimposed on the first image using the augmented reality image data.

5. The apparatus according to claim 4 , further comprising:

a sensor obtaining a rotation angle of the apparatus,

wherein the operations further including obtaining the rotation angle of the apparatus, and

wherein in the displaying, a position of the augmented reality image in the first image is estimated using the rotation angle.

6. The apparatus according claim 4 ,

wherein in the normal mode, a plurality of first images are obtained,

wherein the operations further including obtaining moving direction information from the plurality of first images, and

wherein in the displaying, a position of the augmented reality image in the first image is estimated using the moving direction information.

7. A method, comprising:

executing providing a normal mode and a visible light communication mode, wherein the normal mode and the visible light communication mode are switchable,

in the normal mode, obtaining first image data by image capture with a first exposure time by sequentially starting exposure for a plurality of exposure lines in an image sensor each at a different time and each of the plurality of exposure lines partially overlaps in exposure time an adjacent exposure line,

in the visible light communication mode,

(i) setting a second exposure time of the image sensor so that, in an image obtained by capturing a subject by the image sensor, a plurality of bright lines corresponding to the plurality of exposure lines included in the image sensor appear according to a change in luminance of the subject,

(ii) obtaining a bright line image including the plurality of bright lines, by capturing the subject changing in luminance by the image sensor with the set second exposure time by sequentially starting exposure for the plurality of exposure lines in the image sensor each at the different time and each of the plurality of exposure lines partially overlaps in exposure time the adjacent exposure line, and

(iii) obtaining information by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image; and

displaying a first image, using the first image data, during a period when the visible light communication mode is executed using the image sensor,

wherein the normal mode and the visible light communication mode are executed alternatively using the image sensor.

8. A non-transitory computer-readable recording medium having a program stored therein that when executed by a processor causes the processor to execute operations including:

executing a normal mode and a visible light communication mode, wherein the normal mode and the visible light communication mode are switchable,

in the normal mode, obtaining first image data by image capture with a first exposure time by sequentially starting exposure for a plurality of exposure lines in an image sensor each at a different time and each of the plurality of exposure lines partially overlaps in exposure time an adjacent exposure line,

in the visible light communication mode,

(i) setting a second exposure time of the image sensor so that, in an image obtained by capturing a subject by the image sensor, a plurality of bright lines corresponding to the plurality of exposure lines included in the image sensor appear according to a change in luminance of the subject,

(ii) obtaining a bright line image including the plurality of bright lines, by capturing the subject changing in luminance by the image sensor with the set second exposure time by sequentially starting exposure for the plurality of exposure lines in the image sensor each at the different time and each of the plurality of exposure lines partially overlaps in exposure time the adjacent exposure line, and

(iii) obtaining information by demodulating data specified by a pattern of the plurality of bright lines included in the obtained bright line image; and

displaying a first image, using the first image data, during a period when the visible light communication mode is executed using the image sensor,

wherein the normal mode and the visible light communication mode are executed alternatively using the image sensor.

Priority Claims (11)
JP 2012-286339 · Dec 27, 2012 · national
JP 2013-070740 · Mar 28, 2013 · national
JP 2013-082546 · Apr 10, 2013 · national
JP 2013-110445 · May 24, 2013 · national
WO PCT/JP2013/003318 · May 24, 2013 · international
WO PCT/JP2013/003319 · May 24, 2013 · international
JP 2013-158359 · Jul 30, 2013 · national
JP 2013-180729 · Aug 30, 2013 · national
JP 2013-222827 · Oct 25, 2013 · national
JP 2013-224805 · Oct 29, 2013 · national
JP 2013-237460 · Nov 15, 2013 · national
Continuity (15)
Continuation 14959264 · Dec 4, 2015
Continuation 14616091 · Feb 6, 2015
Continuation 14087639 · Nov 22, 2013
Continuation In Part 13902393 · May 24, 2013
Continuation In Part 13902215 · May 24, 2013
Continuation In Part 13902436 · May 24, 2013
Provisional Application 61904611 · Nov 15, 2013
Provisional Application 61896879 · Oct 29, 2013
Provisional Application 61895615 · Oct 25, 2013
Provisional Application 61872028 · Aug 30, 2013
Provisional Application 61859902 · Jul 30, 2013
Provisional Application 61810291 · Apr 10, 2013
Provisional Application 61805978 · Mar 28, 2013
Provisional Application 61746315 · Dec 27, 2012
Related Publication 20160269608A1 · Sep 15, 2016