IP Library › Granted Patent US 9,699,366
Granted Patent B2
US 9,699,366 · App. 14/699,331 · Granted Jul 4, 2017

Image providing apparatus, image display device, imaging system, image display system, and image providing method in which composite image data is generated using auxiliary image data generated by at least one auxiliary imaging unit

Inventors: Akinobu Sato (Hachioji, JP); Saori Matsumoto (Hino, JP); Keito Fukushima (Mitaka, JP); Hiroki Amino (Akiruno, JP); Takashi Hamada (Hachioji, JP); Osamu Nonaka (Sagamihara, JP)
Assignee: Olympus Corporation
H04N5/23206H04N5/23216H04N5/23293H04N5/3415H04N5/77H04N9/79H04N5/247H04N5/272H04N2101/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,699,366
App. No.
14/699,331
Granted
Jul 4, 2017
Kind
B2
Abstract

An image providing apparatus includes: a plurality of auxiliary imaging units that have shooting ranges partially overlapping one another, and each of which images a subject to generate auxiliary image data; a provider communication unit; a provider communication control unit that receives, from the portable device, via the provider communication unit, transmission request information requesting the image providing apparatus to transmit composite image data; and an image synthesizing unit that generates, based on the transmission request information, composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units. The provider communication control unit transmits, via the provider communication unit, the composite image data to the portable device.

Claims (38)

1. An image providing apparatus that provides image data to a portable device carried by a user, the image providing apparatus comprising:

a plurality of auxiliary imaging units, each having a shooting range, to generate auxiliary image data;

a provider communication unit that performs communication with the portable device;

a provider communication control unit that receives, from the portable device, via the provider communication unit, transmission request information requesting the image providing apparatus to transmit composite image data, wherein the transmission request information includes current position information related to a current position of the portable device;

a shooting range information recording unit that records therein a plurality of pieces of shooting range information related to the respective shooting ranges of the plurality of auxiliary imaging units; and

an image synthesizing unit that generates, based on (1) the current position information included in the transmission request information received from the portable device via the provider communication unit and (2) the plurality of pieces of shooting range information, composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units, or by combining the auxiliary image data generated by at least one of the auxiliary imaging units and image data captured by the portable device,

wherein the provider communication control unit transmits, via the provider communication unit, the composite image data to the portable device,

wherein the image synthesizing unit that generates composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units, does so by (1) determining, for each of the plurality of pieces of shooting range information, whether the piece of shooting range information includes the current position information included in the transmission request information received from the portable device via the provider communication unit and (2) responsive to a determination that a piece of shooting range information includes the current position information, including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image and otherwise, responsive to a determination that a piece of shooting range information does not include the current position information, not including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image.

2. The image providing apparatus according to claim 1 , wherein the image synthesizing unit generates the composite image data including a subject image corresponding to the user.

3. The image providing apparatus according to claim 2 , wherein

the transmission request information includes feature information related to a feature of a subject image corresponding to the user included in in-camera image data obtained by imaging the user as a subject by a first imaging unit composing the portable device, and

the image synthesizing unit generates the composite image data including a subject image having a feature based on the feature information.

4. The image providing apparatus according to claim 2 , wherein

the transmission request information includes in-camera image data obtained by imaging the user as a subject by a first imaging unit composing the portable device, and

the image synthesizing unit generates feature information related to a feature of a subject image included in the in-camera image data and generates the composite image data including a subject image having a feature based on the generated feature information.

5. The image providing apparatus according to claim 1 , further comprising an image extracting unit that generates, when area information related to a partial area of a composite image corresponding to the composite image data is received from the portable device via the provider communication unit, extracted image data in which the partial area based on the area information has been extracted from the composite image, wherein

the provider communication control unit transmits, via the provider communication unit, the extracted image data to the portable device.

6. The image providing apparatus according to claim 1 wherein the image synthesizing unit that generates composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units, does so by (1) predicting, for each of the plurality of pieces of shooting range information and using the current position information, whether the piece of shooting range information includes a subject of an imaging device of the image providing apparatus and (2) responsive to a determination that a piece of shooting range information includes a subject of the imaging device, including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image and otherwise, responsive to a determination that a piece of shooting range information does not include a subject of the imaging device, not including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image.

7. The image providing apparatus according to claim 1 wherein the shooting ranges of at least some of the auxiliary imaging units partially overlap one another.

8. The image providing apparatus according to claim 1 wherein the portable device has an image capture function, and wherein the composite image data includes the image data captured by the portable device.

9. An imaging system, comprising:

a portable device carried by a user; and

the image providing apparatus according to claim 1 , wherein

the portable device comprises:

an operation reception unit that receives a first user operation;

a request information generating unit that generates, when the operation reception unit receives the first user operation, the transmission request information;

a portable communication unit that performs communication with the image providing apparatus; and

a portable communication control unit that transmits the transmission request information to the image providing apparatus and receives the composite image data from the image providing apparatus, via the portable communication unit.

10. An image providing method executed by an image providing apparatus that provides image data to a portable device carried by a user, the image providing method comprising:

causing a plurality of auxiliary imaging units, each having a shooting range, to generate auxiliary image data;

receiving, from the portable device, transmission request information requesting the image providing apparatus to transmit composite image data, wherein the transmission request information includes current position information related to a current position of the portable device;

recording a plurality of pieces of shooting range information related to the respective shooting ranges of the plurality of auxiliary image units;

generating, based on (1) the current position information included in the transmission request information and (2) the plurality of pieces of shooting range information, composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units, or by combining the auxiliary image data generated by at least one of the auxiliary imaging units and image data captured by the portable device; and

transmitting the composite image data to the portable device,

wherein the act of generating composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units includes (1) determining, for each of the plurality of pieces of shooting range information, whether the piece of shooting range information includes the current position information included in the transmission request information received from the portable device and (2) responsive to a determination that a piece of shooting range information includes the current position information, including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image and otherwise, responsive to a determination that a piece of shooting range information does not include the current position information, not including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image.

11. The image providing method of claim 10 wherein the act of generating composite image data by combining the auxiliary image data respectively generated by two or more of the plurality of auxiliary imaging units includes (1) predicting, for each of the plurality of pieces of shooting range information and using the current position information, whether the piece of shooting range information includes a subject of an imaging device of the image providing apparatus and (2) responsive to a determination that a piece of shooting range information includes a subject of the imaging device, including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image and otherwise, responsive to a determination that a piece of shooting range information does not include a subject of the imaging device, not including an image from the auxiliary imaging unit corresponding to the piece of shooting range in the composite image.

12. The image providing method of claim 10 wherein the shooting ranges of at least some of the auxiliary imaging units partially overlap one another.

13. The image providing method of claim 10 wherein the portable device has an image capture function, and wherein the composite image data includes the image data captured by the portable device.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2021
From: OLYMPUS CORPORATION
To: OM DIGITAL SOLUTIONS CORPORATION
Reel/Frame 058294/0274 →
ASSIGNEE CHANGE OF ADDRESS. NEW ADDRESS IS AT THIRD ROW OF PAGE 1/9 (PAGE 1/10 OF TRANSLATION) AND OLD ADDRESS IS AT LAST ROW OF PAGE 9/9 (PAGE 10/10 IN TRANSLATION). DOCUMENT IS DATED AND STAMPED (SIGNED) AT BOTTOM OF PAGE 9/9. Recorded May 23, 2017
From: OLYMPUS CORPORATION
To: OLYMPUS CORPORATION
Reel/Frame 042539/0121 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2015
From: SATO, AKINOBU; MATSUMOTO, SAORI; FUKUSHIMA, KEITO; AMINO, HIROKI; HAMADA, TAKASHI; NONAKA, OSAMU
To: OLYMPUS CORPORATION
Reel/Frame 035527/0916 →
Priority Claims (1)
JP 2014-095356 · May 2, 2014 · national
Continuity (1)
Related Publication 20150319360A1 · Nov 5, 2015