IP Library › Granted Patent US 11,195,061
Granted Patent B2
US 11,195,061 · App. 16/415,002 · Granted Dec 7, 2021

Image generation apparatus and method for generating image

Inventors: Satoshi Sato (Kyoto, JP); Masahiko Saito (Kanagawa, JP); Takeo Azuma (Kyoto, JP); Kunio Nobori (Tokyo, JP); Nobuhiko Wakai (Tokyo, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06K9/628G06N3/08G06T7/00G06T7/246H04N5/232G06T2207/30242G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,195,061
App. No.
16/415,002
Granted
Dec 7, 2021
Kind
B2
Abstract

An image generation apparatus includes a processing circuit and a memory storing at least one computational image. The at least one computational image is a light-field image, a compressive sensing image, or a coded image. The processing circuit (a1) identifies a position of an object in the at least one computational image using a classification device, (a2) generates, using the at least one computational image, a display image in which an indication for highlighting the position of the object is superimposed, and (a3) outputs the display image.

Claims (68)

1. An image generation apparatus comprising:

a processing circuit; and

a memory storing at least one computational image,

wherein the at least one computational image is a light-field image, a compressive sensing image, or a coded image,

wherein the processing circuit

(a1) identifies a position of an object in the at least one computational image using a classification device,

(a2) generates, using the at least one computational image, a display image in which an indication for highlighting the position of the object is superimposed, and

(a3) outputs the display image,

wherein the processing circuit also

(a4) performs recovery on the at least one computational image to generate a recovery image, and

generates, in (a2), a display image by superimposing the indication for highlighting the position of the object upon the recovery image, and

wherein the processing circuit performs (a1) at higher speed than for (a4).

2. The image generation apparatus according to claim 1 ,

wherein the processing circuit also

(a4) performs recovery on the at least one computational image to generate a recovery image, and

generates, using the latest recovery image, after identifying the position of the object in the at least one computational image in (a2), a display image in which the indication for highlighting the position of the object is superimposed.

3. The image generation apparatus according to claim 2 ,

wherein the processing circuit simultaneously starts (a1) and (a4).

4. The image generation apparatus according to claim 1 ,

wherein the processing circuit also

(a5) generates, in the at least one computational image, a partial recovery image corresponding to the identified position of the object, and

generates, in (a2), the display image by superimposing the partial recovery image upon the at least one computational image.

5. An image generation apparatus comprising:

a processing circuit; and

a memory storing at least one computational image,

wherein the at least one computational image is a light-field image, a compressive sensing image, or a coded image,

wherein the processing circuit

(a1) identifies a position of an object in the at least one computational image using a classification device,

(a2) generates, using the at least one computational image, a display image in which an indication for highlighting the position of the object is superimposed, and

(a3) outputs the display image,

wherein the at least one computational image includes first and second images,

wherein the first and second images have been captured in this order, and

wherein the processing circuit

identifies, in (a1), a position of an object included in the first image and then identifies a position of an object included in the second image,

(a4) performs recovery on the first image to generate a first recovery image and then performs recovery on the second image to generate a second recovery image, and

obtains, if the first recovery image is generated but the second recovery image is not generated within a first certain period of time after the position of the object included in the second image is identified in (a1), a first capture time, at which the first image has been captured, and a second capture time, at which the second image has been captured, calculates a difference between the first and second capture times, and, if the difference is equal to or smaller than a first threshold, generates a display image by superimposing the position of the object included in the second image upon the first recovery image and, if the difference is larger than the first threshold, determines the first recovery image as the display image without superimposing the position of the object included in the second image upon the first recovery image.

6. The image generation apparatus according to claim 5 ,

wherein an image capturer that captures the at least one computational image is provided on a mobile object, and

wherein the processing circuit

obtains the at least one computational image from the image capturer and stores the at least one computational image in the memory, and

obtains, if the first recovery image has been generated but the second recovery image has not been generated when the position of the object included in the first image has been identified in (a1), moving speed of the mobile object at a time when the first and second images have been obtained and sets the first certain period of time on the basis of the moving speed.

7. The image generation apparatus according to claim 6 ,

wherein, if the moving speed is lower than a second threshold, the processing circuit does not change the first threshold, and if the moving speed is equal to or higher than the second threshold, the processing circuit shortens the first threshold on the basis of the moving speed.

8. An image generation apparatus comprising:

a processing circuit; and

a memory storing at least one computational image,

wherein the at least one computational image is a light-field image, a compressive sensing image, or a coded image,

wherein the processing circuit

(a1) identifies a position of an object in the at least one computational image using a classification device,

(a2) generates, using the at least one computational image, a display image in which an indication for highlighting the position of the object is superimposed, and

(a3) outputs the display image,

wherein an image capturer that captures the at least one computational image is provided on a mobile object, and

wherein the processing circuit

obtains the at least one computational image from the image capturer and stores the at least one computation image in the memory,

obtains moving speed of the mobile object, and

generates, if the moving speed is equal to or lower than a third threshold, a display image in which the indication for highlighting the position of the object is superimposed in (a2) using the at least one computational image and generates, if the moving speed is higher than the third threshold, an image based on the at least one computational image in which the position of the object is not highlighted in (a2) as a display image.

9. An image generation apparatus comprising:

a processing circuit; and

a memory storing at least one computational image,

wherein the at least one computational image is a light-field image, a compressive sensing image, or a coded image,

wherein the processing circuit

(a1) identifies a position of an object in the at least one computational image using a classification device,

(a2) generates, using the at least one computational image, a display image in which an indication for highlighting the position of the object is superimposed, and

(a3) outputs the display image, and

wherein the at least one computational image includes a first computational image and a second computational image,

the second computational image is imaged after the first computational image is imaged,

a positon of the indication in the display image is determined on the basis of a first position of the object in the first computational image, and

the position of the object in the display image is determined on the basis of a second position of the object in the second computational image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2019
From: SATO, SATOSHI; SAITO, MASAHIKO; AZUMA, TAKEO; NOBORI, KUNIO; WAKAI, NOBUHIKO
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 050821/0912 →
Priority Claims (1)
JP JP2017-175234 · Sep 12, 2017 · national
Continuity (2)
Continuation PCTJP2018029498 · Aug 7, 2018
Related Publication 20190279026A1 · Sep 12, 2019