IP Library Granted Patent US 11,538,245
Granted Patent B2
US 11,538,245 · App. 16/841,393 · Granted Dec 27, 2022

Moving and still image method, device, and recording medium

Inventor: Kei Yamaji (Tokyo, JP)
Assignee: FUJIFILM Corporation
G06V20/46G06V40/10G06V40/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,538,245
App. No.
16/841,393
Granted
Dec 27, 2022
Kind
B2
Abstract

In the image processing device, the method and the recording medium according to the present invention, the characteristic information extractor extracts the number of times the same subject appears in the still images. The target object detector detects the target subject which appears the number of times not less than the threshold value. The image analysis condition determiner sets the image analysis condition for the portion of the moving image where the target subject is absent to be rougher than that where the target subject is present. The frame image analyzer extracts frame images from the moving image in accordance with the image analysis condition. The frame image output section calculates the evaluation value of the frame images based on the result of the image analysis and output the frame image having the evaluation value not less than the threshold value.

Claims (49)

1. An image processing device comprising a processor, wherein the processor:

acquires a moving image and a plurality of still images which are shot individually separately from the moving image;

extracts characteristic information from the plurality of still images;

sets a first image evaluation condition for one portion of the moving image relating to the characteristic information to be lower than a second image evaluation condition for another portion of the moving image based on the characteristic information;

evaluates frame images included in the one portion of the moving image in accordance with the first image evaluation condition, and evaluates frame images included in the another portion of the moving image in accordance with the second image evaluation condition; and

outputs, of frame images included in the moving image, a frame image having an evaluation value not less than a first threshold value, and

wherein the processor sets an evaluation value for a frame image having been shot at a time that is included in a same time range as a time range including a shooting time when at least one still image which is included in the plurality of still images was shot, to be lower than an evaluation value for a frame image having been shot at a time that is not included in the same time range.

2. The image processing device according to claim 1 , wherein

the one portion of the moving image has a relevance score with the plurality of still images not lower than a second threshold value and the another portion of the moving image has a relevance score with the plurality of still images lower than the second threshold value.

3. The image processing device according to claim 1 , wherein

a time range, including a shooting time when at least one still image included in the plurality of still images was shot as the characteristic information, is extracted from the plurality of still images, and

the first image evaluation condition for the frame images included in one portion of the moving image having been shot at a time included in the time range relating to the characteristic information is set to be lower than the second image evaluation condition for the frame images included in another portion of the moving image based on the characteristic information.

4. The image processing device according to claim 3 , wherein

the time range is a time range including all shooting times of the plurality of still images.

5. The image processing device according to claim 3 , wherein

the processor sets an evaluation value for a frame image having been shot at a time included in a same time range as the time range, to be lower than an evaluation value for a frame image having been shot at a time that is not included in the same time range.

6. The image processing device according to claim 3 , wherein

the processor sets an evaluation value for a frame image having been shot at a same time as a shooting time of at least one still image which is included in the plurality of still images, to be lower than an evaluation value for a frame image having been shot at a time that is different from the shooting time, and is included in the time range.

7. The image processing device according to claim 3 , wherein

the one portion of the moving image has a relevance score with the plurality of still images not lower than a second threshold value and the another portion of the moving image has a relevance score with the plurality of still images lower than the second threshold value.

8. An image processing device comprising a processor, wherein the processor:

acquires a moving image and a plurality of still images which are shot individually separately from the moving image;

extracts characteristic information from the plurality of still images;

sets a first image evaluation condition for one portion of the moving image relating to the characteristic information to be lower than a second image evaluation condition for another portion of the moving image based on the characteristic information;

evaluates frame images included in the one portion of the moving image in accordance with the first image evaluation condition, and evaluates frame images included in the another portion of the moving image in accordance with the second image evaluation condition; and

outputs, of frame images included in the moving image, a frame image having an evaluation value not less than a first threshold value, and

wherein the processor sets an evaluation value for a frame image having been shot at a same time as a shooting time when at least one still image that is included in the plurality of still images was shot, to be lower than an evaluation value for a frame image having been shot at a time that is not the shooting time, and is included in a time range including the shooting time.

9. An image processing method comprising:

acquiring a moving image and a plurality of still images which are shot individually separately from the moving image, with an image acquiring section;

extracting characteristic information from the plurality of still images, with a characteristic information extractor;

setting a first image evaluation condition for one portion of the moving image relating to the characteristic information to be lower than a second image evaluation condition for another portion of the moving image based on the characteristic information, with an image evaluation condition determiner;

evaluating frame images included in the one portion of the moving image in accordance with the first image evaluation condition, and evaluating frame images included in the another portion of the moving image in accordance with the second image evaluation condition, with a frame image evaluation section; and

outputting, of frame images included in the moving image, a frame image having an evaluation value not less than a first threshold value, with a frame image output section, and

wherein the processor sets an evaluation value for a frame image having been shot at a time that is included in a same time range as a time range including a shooting time when at least one still image which is included in the plurality of still images was shot, to be lower than an evaluation value for a frame image having been shot at a time that is not included in the same time range.

10. The image processing method according to claim 9 , wherein

the one portion of the moving image has a relevance score with the plurality of still images not lower than a second threshold value and the another portion of the moving image has a relevance score with the plurality of still images lower than the second threshold value.

11. The image processing method according to claim 9 , wherein

the extracting step extracts a time range, including a shooting time when at least one still image included in the plurality of still images was shot as the characteristic information from the plurality of still images, with the characteristic information extractor, and

the setting step sets the first image evaluation condition for the frame images included in one portion of the moving image having been shot at a time included in the time range relating to the characteristic information to be lower than the second image evaluation condition for the frame images included in another portion of the moving image based on the characteristic information, with the image evaluation condition determiner.

12. The image processing method according to claim 11 , wherein

the one portion of the moving image has a relevance score with the plurality of still images not lower than a second threshold value and the another portion of the moving image has a relevance score with the plurality of still images lower than the second threshold value.

13. An image processing method comprising:

acquiring a moving image and a plurality of still images which are shot individually separately from the moving image, with an image acquiring section;

extracting characteristic information from the plurality of still images, with a characteristic information extractor;

setting a first image evaluation condition for one portion of the moving image relating to the characteristic information to be lower than a second image evaluation condition for another portion of the moving image based on the characteristic information, with an image evaluation condition determiner;

evaluating frame images included in the one portion of the moving image in accordance with the first image evaluation condition, and evaluating frame images included in the another portion of the moving image in accordance with the second image evaluation condition, with a frame image evaluation section; and

outputting, of frame images included in the moving image, a frame image having an evaluation value not less than a first threshold value, with a frame image output section, and

wherein the processor sets an evaluation value for a frame image having been shot at a same time as a shooting time when at least one still image that is included in the plurality of still images was shot, to be lower than an evaluation value for a frame image having been shot at a time that is not the shooting time, and is included in a time range including the shooting time.

14. A non-transitory computer readable recording medium having recorded thereon a program for causing a computer to execute each step of the image processing method according to claim 9 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2020
From: YAMAJI, KEI
To: FUJIFILM CORPORATION
Reel/Frame 052324/0068 →
Priority Claims (1)
JP 2015-107009 · May 27, 2015 · national
Continuity (3)
Division 15874420 · Jan 18, 2018
Division 15150452 · May 10, 2016
Related Publication 20200234053A1 · Jul 23, 2020