IP Library Granted Patent US 11,195,042
Granted Patent B2
US 11,195,042 · App. 16/744,661 · Granted Dec 7, 2021

Drug inspection assistance device, drug identification device, image processing device, image processing method, and program

Inventor: Kazuchika Iwami (Ashigarakami-gun, JP)
Assignee: FUJIFILM Toyama Chemical Co., Ltd.
G06K9/44A61J3/007G06K9/4604G06T7/13G16H70/40G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,195,042
App. No.
16/744,661
Granted
Dec 7, 2021
Kind
B2
Abstract

A image processing device which can reduce information such as a pattern, a scar and the like on a surface of a drug which are other than an engraved mark, to accurately extract the engraved mark. The image processing device includes: an obtaining unit configured to obtain a plurality of images of a drug having an engraved mark on a surface of the drug, with emitting directions of light to the surface different from each other; an edge image generating unit configured to apply respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a size in conformity with a width of a groove of the engraved mark, and generate a plurality of edge images; and an image composing unit configured to compose the plurality of edge images and generate a composite image.

Claims (57)

1. An image processing device, comprising:

an obtaining unit configured to obtain a plurality of images of a drug having an engraved mark on a surface of the drug, with emitting directions of light to the surface different from each other;

an edge image generating unit configured to apply respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a larger size than half a width of a groove of the engraved mark, and generate a plurality of edge images; and

an image composing unit configured to compose the plurality of edge images and generate a composite image.

2. The image processing device according to claim 1 , wherein the directions in conformity with the emitting directions include a direction of an emitting direction in plan view of the surface.

3. The image processing device according to claim 2 , wherein the directions in conformity with the emitting directions include a direction inclined by 45 degrees from the direction of the emitting direction in plan view of the surface, and a direction inclined by −45 degrees from the direction of the emitting direction in plan view of the surface.

4. The image processing device according to claim 3 ,

wherein the obtaining unit obtains four images of the drug, with the emitting directions of light to the surface being a first direction, a second direction, a third direction and a fourth direction, and

the second direction is a direction opposite to the first direction in plan view of the surface, the third direction is a direction orthogonal to the first direction in plan view of the surface, and the fourth direction is a direction opposite to the third direction in plan view of the surface.

5. A drug identification device, comprising:

a stage configured to place a drug thereon, the drug having an engraved mark on a surface of the drug;

an irradiating unit configured to include a plurality of light sources with emitting directions of light to the surface different from each other;

an imaging unit configured to obtain a plurality of images taken by imaging the drug with the surface irradiated with light by the light sources;

an edge image generating unit configured to apply respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a larger size than half a width of a groove of the engraved mark, and generate a plurality of edge images; and

an image composing unit configured to compose the plurality of edge images and generate a composite image.

6. A drug identification device comprising:

a stage configured to place a drug thereon, the drug having an engraved mark on a surface of the drug;

an irradiating unit configured to include a plurality of light sources with emitting directions of light to the surface different from each other;

an imaging unit configured to obtain a plurality of images taken by imaging the drug with the surface irradiated with light by the light sources;

an edge image generating unit configured to apply respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a size in conformity with a width of a groove of the engraved mark, and generate a plurality of edge images; and

an image composing unit configured to compose the plurality of edge images and generate a composite image,

wherein the irradiating unit comprises a first light source configured to emit light in a first direction, a second light source configured to emit light in a second direction, a third light source configured to emit light in a third direction, and a fourth light source configured to emit light in a fourth direction, and

the second direction is a direction opposite to the first direction in plan view of the surface, the third direction is a direction orthogonal to the first direction in plan view of the surface, and the fourth direction is a direction opposite to the third direction in plan view of the surface.

7. The drug identification device according to claim 6 ,

wherein the irradiating unit comprises a fifth light source configured to emit light in a fifth direction, a sixth light source configured to emit light in a sixth direction, a seventh light source configured to emit light in a seventh direction, and an eighth light source configured to emit light in an eighth direction,

the sixth direction is a direction opposite to the fifth direction in plan view of the surface, the seventh direction is a direction orthogonal to the fifth direction in plan view of the surface and the eighth direction is a direction opposite to the seventh direction in plan view of the surface,

the stage is made of a material having a light transparency,

the first light source, the second light source, the third light source and the fourth light source are disposed on one surface side of the stage, and

the fifth light source, the sixth light source, the seventh light source and the eighth light source are disposed on another surface side of the stage, the another surface side being different from the one surface side.

8. The drug identification device according to claim 6 , wherein the edge image generating unit applies the edge extracting filters having a larger size than half the width of the groove of the engraved mark, to generate the plurality of edge images.

9. An image processing method, comprising:

an obtaining step of obtaining a plurality of images of a drug having an engraved mark on a surface of the drug, with emitting directions of light to the surface different from each other;

an edge image generating step of applying respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a larger size than half a width of a groove of the engraved mark, to generate a plurality of edge images; and

an image composing step of composing the plurality of edge images to generate a composite image.

10. A non-transitory computer-readable recording medium wherein when an instruction stored in the recording medium is read by a computer, the instruction causes the computer to execute:

an obtaining function of obtaining a plurality of images of a drug having an engraved mark on a surface of the drug, with emitting directions of light to the surface different from each other;

an edge image generating function of respectively applying to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a larger size than half a width of a groove of the engraved mark, to generate a plurality of edge images; and

an image composing function of composing the plurality of edge images to generate a composite image.

11. An drug inspection assistance device which inspects a drug, comprising:

an obtaining unit configured to obtain a plurality of images of a drug having an engraved mark on a surface of the drug, with emitting directions of light to the surface different from each other;

an edge image generating unit configured to apply respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a larger size than half a width of a groove of the engraved mark, and generate a plurality of edge images;

an image composing unit configured to compose the plurality of edge images and generate a composite image;

a display image generating unit configured to generate, as a display image where the engraved mark is enhanced, a difference image obtained by subtracting, from the composite image, a drug area image corresponding to the composite image;

a drug discriminating unit configured to collate drug master images of drugs from a drug database including drug master images, with taken images obtained by imaging drugs to be inspected, and discriminate which drugs the drugs present in the taken images are; and

a list creating unit configured to create a list table of the drugs to be inspected, the list table representing drug master images of the drugs and the difference image, with positions of the drug master images being aligned to positions of the difference image, and engraved mark portions or printed character portions being enhanced.

12. An image processing device, comprising:

an obtaining unit configured to obtain a plurality of images of a drug having an engraved mark on a surface of the drug, with emitting directions of light to the surface different from each other;

an edge image generating unit configured to apply respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a size in conformity with a width of a groove of the engraved mark, and generate a plurality of edge images; and

an image composing unit configured to compose the plurality of edge images and generate a composite image,

wherein the directions in conformity with the emitting directions include a direction of an emitting direction in plan view of the surface, and further include a direction inclined by 45 degrees from the direction of the emitting direction in plan view of the surface, and a direction inclined by −45 degrees from the direction of the emitting direction in plan view of the surface.

13. An image processing device, comprising

an obtaining unit configured to obtain a plurality of images of a drug having an engraved mark on a surface of the drug, with emitting directions of light to the surface different from each other;

an edge image generating unit configured to apply respectively to the plurality of images, edge extracting filters in directions in conformity with the emitting directions, the edge extracting filters having a size in conformity with a width of a groove of the engraved mark, and generate a plurality of edge images; and

an image composing unit configured to compose the plurality of edge images and generate a composite image,

wherein the obtaining unit obtains four images of the drug, with the emitting directions of light to the surface being a first direction, a second direction, a third direction and a fourth direction, and

the second direction is a direction opposite to the first direction in plan view of the surface, the third direction is a direction orthogonal to the first direction in plan view of the surface, and the fourth direction is a direction opposite to the third direction in plan view of the surface.

14. The image processing device according to claim 13 , wherein the edge image generating unit applies the edge extracting filters having a larger size than half the width of the groove of the engraved mark, to generate the plurality of edge images.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Sep 11, 2024
From: FUJIFILM TOYAMA CHEMICAL CO., LTD.
To: FUJIFILM MEDICAL CO., LTD.
Reel/Frame 068552/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2020
From: IWAMI, KAZUCHIKA
To: FUJIFILM TOYAMA CHEMICAL CO., LTD.
Reel/Frame 051537/0634 →
Priority Claims (1)
JP JP2017-159559 · Aug 22, 2017 · national
Continuity (2)
Continuation PCTJP2018029925 · Aug 9, 2018
Related Publication 20200151490A1 · May 14, 2020
Cited By (1)
US 12,728,074