IP Library › Granted Patent US 12,738,023
Granted Patent B2
US 12,738,023 · App. 18/580,712 · Granted Sep 15, 2026

Image classification device and image classification method

Inventors: Sota Komatsu (Tokyo, JP); Masayoshi Ishikawa (Tokyo, JP); Fumihiro Bekku (Tokyo, JP)
Assignee: Hitachi High-Tech Corporation
G06V10/764G06T3/40G06V10/44G06V10/762G06V10/771
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,738,023
App. No.
18/580,712
Granted
Sep 15, 2026
Kind
B2
Abstract

Provided are an image classification device and method that are capable of extracting and mapping an important feature in an image. The image classification device includes: a feature extraction unit 101 that generates a first image group generated by applying different noises to the same image among images included in an image group and a second image group including different images, is trained such that features obtained from the first image group are approximate, is trained such that features obtained from the second image group are more different, and extracts features; a feature mapping unit 102 that maps the extracted plurality of features two-dimensionally or three-dimensionally using manifold learning; and a display unit 103 that displays a mapping result and constructs a training information application task screen.

Claims (26)

1 . An image classification device for performing image classification, the image classification device comprising:

a feature extraction unit that generates a first image group generated by applying different noises to the same image among images included in an image group and a second image group including different images, that is trained such that features obtained from the first image group are approximate, that is trained such that features obtained from the second image group are more different, and that extracts features;

a feature mapping unit that maps the extracted plurality of features two-dimensionally or three-dimensionally using manifold learning; and

a display unit that displays a training information application task screen on which a mapping result is displayed and a training information application task is performed.

2 . The image classification device according to claim 1 , wherein

the feature extraction unit includes a dimension reduction unit that is trained using training information in order to avoid deterioration in mapping accuracy due to the manifold learning when the number of dimensions of the extracted features is large.

3 . The image classification device according to claim 1 , wherein

on the training information application task screen, a plurality of features included in a specified region are remapped and displayed.

4 . The image classification device according to claim 1 , wherein

on the training information application task screen, a feature having a long distance from a neighboring point among the mapped plurality of features is emphasized and displayed.

5 . The image classification device according to claim 1 , wherein

on the training information application task screen, a region in which a distribution density of features among the mapped plurality of features is high is emphasized and displayed.

6 . The image classification device according to claim 1 , wherein

on the training information application task screen, image thumbnails are displayed at positions where the plurality of features are mapped.

7 . The image classification device according to claim 1 , wherein

on the training information application task screen, training information is to be applied to the mapped plurality of features at once by selecting a region on a map.

8 . The image classification device according to claim 1 , wherein

on the training information application task screen, a clustering result of the plurality of features output by the feature extraction unit and a clustering result using two-dimensional coordinates or three-dimensional coordinates output by the feature mapping unit are compared, and a region to be remapped is displayed when the results are different.

9 . An image classification method for performing image classification, the image classification method comprising:

generating a first image group generated by applying different noises to the same image among images included in an image group and a second image group including different images, performing training such that features obtained from the first image group are approximate, performing training such that features obtained from the second image group are more different, and extracting features;

mapping the extracted plurality of features two-dimensionally or three-dimensionally using manifold learning; and

displaying a mapping result on a training information application task screen.

10 . The image classification method according to claim 9 , wherein

dimensions are reduced and output in order to avoid deterioration in mapping accuracy due to the manifold learning when the number of dimensions of the extracted features is large.

11 . The image classification method according to claim 9 , wherein

on the training information application task screen, a clustering result of the plurality of features and a clustering result using two-dimensional coordinates or three-dimensional coordinates are compared, and a region to be remapped is displayed when the results are different.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2024
From: KOMATSU, SOTA; ISHIKAWA, MASAYOSHI; BEKKU, FUMIHIRO
To: HITACHI HIGH-TECH CORPORATION
Reel/Frame 066180/0923 →
Continuity (1)
Related Publication 20240362892A1 · Oct 31, 2024
References Cited (34)
US 8675974B2 · Iio · 2014 [cited by examiner]
US 9990687B1 · Kaufhold · 2018 [cited by examiner]
US 10984075B1 · Liang · 2021 [cited by examiner]
US 20100329529A1 · Feldman · 2010 [cited by examiner]
US 20110158535A1 · Iio · 2011 [cited by examiner]
US 20140037172A1 · Madabhushi · 2014 [cited by examiner]
US 20160132754A1 · Akhbardeh · 2016 [cited by examiner]
US 20170256068A1 · Wang · 2017 [cited by examiner]
US 20200050825A1 · Mendoza-Schrock · 2020 [cited by examiner]
US 20200380338A1 · Matsumura · 2020 [cited by examiner]
US 20210042575A1 · Firner · 2021 [cited by examiner]
US 20210124993A1 · Singh · 2021 [cited by examiner]
US 20210124999A1 · Dia · 2021 [cited by examiner]
US 20210158104A1 · Wu · 2021 [cited by examiner]
US 20210166052A1 · Park · 2021 [cited by examiner]
US 20210201145A1 · Pham · 2021 [cited by examiner]
US 20210334706A1 · Yamaguchi et al. · 2021 [cited by applicant]
US 20220051402A1 · Dikici · 2022 [cited by examiner]
US 20230306761A1 · Sirbulescu · 2023 [cited by examiner]
US 20250118057A1 · Daylac et al. · 2025 [cited by applicant]
JP 2014229115A · 2014 [cited by applicant]
JP 201966993A · 2019 [cited by applicant]
JP 202034998A · 2020 [cited by applicant]
KR 1020180118596A · 2018 [cited by applicant]
International Search Report (PCT/ISA/210) issued in PCT Application No. PCT/JP2021/028252 dated Nov. 2, 2021 with English translation (4 pages). [cited by applicant]
Japanese-language Written Opinion (PCT/ISA/237) issued in PCT Application No. PCT/JP2021/028252 dated Nov. 2, 2021 with English translation (5 pages). [cited by applicant]
Simard, P. Y. et al.; “Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis”, Proceedings of the Seventh International Conference on Document Analysis and Recognition (ICDAR'03), Sep. 8, … [cited by applicant]
Korean-language Office Action issued in Korean Application No. 10-2023-7044265 dated Feb. 11, 2026, with English translation (22 pages). [cited by applicant]
Chen, T. et al.; “A Simple Framework for Contrastive Learning of Visual Representations”, Proceedings of the 37th International Conference on Machine Learning, PMLR 119, Jul. 2020 (20 pages). [cited by applicant]
Chatzimparmpas, A. et al.; “t-viSNE: Interactive Assessment and Interpretation of t-SNE Projections”, IEEE Transactions on Visualization and Computer Graphics, Aug. 2020, pp. 2696-2714, vol. 26, No. 8 (19 pages). [cited by applicant]
Kandogan, E.; “Just-in-Time Annotation of Clusters, Outliers, and Trends in Point-based Data Visualizations”, IEEE Symposium on Visual Analytics Science and Technology, 2012, pp. 73-82 (10 pages). [cited by applicant]
Francois Luus et al., “Active Learning with TensorBoard Projector”, ArViv: 1901.00675v1, Jan. 3, 2019, pp. 1-7 ( 7 pages). [cited by applicant]
Laurens van der Maaten et al., “Visualizing Data using t-SNE”, Journal of Machine Learning Research, Nov. 8, 2008, pp. 1-25, (25 pages). [cited by applicant]
Chinese Office Action application No. 202180100164.X, dated May 29, 2026 with English Translation (15 pages). [cited by applicant]