IP Library › Granted Patent US 12,354,321
Granted Patent B2
US 12,354,321 · App. 17/588,948 · Granted Jul 8, 2025

Data processing device, data processing method, and data processing program for evaluation an object based on a persistence diagram from time-series image data

Inventors: Masakazu Yamagiwa (Yokohama, JP); Yasutaka Nishida (Tama, JP); Akiko Hirao (Kawasaki, JP)
Assignees: KABUSHIKI KAISHA TOSHIBA; TOSHIBA INFRASTRUCTURE SYSTEMS & SOLUTIONS CORPORATION
G06V10/62G06V10/426G06V10/56G06V10/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,354,321
App. No.
17/588,948
Granted
Jul 8, 2025
Kind
B2
Abstract

According to one embodiment, a data processing device includes an acquisition part, and a processor. The acquisition part is configured to acquire first data including time-series image data. The processor is configured to derive first feature information based on a multidimensional array of n dimensions based on the first data acquired by the acquisition part. n is an integer not less than 3. A first axis of the multidimensional array is related to time.

Claims (62)

1. A data processing device, comprising:

processing circuitry configured to:

acquire first data including time-series image data, wherein the first data corresponds to a temporal change of an arc of a circuit interrupter;

derive first feature information based on a multidimensional array of n dimensions based on the first data; and

control the circuit interrupter by supplying a control signal to the circuit interrupter based on the first feature information, wherein,

n is an integer not less than 3,

a first axis of the multidimensional array is related to time,

a second axis of the multidimensional array is related to a first coordinate value of a first spatial axis in space,

a third axis of the multidimensional array is related to a second coordinate value of a second spatial axis in the space, the second spatial axis crosses the first spatial axis,

a fourth axis of the multidimensional array is related to a chromaticity coordinate value,

the first feature information includes a plurality of persistent feature values in a persistence diagram,

a time of one of the plurality of persistent feature values is different from a time of another one of the plurality of persistent feature values, and

the persistence diagram corresponds to a dispersion state of at least a portion of the first data, and is derived based on values of the multidimensional array.

2. The data processing device according to claim 1 , wherein

the time-series image data includes a value related to a brightness at a position corresponding to the first and second coordinate values.

3. The data processing device according to claim 1 , wherein

the time-series image data includes a value related to a color at the position corresponding to the first and second coordinate values.

4. The data processing device according to claim 1 , wherein

the first data is subdivided into a plurality of periods, and

the persistence diagram corresponds to one of the plurality of periods.

5. The data processing device according to claim 1 , wherein

the persistence diagram includes zero-dimensional persistence.

6. The data processing device according to claim 1 , wherein

the first feature information includes a feature vector obtained by converting the persistent feature value.

7. The data processing device according to claim 1 , wherein

the processing circuitry is further configured to output the first feature information for the first data based on a result of comparing the persistent feature value and a first reference value related to the persistent feature value.

8. The data processing device according to claim 1 , wherein

the processing circuitry is further configured to extract a characteristic portion of the first data based on machine learning, and

the machine learning has the first feature information as an input.

9. The data processing device according to claim 1 , wherein

the data processing device is configured to supply a control signal to an object device based on the first feature information, and

the first data is related to the object device.

10. A data processing method, comprising:

acquiring first data including time-series image data, wherein the first data corresponds to a temporal change of an arc of a circuit interrupter;

deriving first feature information based on a multidimensional array of n dimensions based on the first data; and

controlling the circuit interrupter by supplying a control signal to the circuit interrupter based on the first feature information, wherein

n is an integer not less than 3,

a first axis of the multidimensional array is related to time,

a second axis of the multidimensional array is related to a first coordinate value of a first spatial axis in space,

a third axis of the multidimensional array is related to a second coordinate value of a second spatial axis in the space, the second spatial axis crosses the first spatial axis,

a fourth axis of the multidimensional array is related to a chromaticity coordinate value,

the first feature information includes a plurality of persistent feature values in a persistence diagram,

a time of one of the plurality of persistent feature values is different from a time of another one of the plurality of persistent feature values, and

the persistence diagram corresponds to a dispersion state of at least a portion of the first data, and is derived based on values of the multidimensional array.

11. The data processing method according to claim 10 , wherein

the time-series image data includes a value related to a brightness at a position corresponding to the first and second coordinate values.

12. The data processing method according to claim 10 , wherein

the time-series image data includes a value related to a color at the position corresponding to the first and second coordinate values.

13. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a device, cause the device to:

acquire first data including time-series image data, wherein the first data corresponds to a temporal change of an arc of a circuit interrupter;

derive first feature information based on a multidimensional array of n dimensions based on the first data; and

control the circuit interrupter by supplying a control signal to the circuit interrupter based on the first feature information, wherein

n is an integer not less than 3,

a first axis of the multidimensional array is related to time,

a second axis of the multidimensional array is related to a first coordinate value of a first spatial axis in space,

a third axis of the multidimensional array is related to a second coordinate value of a second spatial axis in the space, the second spatial axis crosses the first spatial axis,

a fourth axis of the multidimensional array is related to a chromaticity coordinate value,

the first feature information includes a plurality of persistent feature values in a persistence diagram,

a time of one of the plurality of persistent feature values is different from a time of another one of the plurality of persistent feature values, and

the persistence diagram corresponds to a dispersion state of at least a portion of the first data, and is derived based on values of the multidimensional array.

14. The non-transitory computer-readable medium according to claim 13 , wherein

the time-series image data includes a value related to a brightness at a position corresponding to the first and second coordinate values.

Assignments (2)
MERGER Recorded Jul 18, 2025
From: TOSHIBA INFRASTRUCTURE SYSTEMS & SOLUTIONS CORPORATION
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 072053/0393 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: YAMAGIWA, MASAKAZU; NISHIDA, YASUTAKA; HIRAO, AKIKO
To: KABUSHIKI KAISHA TOSHIBA; TOSHIBA INFRASTRUCTURE SYSTEMS & SOLUTIONS CORPORATION
Reel/Frame 058832/0334 →
Priority Claims (1)
JP 2021-147412 · Sep 10, 2021 · national
Continuity (1)
Related Publication 20230078877A1 · Mar 16, 2023
References Cited (14)
US 9430688B1 · Ray · 2016 [cited by examiner]
US 10333958B2 · Huang · 2019 [cited by examiner]
US 20190304568A1 · Wei · 2019 [cited by examiner]
US 20190388064A1 · Kezurer · 2019 [cited by examiner]
US 20200184353A1 · Tsunoda et al. · 2020 [cited by applicant]
US 20220101105A1 · Mezghanni · 2022 [cited by examiner]
US 20220262040A1 · Kanda · 2022 [cited by examiner]
US 20220392164A1 · Ike · 2022 [cited by examiner]
JP 202091756A · 2020 [cited by applicant]
WO WO2021219852A1 · 2021 [cited by examiner]
WO WO2022182603A1 · 2022 [cited by examiner]
Umeda, Y., “Time Series Classification via Topological Data Analysis,” (2017), 12 pages. [cited by applicant]
Office Action mailed Sep. 17, 2024 in Japanese Application No. 2021-147412 filed Sep. 10, 2021 (w/English machine translation). [cited by applicant]
Takaya Kimura, et al., “Video Watermarking Using Difference of Persistent Homology in Consecutive Frames”, vol. 119, No. 145, Jul. 16, 2019 (w/English machine translation). [cited by applicant]