IP Library › Granted Patent US 12,593,115
Granted Patent B2
US 12,593,115 · App. 18/359,856 · Granted Mar 31, 2026

Data processing apparatus, data processing method, data processing program, optical element, imaging optical system, and imaging apparatus to select suitable wavelength for object detection

Inventors: Yasunobu Kishine (Saitama, JP); Atsushi Kawanago (Saitama, JP); Kazuyoshi Okada (Saitama, JP); Yuya Hirakawa (Saitama, JP)
Assignee: FUJIFILM Corporation
H04N23/10G06V10/143G06V10/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,593,115
App. No.
18/359,856
Granted
Mar 31, 2026
Kind
B2
Abstract

A data processing apparatus includes a processor, in which the processor executes data acquisition processing of acquiring spectral data of a plurality of subjects, calculation processing of calculating intensity characteristics at a first wavelength and a second wavelength selected from wavelength ranges of the acquired spectral data of the plurality of subjects based on a relationship between two wavelengths which are the first wavelength and the second wavelength, data conversion processing of converting the intensity characteristics calculated in the calculation processing into discrimination data of a specific subject for the wavelength range, and output processing of outputting the discrimination data to an outside.

Claims (241)

1 . A data processing apparatus comprising:

a processor configured to execute

data acquisition processing of acquiring spectral data of a plurality of subjects,

calculation processing of calculating intensity characteristics at a first wavelength and a second wavelength selected from wavelength ranges of the acquired spectral data of the plurality of subjects based on a relationship between two wavelengths which are the first wavelength and the second wavelength,

data conversion processing of converting the intensity characteristics calculated in the calculation processing into discrimination data of a specific subject for the wavelength range, and

output processing of outputting the discrimination data to an outside,

wherein the intensity characteristic is an intensity difference, and is calculated according to the following expressions

the intensity difference=|[ A (λ1)− A (λ2)]−[ B (λ1)− B (λ2)]|

in a case in which spectral data of a first subject in the spectral data of the plurality of subjects is denoted by A(λ), spectral data of a second subject in the spectral data of the plurality of subjects is denoted by B(λ), and the first wavelength and the second wavelength, which are to be selected, are denoted by λ1 and λ2, respectively.

2 . The data processing apparatus according to claim 1 ,

wherein the discrimination data is a first map representing a change in the intensity characteristic with a wavelength as a variable.

3 . The data processing apparatus comprising:

a processor configured to execute

data acquisition processing of acquiring spectral data of a plurality of subjects,

calculation processing of calculating intensity characteristics at a first wavelength and a second wavelength selected from wavelength ranges of the acquired spectral data of the plurality of subjects based on a relationship between two wavelengths which are the first wavelength and the second wavelength,

data conversion processing of converting the intensity characteristics calculated in the calculation processing into discrimination data of a specific subject for the wavelength range, output processing of outputting the discrimination data to an outside,

wherein the discrimination data is a first map representing a change in the intensity characteristic with a wavelength as a variable, and

the first map is a two-dimensional map, and coordinate axes of the two-dimensional map are the first wavelength and the second wavelength,

receive a specific position on the first map displayed on the display device in response to a user indication,

specify a wavelength combination of the first wavelength and the second wavelength to be used for detection of a detection object among the plurality of subjects based on the specific position,

acquire a first image in a wavelength range including the first wavelength in the specified wavelength combination and a second image in a wavelength range including the second wavelength,

calculate a difference image between the first image and the second image, which are acquired, and

create a second map showing the calculated difference image.

4 . The data processing apparatus according to claim 3 ,

wherein a destination of the output of the discrimination data to the outside is a display device.

5 . The data processing apparatus according to claim 3 ,

wherein the processor executes

processing of extracting one or a plurality of positions on the first map at which the intensity characteristic exceeds a threshold value from the first map, and

processing of specifying one or a plurality of wavelength combinations of the first wavelength and the second wavelength to be used for detection of a detection object among the plurality of subjects based on the extracted positions.

6 . The data processing apparatus according to claim 5 ,

wherein a destination of the output of the discrimination data to the outside is a display device, and

the processor executes processing of displaying candidates for a specific position in the one or plurality of wavelength combinations of the first wavelength and the second wavelength in a superimposed manner on the first map displayed on the display device, processing of receiving the specific position from among the candidates for the specific position in response to a user indication, and processing of specifying the wavelength combination of the first wavelength and the second wavelength based on the received specific position.

7 . The data processing apparatus according to claim 3 ,

wherein the plurality of subjects include a first subject, a second subject, and a third subject,

in the data acquisition processing, spectral data of the first subject, spectral data of the second subject, and spectral data of the third subject are acquired,

in the calculation processing, two or more intensity characteristics, out of the intensity characteristics of the spectral data of the first subject and the spectral data of the second subject at the first wavelength and the second wavelength, the intensity characteristics of the spectral data of the second subject and each spectral data of the third subject at the first wavelength and the second wavelength, and the intensity characteristics of the spectral data of the first subject and the spectral data of the third subject at the first wavelength and the second wavelength, are calculated, and

in the data conversion processing, the two or more intensity characteristics are converted into two or more discrimination data.

8 . An optical element comprising:

a first wavelength selection element; and

a second wavelength selection element,

wherein the first wavelength selection element transmits a wavelength range of the first wavelength in the wavelength combination specified by the data processing apparatus according to claim 3 , and

the second wavelength selection element transmits a wavelength range of the second wavelength in the wavelength combination specified by the data processing apparatus according to claim 3 .

9 . An imaging optical system comprising:

the optical element according to claim 8 that is disposed at a pupil position or in a vicinity of the pupil position.

10 . An imaging apparatus comprising:

the imaging optical system according to claim 9 ; and

an imaging element that captures a first optical image transmitted through the first wavelength selection element and a second optical image transmitted through the second wavelength selection element, which are image-formed by the imaging optical system.

11 . A data processing method to be executed by a processor, comprising:

acquiring spectral data of a plurality of subjects;

calculating intensity characteristics at a first wavelength and a second wavelength selected from wavelength ranges of the acquired spectral data of the plurality of subjects based on a relationship between two wavelengths which are the first wavelength and the second wavelength;

converting the intensity characteristics calculated in the calculation step into discrimination data of a specific subject for the wavelength range; and

outputting the discrimination data to an outside,

wherein the intensity characteristic is an intensity difference, and is calculated according to the following expressions

the intensity difference=|[ A (λ1)− A (λ2)]−[ B (λ1)− B (λ2)]|

in a case in which spectral data of a first subject in the spectral data of the plurality of subjects is denoted by A(λ), spectral data of a second subject in the spectral data of the plurality of subjects is denoted by B(λ), and the first wavelength and the second wavelength, which are to be selected, are denoted by λ1 and λ2, respectively.

12 . The data processing method according to claim 11 ,

wherein the discrimination data is a first map representing a change in the intensity characteristic with a wavelength as a variable.

13 . A data processing method to be executed by a processor, comprising:

acquiring spectral data of a plurality of subjects;

calculating intensity characteristics at a first wavelength and a second wavelength selected from wavelength ranges of the acquired spectral data of the plurality of subjects based on a relationship between two wavelengths which are the first wavelength and the second wavelength;

converting the intensity characteristics calculated in the calculation step into discrimination data of a specific subject for the wavelength range; and

outputting the discrimination data to an outside,

wherein the discrimination data is a first map representing a change in the intensity characteristic with a wavelength as a variable, the first map is a two-dimensional map, and coordinate axes of the two-dimensional map are the first wavelength and the second wavelength,

receiving a specific position on the first map displayed on the display device in response to a user indication,

specifying a wavelength combination of the first wavelength and the second wavelength to be used for detection of a detection object among the plurality of subjects based on the specific position,

acquiring a first image in a wavelength range including the first wavelength in the specified wavelength combination and a second image in a wavelength range including the second wavelength,

calculating a difference image between the first image and the second image, which are acquired, and

creating a second map showing the calculated difference image.

14 . The data processing method according to claim 13 ,

wherein a destination of the output of the discrimination data to the outside is a display device.

15 . The data processing method according to claim 13 , further comprising:

extracting one or a plurality of positions on the first map at which the intensity characteristic exceeds a threshold value from the first map; and

specifying one or a plurality of wavelength combinations of the first wavelength and the second wavelength to be used for the detection of the detection object among the plurality of subjects based on the extracted positions.

16 . The data processing method according to claim 15 ,

wherein a destination of the output of the discrimination data to the outside is a display device, and

the data processing method further comprises:

displaying candidates for a specific position in the one or plurality of wavelength combinations of the first wavelength and the second wavelength in a superimposed manner on the first map displayed on the display device;

receiving the specific position from among the candidates for the specific position in response to a user indication; and

specifying the wavelength combination of the first wavelength and the second wavelength based on the received specific position.

17 . The data processing method according to claim 13 ,

wherein the plurality of subjects include a first subject, a second subject, and a third subject,

wherein spectral data of the first subject, spectral data of the second subject, and spectral data of the third subject are acquired,

wherein two or more intensity characteristics, out of the intensity characteristics of the spectral data of the first subject and the spectral data of the second subject at the first wavelength and the second wavelength, the intensity characteristics of the spectral data of the second subject and each spectral data of the third subject at the first wavelength and the second wavelength, and the intensity characteristics of the spectral data of the first subject and the spectral data of the third subject at the first wavelength and the second wavelength, are calculated, and

wherein the two or more intensity characteristics are converted into two or more discrimination data.

18 . A non-transitory computer-readable recording medium on which a program for causing, when read by a computer, the computer to execute the data processing method according to claim 13 is recorded.

19 . A data processing apparatus comprising:

a processor configured to execute

data acquisition processing of acquiring spectral data of a plurality of subjects,

calculation processing of calculating intensity characteristics at a first wavelength and a second wavelength selected from wavelength ranges of the acquired spectral data of the plurality of subjects based on a relationship between two wavelengths which are the first wavelength and the second wavelength,

data conversion processing of converting the intensity characteristics calculated in the calculation processing into discrimination data of a specific subject for the wavelength range, and

output processing of outputting the discrimination data to an outside,

wherein the intensity characteristic is an intensity difference or an intensity ratio, and is calculated by the following expressions

Intensity

⁢

difference

=

❘

"\[LeftBracketingBar]"

A

⁡

(

λ

⁢

1

)

-

A

⁡

(

λ

⁢

2

)

A

⁡

(

λ

⁢

1

)

+

A

⁡

(

λ

⁢

2

)

-

B

⁡

(

λ

⁢

1

)

-

B

⁡

(

λ

⁢

2

)

B

⁡

(

λ

⁢

1

)

+

B

⁡

(

λ

⁢

2

)

❘

"\[RightBracketingBar]"

[

Math

.

1

]

Intensity

⁢

ratio

=

❘

"\[LeftBracketingBar]"

A

⁡

(

λ

⁢

1

)

-

A

⁡

(

λ

⁢

2

)

A

⁡

(

λ

⁢

1

)

+

A

⁡

(

λ

⁢

2

)

/

B

⁡

(

λ

⁢

1

)

-

B

⁡

(

λ

⁢

2

)

B

⁡

(

λ

⁢

1

)

+

B

⁡

(

λ

⁢

2

)

❘

"\[RightBracketingBar]"

[

Math

.

2

]

in a case in which spectral data of a first subject in the spectral data of the plurality of subjects is denoted by A(λ), spectral data of a second subject in the spectral data of the plurality of subjects is denoted by B(λ), and the first wavelength and the second wavelength, which are to be selected, are denoted by λ1 and λ2, respectively.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2023
From: KISHINE, YASUNOBU; KAWANAGO, ATSUSHI; OKADA, KAZUYOSHI; HIRAKAWA, YUYA
To: FUJIFILM CORPORATION
Reel/Frame 064412/0352 →
Priority Claims (1)
JP 2021-013412 · Jan 29, 2021 · national
Continuity (2)
Continuation PCTJP2022002756 · Jan 26, 2022
Related Publication 20230370700A1 · Nov 16, 2023
References Cited (36)
US 5557414A · Allaire et al. · 1996 [cited by applicant]
US 7821670B2 · Nakaya et al. · 2010 [cited by applicant]
US 10379035B2 · Noda et al. · 2019 [cited by applicant]
US 10481095B2 · Dimitriadis et al. · 2019 [cited by applicant]
US 10684224B2 · Dimitriadis et al. · 2020 [cited by applicant]
US 11122242B2 · Ono · 2021 [cited by applicant]
US 11706506B2 · Okada et al. · 2023 [cited by applicant]
US 11877076B2 · Ono · 2024 [cited by applicant]
US 20140125988A1 · Wang · 2014 [cited by examiner]
US 20170343477A1 · Santori · 2017 [cited by examiner]
US 20210293622A1 · Klimek · 2021 [cited by examiner]
US 20210295042A1 · Takashima · 2021 [cited by examiner]
US 20220078319A1 · Okada et al. · 2022 [cited by applicant]
CN 101196720 · 2008 [cited by applicant]
CN 106999021 · 2017 [cited by applicant]
CN 111717440 · 2020 [cited by applicant]
EP 3716136 · 2020 [cited by applicant]
JP 2000249661 · 2000 [cited by applicant]
JP 2007178407 · 2007 [cited by applicant]
JP 2010117171 · 2010 [cited by applicant]
JP 2013258647 · 2013 [cited by applicant]
JP 2017053699 · 2017 [cited by applicant]
JP 2017053699A · 2017 [cited by examiner]
JP 2017064405 · 2017 [cited by applicant]
JP 2017064405A · 2017 [cited by examiner]
JP 2018125770 · 2018 [cited by applicant]
WO 2017168469 · 2017 [cited by applicant]
WO 2020075523 · 2020 [cited by applicant]
WO 2020110595 · 2020 [cited by applicant]
WO 2020250774 · 2020 [cited by applicant]
“Partial Search Report of Europe Counterpart Application”, issued on Jun. 5, 2024, pp. 1-11. [cited by applicant]
“International Search Report (Form PCT/ISA/210) of PCT/JP2022/002756”, mailed on Mar. 22, 2022, with English translation thereof, pp. 1-5. [cited by applicant]
“Written Opinion of the International Searching Authority (Form PCT/ISA/237) of PCT/JP2022/002756”, mailed on Mar. 22, 2022, with English translation thereof, pp. 1-9. [cited by applicant]
“Search Report of Europe Counterpart Application”, issued on Jun. 26, 2024, pp. 1-11. [cited by applicant]
“Notice of Reasons for Refusal of Japan Counterpart Application”, issued on Sep. 25, 2025, with English translation thereof, p. 1-p. 13. [cited by applicant]
“Office Action of China Counterpart Application”, issued on Jan. 14, 2026, with English translation thereof, pp. 1-12. [cited by applicant]