IP Library › Granted Patent US 12,253,494
Granted Patent B2
US 12,253,494 · App. 17/297,842 · Granted Mar 18, 2025

Information processing apparatus, information processing method, learned model generation method, and program

Inventors: Hiroaki Matsuoka (Tokyo, JP); Noriaki Koide (Tokyo, JP); Yusuke Kosuda (Tokyo, JP)
Assignee: REVORN CO., LTD.
G01N29/022G01N29/4454G01N29/4472G06N20/00G01N2291/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,253,494
App. No.
17/297,842
Granted
Mar 18, 2025
Kind
B2
Abstract

An information processing apparatus includes: a first acquisition unit that acquires odor data obtained by measuring the odor of an object; a second acquisition unit that acquires an acquisition condition for the odor data; and an identification unit that identifies the object from the odor data and the acquisition condition acquired by the first and second acquisition units on the basis of a learned model obtained by performing learning on the odor data of the object and the acquisition condition, and on the object corresponding to the odor data. The acquisition condition can be text data that indicates the category of the odor and is inputted by a user who has measured the odor.

Claims (64)

1. An information processing apparatus, comprising:

a controller configured to execute a program so as to:

acquire target odor data measuring an odor of a target object via an odor sensor using a quartz crystal, the target odor data corresponding to time-series data of frequencies, the frequencies being measured while the odor of the target object is in an inner space of the odor sensor for a predetermined period of time;

acquire a target acquisition condition of the target odor data, the target acquisition condition including environmental information regarding a measurement environment in which the odor of the target object is measured, the environmental information including location information or weather information of the measurement environment;

store data of a plurality of learned models obtained by learning sample odor data and a sample acquisition condition including the location information or the weather information with respect to a plurality of different sample objects, and each of the plurality of learned models having:

an input layer accepting the sample odor data as the time-series data of the frequencies together with the sample acquisition condition in association with the plurality of different sample objects;

an intermediate layer extracting of a plurality of sample features of the sample odor data from the input layer in association with the plurality of different sample objects; and

an output layer providing an identification result based on the plurality of different sample features;

receive an operation input from a user via an operation interface to select a target model of the plurality of learned models;

input the target odor data as the time-series data of the frequencies together with the target acquisition condition into the input layer of the target model;

cause the intermediate layer of the target model to extract a target feature of the target odor data;

cause the output layer of the target model to provide a target identification result based on the target feature and the plurality of sample features of the target model;

identify the target object based on the target identification result; and

display information relating to the identified target object,

wherein the target identification result corresponds to a probability value indicating how likely the target object corresponds to one of the plurality of different sample objects.

2. The information processing apparatus in claim 1 , wherein:

each of the target and sample acquisition conditions includes text data indicating a category of the odor, and the text data is input via the operation interface by a measurement user who measures the odor.

3. The information processing apparatus in claim 1 , wherein:

each of the target and sample acquisition conditions includes state information indicating a state of the odor sensor when measuring the odor.

4. The information processing apparatus in claim 1 , wherein:

the target identification result includes information indicating whether the target object corresponding to the target odor data corresponds to one of the plurality of different sample objects.

5. The information processing apparatus in claim 1 , wherein:

the information processing apparatus is configured to be connected to a terminal of the user, and

the operation input is received from the terminal.

6. An information processing method for causing a processor to execute a program, the information processing method comprising executing on the processor the steps of:

acquiring target odor data measuring an odor of a target object via an odor sensor using a quartz crystal, the target odor data corresponding to time-series data of frequencies, the frequencies being measured while the odor of the target object is in an inner space of the odor sensor for a predetermined period of time;

acquiring a target acquisition condition of the target odor data, the target acquisition condition including environmental information regarding a measurement environment in which the odor of the target object is measured, the environmental information including location information or weather information of the measurement environment;

storing data of a plurality of learned models obtained by learning sample odor data and a sample acquisition condition including the location information or the weather information with respect to a plurality of different sample objects, and each of the plurality of learned models having:

an input layer accepting the sample odor data as the time-series data of the frequencies together with the sample acquisition condition in association with the plurality of different sample objects;

an intermediate layer extracting of a plurality of sample features of the sample odor data from the input layer in association with the plurality of different sample objects; and

an output layer providing an identification result based on the plurality of different sample features;

receiving an operation input from a user via an operation interface to select a target model of the plurality of learned models;

inputting the target odor data as the time-series data of the frequencies together with the target acquisition condition into the input layer of the target model;

causing the intermediate layer of the target model to extract a target feature of the target odor data;

causing the output layer of the target model to provide a target identification result based on the target feature and the plurality of sample features of the target model;

identifying the target object based on the target identification result; and

displaying information relating to the identified target object,

wherein the target identification result corresponds to a probability value indicating how likely the target object corresponds to one of the plurality of different sample objects.

7. The information processing method in claim 6 , wherein:

each of the target and sample acquisition conditions includes text data indicating a category of the odor, and the text data is input via the operation interface by a measurement user who measures the odor.

8. The information processing method in claim 6 , wherein:

each of the target and sample acquisition conditions includes state information indicating a state of the odor sensor when measuring the odor.

9. The information processing method in claim 6 , wherein:

the target identification result includes information indicating whether the target object corresponding to the target odor data corresponds to one of the plurality of different sample objects.

10. A non-transitory computer-readable medium storing a program for causing a computer to execute a process by a processor so as to perform the steps of:

acquiring target odor data measuring an odor of a target object via an odor sensor using a quartz crystal, the target odor data corresponding to time-series data of frequencies, the frequencies being measured while the odor of the target object is in an inner space of the odor sensor for a predetermined period of time;

acquiring a target acquisition condition of the target odor data, the target acquisition condition including environmental information regarding a measurement environment in which the odor of the target object is measured, the environmental information including location information or weather information of the measurement environment;

storing data of a plurality of learned models obtained by learning sample odor data and a sample acquisition condition including the location information or the weather information with respect to a plurality of different sample objects, and each of the plurality of learned models having:

an input layer accepting the sample odor data as the time-series data of the frequencies together with the sample acquisition condition in association with the plurality of different sample objects;

an intermediate layer extracting of a plurality of sample features of the sample odor data from the input layer in association with the plurality of different sample objects; and

an output layer providing an identification result based on the plurality of different sample features;

receiving an operation input from a user via an operation interface to select a target model of the plurality of learned models;

inputting the target odor data as the time-series data of the frequencies together with the target acquisition condition into the input layer of the target model;

causing the intermediate layer of the target model to extract a target feature of the target odor data;

causing the output layer of the target model to provide a target identification result based on the target feature and the plurality of sample features of the target model;

identifying the target object based on the target identification result; and

displaying information relating to the identified target object,

wherein the target identification result corresponds to a probability value indicating how likely the target object corresponds to one of the plurality of different sample objects.

11. The non-transitory computer-readable medium according to claim 10 , wherein:

each of the target and sample acquisition conditions includes text data indicating a category of the odor, and the text data is input via the operation interface by a measurement user who measures the odor.

12. The non-transitory computer-readable medium according to claim 10 , wherein:

each of the target and sample acquisition conditions includes state information indicating a state of the odor sensor when measuring the odor.

13. The non-transitory computer-readable medium according to claim 10 , wherein:

the target identification result includes information indicating whether the target object corresponding to the target odor data corresponds to one of the plurality of different sample objects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2022
From: MATSUOKA, HIROAKI; KOIDE, NORIAKI; KOSUDA, YUSUKE
To: REVORN CO., LTD.
Reel/Frame 059621/0028 →
Continuity (1)
Related Publication 20210325343A1 · Oct 21, 2021
References Cited (37)
US 11644449B2 · Onda · 2023 [cited by examiner]
US 20040135684A1 · Steinthal · 2004 [cited by examiner]
US 20060191319A1 · Kurup · 2006 [cited by examiner]
US 20130154797A1 · Lee · 2013 [cited by examiner]
US 20180137462A1 · Zohar · 2018 [cited by examiner]
US 20190019033A1 · Chang · 2019 [cited by examiner]
US 20190087425A1 · Kim · 2019 [cited by examiner]
US 20200097776A1 · Kim · 2020 [cited by examiner]
US 20200300798A1 · Watanabe · 2020 [cited by examiner]
CN 103868955A · 2014 [cited by applicant]
JP H05010904A · 1993 [cited by applicant]
JP H6160317A · 1994 [cited by applicant]
JP 2007022169A · 2007 [cited by applicant]
JP 2011169830A · 2011 [cited by applicant]
JP 2017161300A · 2017 [cited by applicant]
JP 2018045517A · 2018 [cited by applicant]
JP 2018075255A · 2018 [cited by applicant]
JP 2018146803A · 2018 [cited by applicant]
WO 2016060863A2 · 2016 [cited by applicant]
WO 2016060863A3 · 2016 [cited by applicant]
WO WO2016145300A1 · 2016 [cited by examiner]
Matsuno et al. (A Quartz Crystal Microbalance-Type Odor Sensor Using PVC-Blended Lipid Membrane, IEEE, 1995) (Year: 1995). [cited by examiner]
Nanto (Odor sensor using quartz crystal microbalance coated with molecular recognition membrane, 2006) (Year: 2006). [cited by examiner]
Acharyya D. et al. “Noise Analysis-Resonant Frequency-Based Combined Approach for Concomitant Detection of Unknown Vapor Type and Concentration”; IEEE Transactions on Instrumentation and Measurement, IEEE, USA; vol. 68,… [cited by applicant]
Extended European Search Report issued for the corresponding European Application No. 19891914.4; dated Jan. 17, 2022 (total 11 pages). [cited by applicant]
International Search Report (English and Japanese) of the International Searching Authority issued in PCT/JP2019/047343, mailed Mar. 3, 2020; ISA/JP (6 pages). [cited by applicant]
Office Action issued in the corresponding Chinese Patent Application No. 201980080060.X; dated Nov. 29, 2023 (total 42 pages). [cited by applicant]
“New technology to raise manhood. Kunkun body realizes odor management fo capable men”; Konica Minolta BIC—Japan; URL: https://www.makuake.com/project/kunkunbody/; Author unknown; retrived from the internet on Feb. 29, … [cited by applicant]
English abstract; Young Ah Seong, et al. “Scent Sensing System for Recording Scent Data in Daily Life”; Transactions of the Virtual Reality Society of Japan; vol. 16, No. 4; dated Dec. 31, 2011; pp. 677-686 (total 10 pa… [cited by applicant]
“Scent AI startup Revorn launches “iinioi Project” utilizing the world's No. 1 scent database and AI”; PR Times; URL: https://prtimes.jp/main/html/rd/p/00; published online by PR Times Corporation on Nov. 20, 2018; retr… [cited by applicant]
Office Action issued in the corresponding Japanese Patent Application No. 2020-559951; mailed on Mar. 5, 2024 (total 8 pages). [cited by applicant]
Amy Loutfi et al. “Object recognition: A new application for smelling robots”; Robotics and Autonomous Systems; vol. 52, No. 4; Sep. 30, 2005; pp. 272-289; XP027792856; ISSN: 0921-8890 (total 18 pages). [cited by applicant]
Amy Loutfi et al. “Putting Olfaction into Action: Anchoring Symbols to Sensor Data Using Olfaction and Planning”; ReasearchGate; Oct. 23, 2004; pp. 1-7; XP093134143 (total 7 pages). [cited by applicant]
Amy Loutfi et al. “Odor source identification by grounding linguistic descriptions in an artificial nose”; Proceedings of SPIE; vol. 4385; Mar. 22, 2001; pp. 273-281; XP093134136; ISSN: 0277-786X; DOI: 10.1117/12.421115… [cited by applicant]
Office Action issued in the corresponding European Patent Application No. 19891914.4; dated Feb. 28, 2024 (total 9 pages). [cited by applicant]
Liu Yande, “Non-destructive Intelligent Inspection Technology and Application”; Huazhong University of Science and Technology Publishing House; May 1, 2007; pp. 245-247 (total 18 pages). [cited by applicant]
Office Action issued in the corresponding Chinese Patent Application No. 201980080060.X; dated Nov. 29, 2024 (total 26 pages). [cited by applicant]