IP Library › Granted Patent US 12,730,049
Granted Patent B2
US 12,730,049 · App. 18/812,862 · Granted Sep 8, 2026

Enabling an automated assistant to leverage odor sensor(s) of client device(s)

Inventor: Evan Brown (New York, NY)
Assignee: GOOGLE LLC
G01N7/04H04L67/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,730,049
App. No.
18/812,862
Granted
Sep 8, 2026
Kind
B2
Abstract

Implementations described herein are directed to leveraging odor sensor(s) of client device(s) in responding to user request(s) and/or in generating notification(s). Processor(s) of a given client device can receive a request to identify an odor in an environment of the given client device, process an odor data instance generated by the odor sensor(s) of the given client device, identify the odor based on processing the odor data instance, generate a response that identifies the odor and/or a source of the odor, and cause the response to the request to be rendered via the given client device. Processor(s) of the given client device can additionally, or alternatively, establish baseline odor(s) in the environment and generate a notification when an odor is detected that does not correspond to the baseline odor(s) and/or exclude the baseline odor(s) in generating the response to the request.

Claims (73)

1 . A method implemented by one or more processors, the method comprising:

at a plurality of time instances:

obtaining corresponding odor data instances generated by an odor sensor of a client device of a user;

processing the corresponding odor data instances to generate corresponding outputs for the corresponding odor data instances; and

identifying, based on the corresponding outputs, one or more baseline odors associated with a physical environment of the client device; and

at a subsequent time instance that is subsequent to each of the plurality of time instances:

obtaining a given odor data instance generated by the odor sensor of the client device of the user or an additional odor sensor of an additional client device of the user that is co-located in the physical environment of the client device;

processing the given odor data instance to generate given output for the given odor data instance;

identifying, based on the given output, a given odor in the physical environment of the client device;

determining that the given odor in the physical environment of the client device does not correspond to one or more of the baseline odors associated with the physical environment of the client device; and

in response to determining that the given odor in the physical environment of the client device that does not correspond to one or more of the baseline odors associated with the physical environment of the client device:

generating synthesized speech audio data that captures synthesized speech identifying the given odor in the physical environment of the client device; and

causing the synthesized speech audio data that captures the synthesized speech identifying the given odor in the physical environment of the client device to be rendered for audible presentation to the user via one or more speakers of the client device or the additional client device of the user.

2 . The method of claim 1 , wherein identifying a given baseline odor, of the one or more baseline odors, in the physical environment of the client device based on the corresponding outputs comprises:

identifying the given baseline odor at a threshold quantity of time instances of the plurality of time instances; and

storing, in an index that includes at least the one or more baseline odors, an indication of the given baseline odor.

3 . The method of claim 2 , further comprising:

storing, in the index that includes at least the one or more baseline odors, and in association with the given baseline odor, one or more terms that describe a characteristic of the given baseline odor.

4 . The method of claim 3 , wherein the synthesized speech further identifies an indication of the characteristic of the given odor.

5 . The method of claim 1 , wherein the synthesized speech further identifies an indication that the given odor in the physical environment of the client device does not correspond to the one or more baseline odors.

6 . The method of claim 1 , further comprising:

generating, based on the given odor in the physical environment of the client device of the user, a query; and

executing, based on the query, a search over one or more databases to obtain content that is responsive to the query.

7 . The method of claim 6 , wherein the synthesized speech further identifies the content that is responsive to the query.

8 . A system comprising:

at least one processor; and

memory storing instructions that, when executed by the at least one processor, cause the at least one processor to be operable to:

at a plurality of time instances:

obtain corresponding odor data instances generated by an odor sensor of a client device of a user;

process the corresponding odor data instances to generate corresponding outputs for the corresponding odor data instances; and

identify, based on the corresponding outputs, one or more baseline odors associated with a physical environment of the client device; and

at a subsequent time instance that is subsequent to each of the plurality of time instances:

obtain a given odor data instance generated by the odor sensor of the client device of the user or an additional odor sensor of an additional client device of the user that is co-located in the physical environment of the client device;

process the given odor data instance to generate given output for the given odor data instance;

identify, based on the given output, a given odor in the physical environment of the client device;

determine that the given odor in the physical environment of the client device does not correspond to one or more of the baseline odors associated with the physical environment of the client device; and

in response to determining that the given odor in the physical environment of the client device that does not correspond to one or more of the baseline odors associated with the physical environment of the client device:

generate synthesized speech audio data that captures synthesized speech identifying the given odor in the physical environment of the client device; and

cause the synthesized speech audio data that captures the synthesized speech identifying the given odor in the physical environment of the client device to be rendered provided for audible presentation to the user via one or more speakers of the client device or the additional client device of the user.

9 . The system of claim 8 , wherein the instructions to identify a given baseline odor, of the one or more baseline odors, in the physical environment of the client device based on the corresponding outputs comprise instructions to:

identify the given baseline odor at a threshold quantity of time instances of the plurality of time instances; and

store, in an index that includes at least the one or more baseline odors, an indication of the given baseline odor.

10 . The system of claim 9 , wherein the at least one processor is further operable to:

store, in the index that includes at least the one or more baseline odors, and in association with the given baseline odor, one or more terms that describe a characteristic of the given baseline odor.

11 . The system of claim 10 , wherein the synthesized speech further identifies an indication of the characteristic of the given odor.

12 . The system of claim 8 , wherein the synthesized speech further identifies an indication that the given odor in the physical environment of the client device does not correspond to the one or more baseline odors.

13 . The system of claim 8 , wherein the at least one processor is further operable to:

generate, based on the given odor in the physical environment of the client device of the user, a query; and

execute, based on the query, a search over one or more databases to obtain content that is responsive to the query.

14 . The system of claim 13 , wherein the synthesized speech further identifies the content that is responsive to the query.

15 . A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to be operable to perform operations, the operations comprising:

at a plurality of time instances:

obtaining corresponding odor data instances generated by an odor sensor of a client device of a user;

processing the corresponding odor data instances to generate corresponding outputs for the corresponding odor data instances; and

identifying, based on the corresponding outputs, one or more baseline odors associated with a physical environment of the client device; and

at a subsequent time instance that is subsequent to each of the plurality of time instances:

obtaining a given odor data instance generated by the odor sensor of the client device of the user or an additional odor sensor of an additional client device of the user that is co-located in the physical environment of the client device;

processing the given odor data instance to generate given output for the given odor data instance;

identifying, based on the given output, a given odor in the physical environment of the client device;

determining that the given odor in the physical environment of the client device does not correspond to one or more of the baseline odors associated with the physical environment of the client device; and

in response to determining that the given odor in the physical environment of the client device that does not correspond to one or more of the baseline odors associated with the physical environment of the client device:

generating synthesized speech audio data that captures synthesized speech identifying the given odor in the physical environment of the client device; and

causing the synthesized speech audio data that captures the synthesized speech identifying the given odor in the physical environment of the client device to be rendered for audible presentation to the user via one or more speakers of the client device or the additional client device of the user.

16 . The non-transitory computer-readable storage medium of claim 15 , wherein identifying a given baseline odor, of the one or more baseline odors, in the physical environment of the client device based on the corresponding outputs comprises:

identifying the given baseline odor at a threshold quantity of time instances of the plurality of time instances; and

storing, in an index that includes at least the one or more baseline odors, an indication of the given baseline odor.

17 . The non-transitory computer-readable storage medium of claim 16 , the operations further comprising:

storing, in the index that includes at least the one or more baseline odors, and in association with the given baseline odor, one or more terms that describe a characteristic of the given baseline odor.

18 . The non-transitory computer-readable storage medium of claim 17 , wherein the synthesized speech further identifies an indication of the characteristic of the given odor.

19 . The non-transitory computer-readable storage medium of claim 15 , wherein the synthesized speech further identifies an indication that the given odor in the physical environment of the client device does not correspond to the one or more baseline odors.

20 . The non-transitory computer-readable storage medium of claim 15 , the operations further comprising:

generating, based on the given odor in the physical environment of the client device of the user, a query; and

executing, based on the query, a search over one or more databases to obtain content that is responsive to the query, wherein the synthesized speech further identifies the content that is responsive to the query.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2024
From: BROWN, EVAN
To: GOOGLE LLC
Reel/Frame 068429/0137 →
Continuity (2)
Continuation 17548945 · Dec 13, 2021
Related Publication 20240410803A1 · Dec 12, 2024
References Cited (37)
US 6903723B1 · Forest · 2005 [cited by examiner]
US 11204344B1 · Bazemore · 2021 [cited by applicant]
US 20090043580A1 · Mozer · 2009 [cited by applicant]
US 20110181421A1 · Nabata et al. · 2011 [cited by applicant]
US 20160171339A1 · Choi · 2016 [cited by examiner]
US 20180268806A1 · Chun · 2018 [cited by examiner]
US 20200151601A1 · Niewczas · 2020 [cited by examiner]
US 20200183925A1 · Amin · 2020 [cited by examiner]
US 20200342011A1 · Miller · 2020 [cited by applicant]
US 20210033582A1 · Gafsou · 2021 [cited by applicant]
US 20210325343A1 · Matsuoka · 2021 [cited by examiner]
US 20210352115A1 · Hansen · 2021 [cited by applicant]
US 20220034857A1 · Zhou · 2022 [cited by applicant]
US 20220067093A1 · Su · 2022 [cited by examiner]
US 20220246304A1 · Shyu · 2022 [cited by examiner]
US 20220260539A1 · Yun · 2022 [cited by applicant]
US 20230061026A1 · Shimizu · 2023 [cited by applicant]
US 20230184652A1 · Brown · 2023 [cited by applicant]
CN 2879557 · 2007 [cited by applicant]
CN 108885904 · 2018 [cited by applicant]
CN 111401129 · 2020 [cited by applicant]
WO 2023038654 · 2023 [cited by applicant]
Galan et al.; The Sense of Smell in Social Robots; 798-1-4577-2119-9/12; IEEE; 6 pages; dated 2011. [cited by applicant]
Sanchez-Lengeling et al.; Machine Learning for Scent: Learning Generalizable Perceptual Representations of Small Molecules; arXiv:1910.10685v2; dated Oct. 25, 2019. [cited by applicant]
Leo et al.; An Efficient Approach for Preprocessing Data from a Large-Scale Chemical Sensor Array; Sensors; 14; 17786-17806; doi: 10.3390/s140917786; dated 2014. [cited by applicant]
European Patent Office; Communication issued in Application No. 22197823.2; 8 pages; dated Mar. 16, 2023. [cited by applicant]
European Patent Office; International Search Report and Written Opinion issued in Application No. PCT/US2021/063338; 14 pages; dated Aug. 18, 2022. [cited by applicant]
“New smartphone app can act as electronic nose to detect your scent” Dated Mar. 27, 2018. 3 pages. Retrieved from: https://www.bgr.in/news/new-smartphone-app-can-act-as-electronic-nose-to-detect-your-scent-597870/#:~:te… [cited by applicant]
“Aroma Bit to Develop Smartphone Embeddable Ultra-compact Silicon CMOS Based Smell Sensor That Has Dog Nose Equivalent Resolution in 1mm Squared Die Size” Aroma Bit Silicon Sensor Technology Inc. Dated Jun. 28, 2019. 5 … [cited by applicant]
Arroyo et al., “Eclectronic Nose with Digital Gas Sensors Connected via Bluetooth to a Smartphone for Air Quality Measurements” Sensors 2020, 20, 786; doi:10.3390/s20030786. 16 pages. [cited by applicant]
Tan et al., “Applications of Electronic nose (e-nose) and electronic tongue (e-tongue) in food quality-related properties determination: A review” Artificial Intelligence in Agriculture 4 (2020) 104-115. https://doi.org… [cited by applicant]
Tim Collins, “The phone that could save your life: World's first mobile that contains a sensor able to smell indoor air pollutants (and it also has a thermal imaging camera)” Retreived from https:///www.dailymail.co.uk/… [cited by applicant]
Schuman et al., “The game-changing potential of smartphones that can smell” IDG Communications, Inc. 2020. 5 pages. [cited by applicant]
Wiltschko et al., “Learning to Smell: Using Deep Learning to Predict the Olfactory Properties of Molecules” Google AI Blog. Dated Oct. 24, 2019. 5 pages. [cited by applicant]
Intellectual Property India, Hearing Notice issued in Application No. 202417037040, 9 pages, dated Feb. 2, 2026. [cited by applicant]
Intellectual Property India, Examination Report issued in Application No. 202417037040, 13 pages, dated Oct. 28, 2025. [cited by applicant]
European Patent Office; Communication pursuant to Article 94(3) EPC issued in Application No. 22197823.2; 6 pages; dated Mar. 31, 2026. [cited by applicant]