Granted Patent B2

US 12,213,796 · App. 17/843,442 · Granted Feb 4, 2025

Inventors: Derrick Anthony Martin, II (Brooklyn, NY); Alex M. Kass (Palo Alto, CA); Marc Carrel-Billiard (Vence, FR); Alexandria Emily Pabst (Merced, CA)

Assignee: Accenture Global Solutions Limited

A61B5/4011G06F3/015G06F3/04842

Abstract

Claims (72)

1. A computer-implemented method for aroma training, comprising:

generating training data sets for training a machine learning model to identify one of a plurality of objects to present after initially presenting another one of the plurality of objects to incrementally trigger increased user perception of aromas by users that are suffering from olfactory disfunction, the training data sets each including data indicating (i) another one of the plurality of objects that was initially presented to one of the users, (ii) one of the plurality of objects that were presented to the one of the users after initially presenting the another one of the plurality of objects, (iii) and electrical brain activity data of the one of the users that reflects an extent to which presentation of the aromas of the one of the plurality of objects and the another one of the plurality of objects created fluctuations in electrical activity of a brain of the one of the users when the one of the plurality of objects and the another one of the plurality of object were presented;

training the machine learning model in such a way that the aromas of the another one of the plurality of objects is followed in sequence by the aromas of the one of the plurality of objects, to predict objects from a plurality of objects based on the aromas;

transmitting, to a client device, a first data indicating a first object from the plurality of objects and instructions to disperse a first aroma associated with the first object for presentation to a user of the client device;

receiving, from the client device, a user response that was provided by the user in response to the presentation of the first object and the first aroma, the user response comprising electrical brain activity data of the user that reflects an extent to which an aroma of the first object was perceived;

storing the user response in a database as an instance of a training dataset for the user;

identifying, based on the user response, a second object from the plurality of objects using the trained machine learning model;

determining the aroma of the second object based on the electrical brain activity data of the one of the users; and

transmitting, to the client device, the second data indicating the second object and instructions to disperse the second aroma for presentation to the user of the client device.

2. The computer-implemented method of claim 1 , wherein presenting the first and the second data by the client device comprises:

displaying the respective object on a display screen of a client device wherein the display screen can support virtual reality (VR);

dispersing the respective aroma associated to the respective object and displayed on the display screen of the client device using a aroma dispenser of the client device.

3. The computer-implemented method of claim 1 , comprising:

displaying a plurality of objects in the VR space generated by the client device;

dispersing the aroma associated to a particular object at an intensity level, wherein the intensity level is based on the user position with respect to the VR space and the distance of the user position in the VR space to the particular object in the VR space; and

changing the intensity level of the aroma based on the change in the user position in the VR space and change in the distance of the user position in the VR space to the particular object in the VR space;

receiving a response from the user indicating a user selection of an object in the VR space;

revealing the particular object to the user in the VR space and an indication of whether the object selected by the user is the same as the particular object.

4. The computer-implemented method of claim 3 , comprising:

displaying to the user in the VR space the plurality of objects, receiving a response from the user indicating a selection of an object from the plurality of objects, wherein, in response to the user selection of the object, dispersing the aroma associated to the object; and

receiving a response from the user indicating a selection of two objects from the plurality of objects; and in response to selecting two objects from the plurality of objects, displaying to the user whether the two selected obj ects have the same aroma.

5. The computer-implemented method of claim 4 , wherein the user response provided by the user in response to the presentation of the first object and the first aroma is collected using one or more electrodes of the client device affixed to the scalp of the user wherein the electrical activity of the brain identifies brain activity in response to the user smelling the first object.

6. The computer-implemented method of claim 1 , wherein the user response provided by the user in response to the presentation of the first object and the first aroma based on the user experience comprises (1) an indication whether the user was able to perceive the first aroma, (2) an indication whether the user is able to associate the first object and the first aroma, and (3) a score provided by the user indicating the level of confidence the user has on the association of the first object and first aroma.

7. A system for aroma training, comprising one or more processors and one or more non-transitory computer readable media that store instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

generating training data sets for training a machine learning model to identify one of a plurality of objects to present after initially presenting another one of the plurality of objects to incrementally trigger increased user perception of aromas by users that are suffering from olfactory disfunction, the training data sets each including data indicating (i) another one of the plurality of objects that was initially presented to one of the users, (ii) one of the plurality of objects that were presented to the one of the users after initially presenting the another one of the plurality of objects, (iii) and electrical brain activity data of the one of the users that reflects an extent to which presentation of the aromas of the one object and the another one of the objects created fluctuations in electrical activity of a brain of the one of the users when the one of the plurality of object and the another one of the plurality of objects were presented;

training the machine learning model in such a way that the aromas of the another one of the plurality of objects is followed in sequence by the aromas of the one of the plurality of objects, to predict objects from the plurality of objects based on the aromas;

transmitting, to a client device, a first data indicating a first object from the plurality of objects and instructions to disperse a first aroma associated with the first object for presentation to a user of the client device;

receiving, from the client device, the user response that was provided by the user in response to the presentation of the first object and the first aroma, the user response comprising electrical brain activity data of the user that reflects an extent to which an aroma of the first object was perceived;

storing the user response in a database as an instance of a training dataset for the user;

identifying, based on the user response, a second object from the plurality of objects using the trained machine learning model;

determining a second aroma that is associated with the second object based on the electrical brain activity data of the one of the users;

transmitting, to the client device, the second data indicating the second object and instructions to disperse the second aroma for presentation to the user of the client device.

8. The system of claim 7 , wherein presenting the first and the second data by the client device comprises:

displaying the respective object on a display screen of a client device wherein the display screen can support virtual reality (VR); and

dispersing the respective aroma associated to the respective object and displayed on the display screen of the client device using an aroma dispenser of the client device.

9. The system of claim 7 , wherein the operations comprise:

displaying a plurality of objects in the VR space generated by the client device;

dispersing the aroma associated to a particular object at an intensity level, wherein the intensity level is based on the user position with respect to the VR space and the distance of the user position in the VR space to the particular object in the VR space;

changing the intensity level of the aroma based on the change in the user position in the VR space and change in the distance of the user position in the VR space to the particular object in the VR space;

receiving a response from the user indicating a user selection of an object in the VR space; and

revealing the particular object to the user in the VR space and an indication of whether the object selected by the user is the same as the particular object.

10. The system of claim 9 , wherein the operations comprise:

displaying to the user in the VR space the plurality of objects;

receiving a response from the user indicating a selection of an object from the plurality of objects,

wherein, in response to the user selection of an object, dispersing the aroma associated to the object;

receiving a response from the user indicating a selection of two objects from the plurality of objects; and

in response to selecting two objects from the plurality of objects, displaying to the user whether the two selected objects have the same aroma.

11. The system of claim 10 , wherein the user response provided by the user in response to the presentation of the first object and the first aroma is collected using one or more electrodes of the client device affixed to the scalp of the user wherein the electrical activity of the brain identifies brain activity in response to the user smelling the first object.

12. The system of claim 7 , wherein the user response provided by the user in response to the presentation of the first object and the first aroma based on the user experience comprises (1) an indication whether the user was able to perceive the first aroma, (2) an indication whether the user is able to associate the first object and the first aroma, and (3) a score provided by the user indicating the level of confidence the user has on the association of the first object and first aroma.

13. A non-transitory computer readable medium storing instructions that, when executed by one or more data processing apparatus, cause the one or more data processing apparatus to perform operations comprising:

generating training data sets for training a machine learning model to identify one of a plurality of objects to present after initially presenting another one of the plurality of objects to incrementally trigger increased user perception of aromas by users that are suffering from olfactory disfunction, the training data sets each including data indicating (i) another one of the plurality of objects that was initially presented to one of the users, (ii) one of the objects that were presented to the one of the users after initially presenting the another one of the plurality of objects, (iii) and electrical brain activity data of the one of the users that reflects an extent to which presentation of the aromas of the one of the plurality of objects and the another one of the objects created fluctuations in electrical activity of a brain of the one of the users when the one object and the another object were presented;

training the machine learning model in such a way that the aromas of the another one of the plurality of objects is followed in sequence by the aromas of the one of the objects, to predict objects from a plurality of objects based on the aromas:

transmitting, to a client device, a first data indicating a first object from the plurality of objects and instructions to disperse a first aroma associated with the first object for presentation to a user of the client device;

receiving, from the client device, a user response that was provided by the user in response to the presentation of the first object and the first aroma, the user response comprising electrical brain activity data of the user that reflects an extent to which an aroma of the first object was perceived;

storing the user response in a database as an instance of a training dataset for the user;

identifying, based on the user response, a second object from the plurality of objects using the trained machine learning model;

determining a second aroma that is associated with the second object based on the electrical brain activity data of the one of the users; transmitting, to the client device, the second data indicating the second object and instructions to disperse the second aroma for presentation to the user of the client device.

14. The non-transitory computer readable medium of claim 13 , wherein presenting the first and the second data by the client device comprises:

displaying the respective object on a display screen of a client device wherein the display screen can support virtual reality (VR); and

dispersing the respective aroma associated to the respective object and displayed on the display screen of the client device using an aroma dispenser of the client device.

15. The non-transitory computer readable medium of claim 13 , wherein the operations comprise:

displaying a plurality of objects in the VR space generated by the client device;

dispersing the aroma associated to a particular object at an intensity level, wherein the intensity level is based on the user position with respect to the VR space and the distance of the user position in the VR space to the particular object in the VR space;

changing the intensity level of the aroma based on the change in the user position in the VR space and change in the distance of the user position in the VR space to the particular object in the VR space;

receiving a response from the user indicating a user selection of an object in the VR space;

revealing the particular object to the user in the VR space and an indication of whether the object selected by the user is the same as the particular object.

16. The non-transitory computer readable medium of claim 15 , wherein the operations comprise:

displaying to the user in the VR space the plurality of objects;

receiving a response from the user indicating a selection of an object from the plurality of objects,

wherein, in response to the user selection of an object, dispersing the aroma associated to the object;

receiving a response from the user indicating a selection of two objects from the plurality of objects; and

in response to selecting two objects from the plurality of objects, displaying to the user whether the two selected objects have the same aroma.

Assignments (2)

Continuity (2)

References Cited (54)