IP Library Granted Patent US 12,327,275
Granted Patent B2
US 12,327,275 · App. 17/118,279 · Granted Jun 10, 2025

Method, system, and non-transitory computer-readable medium for associating taste with consumable records

Inventors: Chul Lee (San Francisco, CA); Kyler Eastman (Austin, TX); Patrick Howell (Austin, TX); Layla Martin (San Francisco, CA); Hesamoddin Salehian (San Francisco, CA); Joohyun Kim (San Francisco, CA)
Assignee: MyFitnessPal, Inc.
G06Q30/0631G16H10/60G16H20/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,327,275
App. No.
17/118,279
Granted
Jun 10, 2025
Kind
B2
Abstract

A method for operating a health tracking system, a health tracking system, and non-transitory computer-readable medium for operating a health tracking system are disclosed. The method comprises receiving a data record comprising at least a descriptive string and nutritional data regarding a consumable item to which the data record corresponds; determining a taste associated to the consumable item based on an evaluation of at least one of: (i) the descriptive string, and (ii) the nutritional data; and associating the determined taste with the data record in a database.

Claims (57)

1. A method for operating a health tracking system, the method comprising:

receiving a crowd-sourced data record comprising at least a descriptive string and nutritional data regarding a consumable item to which the data record corresponds;

determining one of a plurality of possible tastes associated to the consumable item by:

evaluating the nutritional data of the data record to determine an accuracy of the nutritional data with respect to the consumable item,

when the evaluation of the nutritional data is determined to be accurate, applying a first statistical model to the descriptive string to determine a first set of probabilities that the consumable item has each of the plurality of possible tastes, wherein the plurality of possible tastes includes a plurality of fundamental flavors, applying a second statistical model to the nutritional data to determine a second set of probabilities that the consumable item has each of the plurality of possible tastes, and determining the one of the plurality of possible tastes for the consumable item based on the first set of probabilities and the second set of probabilities, wherein applying the first statistical model comprises (i) vectorizing the descriptive string, (ii) comparing the vectorized descriptive string to a set of training vectors, and (iii) using a weighted k-nearest neighbor algorithm to calculate the first set of probabilities that the consumable item has each of the plurality of possible tastes based on a similarity between the vectorized descriptive string and vectors in the set of training vectors, and

when the nutritional data is determined to not be accurate, determining the one of the plurality of possible tastes by applying the first statistical model to the descriptive string to determine the first set of probabilities that the consumable item has each of the plurality of possible tastes and determining the one of a plurality of possible tastes for the consumable item based only on the first set of probabilities;

updating a crowd-sourced database in order to associate the determined taste with the data record in the crowd-sourced database;

performing the acts of receiving, determining, and associating updating with respect to each of a plurality data records stored in the crowd-sourced database such that each of the plurality of data records is associated to a taste;

determining a taste profile specific to a user, said taste defined by a probability of each of the fundamental flavors;

generating a list of recommended ones of a plurality of consumable items for the user based at least in part on the determined taste profile specific to the user and the tastes associated with the plurality of data records; and

transmitting the generated list of recommended ones of a plurality of consumable items to a health tracking device associated with the user.

2. The method according to claim 1 , wherein the nutritional data includes at least a total caloric content and respective amounts of a plurality of macronutrients of the consumable item, and the act of determining the accuracy further comprises comparing the total caloric content to a caloric content representative of the respective amounts of the plurality of macronutrients.

3. The method according to claim 1 , further comprising: when the nutritional data is determined to be accurate, weighting an output of the first statistical model, and weighting an output of the second statistical model.

4. The method according to claim 3 , wherein a value by which the output of the first statistical model is weighted and a value by which the output of the second statistical model is weighted are dependent on a value of the output of the first statistical model.

5. The method according to claim 1 , further comprising:

receiving a list of consumable items, the received list being associated with a user profile stored in the database, the received list containing a plurality of entries corresponding to individual ones of the data records selected by the user; and

associating the determined taste profile to the user profile in the database, wherein the determined taste profile specific to the user profile is based on one or more patterns determined from the tastes associated to each of the data records corresponding to the plurality of entries in the received list.

6. The method according to claim 5 , further comprising:

selecting individual ones of a plurality of advertisements stored in the database based on the determined taste profile; and

transmitting the selected individual ones of the plurality of advertisements to a health tracking device associated with the user profile.

7. The method of claim 1 wherein the plurality of fundamental flavors include two or more of sweet, salty, umami, sour, spicy and bitter.

8. The method of claim 1 wherein the taste profile is defined by a user probability for each of the fundamental flavors.

9. A health tracking system comprising:

a database configured to store a plurality of crowd-sourced data records, each of the plurality of data records comprising at least a descriptive string and nutritional data regarding the consumable item to which the data record corresponds; and

a data processor in communication with the database, the data processor being configured to (i) receive one or more of the plurality of data records from the database, (ii) determine a taste aspect for the consumable item to which each of the received ones of the one or more of the plurality of data records corresponds, the determination being based on an evaluation of at least one of the descriptive string and the nutritional data, wherein the taste aspect defines probabilities for each of a plurality of fundamental flavors (iii) generate a list of recommended ones of the plurality of data records based at least in part on the determined taste aspects corresponding to the plurality of data records, and (iv) send the generated list of recommended ones of the plurality of data records to a health tracking device associated with the user;

wherein the evaluation of at least one of the descriptive string and the nutritional data comprises:

for each of the one or more of the plurality of data records, determine whether the nutritional data thereof is accurate with respect to the consumable item;

when it is determined that the nutritional data is accurate, apply a first mathematical model to the nutritional data to calculate a probability that respective ones of the consumable item have a first taste aspect and based on the result thereof, apply a second mathematical model to the descriptive string, wherein applying the second mathematical model comprises (i) vectorizing the descriptive string, (ii) comparing the vectorized descriptive string to a set of training vectors, and (iii) using a weighted k-nearest neighbor algorithm to calculate a first set of probabilities that the consumable item has each of the plurality of possible tastes based on a similarity between the vectorized descriptive string and vectors in the set of training vectors; and

when it is determined that the nutritional data is not accurate, apply the second mathematical model to the descriptive string to calculate a probability that respective ones of the consumable item have the first taste aspect.

10. The health tracking system of claim 9 , wherein the data processor is further configured to store the determined taste aspects in the database in association with the respective ones of the one or more of the plurality of data records.

11. The health tracking system of claim 9 , wherein the at least one of the first and second mathematical models model also comprises a machine learning model which utilizes a training set of data records having known taste aspects associated therewith.

12. The health tracking system of claim 9 , wherein applying the first mathematical model also comprises using a weighted k-nearest neighbor algorithm.

13. The health tracking system of claim 9 , wherein the application of the second mathematical model to the descriptive string further comprises

vectorize the descriptive string; and

apply applying a pattern recognition model to the vectorized descriptive string.

14. The health tracking system of claim 13 , wherein the nutritional data includes at least a total caloric content and respective amounts of a plurality of macronutrients of the consumable item, and wherein determining whether the nutritional data thereof is accurate with respect to the consumable item further comprises comparing the total caloric content to a caloric content representative of respective amounts of the plurality of macronutrients.

15. The health tracking system of claim 13 , wherein when the nutritional data is determined to be accurate, weighting an output of the first mathematical model, and weighting an output of the second mathematical model.

16. The health tracking system of claim 15 , wherein a value by which the output of the first mathematical model is weighted and a value by which the output of the second mathematical model is weighted are dependent on a value of the output of the first mathematical model.

17. The health tracking system of claim 9 , wherein the data processor is further configured to:

receive a list of consumable items, the received list being associated with a user profile stored in the database, the received list containing a plurality of entries corresponding to individual ones of the plurality of data records; and

associate the determined taste aspect to the user profile in the database, wherein the determined taste aspect specific to the user profile is based on one or more patterns determined from the tastes associated to each of the data records corresponding to the plurality of entries in the received list.

18. The health tracking system of claim 9 , wherein the data processor is further configured to:

select individual ones of a plurality of advertisements stored in the database based on the user profile; and

transmit the selected individual ones of the plurality of advertisements to a health tracking device associated with the user profile.

19. A non-transitory computer-readable medium for operating a health tracking system, the computer-readable medium having a plurality of instructions stored thereon that, when executed by a processor, cause the processor to:

receive a plurality of crowd-sourced data records from a database, the plurality data records each comprising a descriptive string and nutritional data regarding the respective corresponding consumable;

determine a taste for each of the respective corresponding consumables of the plurality of data records based on at least one of (i) the descriptive string of the data record, and (ii) evaluation of the nutritional data of the data record, the nutritional data including at least a total caloric content and respective amounts of a plurality of macronutrients of the consumable, wherein the determined taste is defined by probabilities that the consumable has each of a plurality of fundamental flavors;

wherein the evaluation of the nutritional data of the data record comprises determining the accuracy of the nutritional data with respect to the consumable by comparing the total caloric content to a caloric content representative of the respective amounts of the plurality of macronutrients, wherein,

when the nutritional data is determined to be accurate, determining the taste by (a) applying a first statistical model to the descriptive string and (b) applying a second statistical model to the nutritional data, wherein applying the first statistical model comprises (i) vectorizing the descriptive string, (ii) comparing the vectorized descriptive string to a set of training vectors, and (iii) using a weighted k-nearest neighbor algorithm to calculate the first set of probabilities that the consumable item has each of the plurality of possible tastes based on a similarity between the vectorized descriptive string and vectors in the set of training vectors; and

when the nutritional data is determined to be inaccurate, determining the taste by applying the first statistical model to the descriptive string and omitting to utilize the nutritional data;

update the database by storing the determined tastes in the database associated to the respective ones of the plurality of data records;

derive a taste profile for a particular user; and

recommend one or more items for consumption and/or provide one or more advertisements to said particular user based at least in part on the derived taste profile and the determined taste for each of the respective corresponding consumables.

20. The non-transitory computer-readable medium of claim 19 , wherein the plurality of instructions are further configured to:

utilize said tastes for each of said corresponding consumables to derive the taste profile for the particular user, the taste profile being based at least in part on one or more of:

individual ones of the plurality of data records selected by the particular user, an age of the particular user, and/or

a gender of the particular user.

Assignments (4)
PATENT SECURITY AGREEMENT Recorded Jul 26, 2024
From: MYFITNESSPAL, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 068173/0300 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2023
From: UNDER ARMOUR, INC.
To: UA CONNECTED FITNESS, INC.
Reel/Frame 063323/0353 →
CHANGE OF NAME Recorded Apr 14, 2023
From: UA CONNECTED FITNESS, INC.
To: MYFITNESSPAL, INC.
Reel/Frame 063323/0363 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2021
From: LEE, CHUL; EASTMAN, KYLER; HOWELL, PATRICK; MARTIN, LAYLA; SALEHIAN, HESAMODDIN; KIM, JOOHYUN
To: UNDER ARMOUR, INC.
Reel/Frame 055567/0297 →
Continuity (2)
Continuation 15215861 · Jul 21, 2016
Related Publication 20210142367A1 · May 13, 2021
References Cited (44)
US 20130339179A1 · Pickelsimer · 2013 [cited by examiner]
US 20140255882A1 · Hadad · 2014 [cited by examiner]
US 20140280226A1 · Wilson · 2014 [cited by examiner]
US 20140324607A1 · Frehn et al. · 2014 [cited by applicant]
US 20150235136A1 · Dillon et al. · 2015 [cited by applicant]
US 20150276700A1 · Goel et al. · 2015 [cited by applicant]
US 20150294225A1 · Takei et al. · 2015 [cited by applicant]
US 20160005097A1 · Hsiao · 2016 [cited by examiner]
US 20160012513A1 · Martinez · 2016 [cited by examiner]
US 20160103910A1 · Kim et al. · 2016 [cited by applicant]
US 20160171514A1 · Frank · 2016 [cited by examiner]
US 20170053362A1 · Galarraga et al. · 2017 [cited by applicant]
US 20170249445A1 · Devries · 2017 [cited by examiner]
WO 2007023619A1 · 2007 [cited by applicant]
Pouladzadeh, P., et al., “Measuring Calorie and Nutrition From Food Image,” in IEEE Transactions on Instrumentation and Measurement, vol. 63, No. 8, pp. 1947-1956, doi: 10.1109/TIM.2014.2303533 (Year: 2014). [cited by examiner]
Temussi, P. A., “The good taste of peptides” J. Pept. Sci. 2012; vol. 18: p. 73â82. (Year: 2012). [cited by examiner]
Berrueta, L., et al. “Supervised pattern recognition in food analysis,” Journal of Chromatography A, vol. 1158, Iss. 1-2, pp. 196-214 , ISSN 0021-9673,https://doi.org/10.1016/j.chroma.2007.05.024. (Year: 2007). [cited by examiner]
Ahn, Ahnert and Barabasi, Flavor Network and the Principles of Food Pairing, Scientific Reports, 2011, 1. [cited by applicant]
Breiman, Random Forests, Mach. Learn., Oct. 2001, 45(1):5-32. [cited by applicant]
Burger, Cornier, Ingebrigtsen and Johnson, Assessing Food Appeal and Desire to Eat; the Affects of Portion Size & Energy Density; International Journal of Behavioral Nutrition and Physical Activity, 2011, 8(1):101. [cited by applicant]
Cox, Moore, Vallis and Mela, Sensory and Hedonic Associations with Macronutrient and Energy Intakes of Lean and Obese Consumers, International Journal of Obesity and Related Metabolic Disorders; Journal of the Internati… [cited by applicant]
Dasarathy, Nearest Neighbor (NN) Norms: Nn Pattern Classification Techniques, IEEE Computer Society Press Tutorial, IEEE Computer Society Press, 1991. [cited by applicant]
Donaldson, Benneti, Baic, and Melichar, Taste and weight: is there a link? American Journal of Clinical Nutrition, Sep. 2009, 90(3):800S-803S. [cited by applicant]
Drewnoski and Monsivais, Present Knowledge in Nutrition, chapter 60. Taste and Food Choices, 2012, pp. 1027-1041. John Wiley & Sons, Inc, 10 edition. [cited by applicant]
Drewnowski, Brunzell, Sande, Iverius and Greenwood, Sweet tooth reconsidered: taste responsiveness In human obesity. Physiology & Behavior, 1985, 35(4):617-622. [cited by applicant]
Drewnoski, Kurth, Holden-Wiltse and Saari, Food preferences in human obesity: carbohydrates versus fats., Appetite, 1992, 18(3): 207-221. [cited by applicant]
Gearhardt, Rizk and Treat, The association of food characteristics and individual differences with ratings of craving and liking., Appetite, 2104, 79:166-173. [cited by applicant]
Glanz, Basil, Mai Bach, Goldberg and Snyder, Why americans eat what they do: Taste,nutrition, cost, convenience, and weight controlconcerns as influences on food consumption., Journal of the American Dietetic Associatio… [cited by applicant]
Hastie, Tibshirani and Friedman, The Elements of Statistical Learning. Springer Series in Statistics., 2001, Springer New York Inc., New York, Ny, USA. [cited by applicant]
Keskitalo, Tuorila, Spector, Cherkas, Knmpilia, Kaprio, Silventoinen and Perola, The three-factor eating questionnaire, body mass index, and responses to sweet and salty fatty foods: a twin study of genetic and environm… [cited by applicant]
Krebs, The gourmet ape: evolution and human food preferences., American Journal of Clinical Nutrition, Sep. 90(3). [cited by applicant]
Maffies, Grezzani, Perrone, Del Giudice, Saggese and Tato, Could the savory taste of snacks be a further risk factor for overweight in children? Journal of pediatric gastroenterology and nutrition, 2008, 46(4):429-437. [cited by applicant]
Matsunga, Doman, Hirayama, Ide, Deguchi, Murase, Tastes and textures estimation of foods based on the analysis of its ingredients list and image., In New Trends in Image Analysis and Processing-ICIAP 2015 Workshops, 201… [cited by applicant]
Mikolov, Sutskever, Chen, Corrado and Dean, Efficient estimation of word representations in vector space., In Proceedings of Workshop at ICLR, 2013. [cited by applicant]
Mojet, Heidema and Christ-Hazelhof, Taste perception with age: Generic or specific losses in supra-threshold intensities of five taste qualities?, Chemical Senses, Jun. 28(5). [cited by applicant]
Nestle, Wing, Birch, Disogra, Drewnowski, Middleton Sigman-Grant, Sobal, Winston and Economos, Behavioral and social influences on food choice., Nutrition reviews, 1998, 56{5):50-64. [cited by applicant]
Ouwehand and Papies, Eat it or beat it. the differerential effects of food temptations on overweight and normal-weight restrained eaters., Appetite, 2010, 55(1):56-60. [cited by applicant]
Pepino, Finkbeiner, Beauchamp and Mennella, Obese women have lower monosodium glutamate taste sensitivity and prefer higher concentrations than do normal-weight women., Obesity, 2010, 18{5):959-965. [cited by applicant]
Sagioglou and Greitemeyer, Individual differences in bitter taste preferences are associated with antisocial personality traits. Appetite, 2016, 96:299-308. [cited by applicant]
Teng, Lin and Adamic, Recipe recommendation using ingredient networks. In Proceedings of the 4th Annual ACM Web Science Conference, 2012, pp. 298-307. ACM. [cited by applicant]
Togo, Osler, Sorenson and Heitmann, Food intake patterns and body mass index in observational studies Intemational journal of obesity and related metabolic disorders: journal of the International Association for the Stu… [cited by applicant]
Tucker, Edlinger, Craig and Maties, Associations between bmi and fat taste sensitivity in humans. Chemical senses, 2014, 39(4):349-357. [cited by applicant]
U.S. Department of Agriculture, Agricultural Research Service. USDA National Nutrient Database for Standard Reference, Release 27. 2014_ Nutrient Data Laboratory Home Page, http://www.ars.usda.gov/ba/bhnrc/ndl. [cited by applicant]
Wang, Kumar, Thome, Cord and Precioso, Recipe recognition with large multimodal food dataset In Multimedia & Expo Workshops (ICMEW), 2015 IEEE International Conference on, 2015, pp. 1-6. IEEE. [cited by applicant]