IP Library Granted Patent US 11,250,457
Granted Patent B1
US 11,250,457 · App. 16/800,954 · Granted Feb 15, 2022

Promotion processing system for generating a digital promotion based upon a satisfaction level determined from a facial image and related methods

Inventors: Alise Raak (Winston-Salem, NC); Diana Medina (Winston-Salem, NC)
Assignee: INMAR CLEARING, INC.
G06Q30/0224G06F16/5854G06F16/951G06K9/00281G06K9/00302G06Q30/0239
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,250,457
App. No.
16/800,954
Granted
Feb 15, 2022
Kind
B1
Abstract

A promotion processing system may include a remote device associated with a given user and that includes a camera. The promotion processing system may also include a promotion processing server configured to store meal recipes and associated ingredients, and obtain a selected meal recipe from the given user. The promotion processing server may also be configured to cooperate with the camera of the remote device to obtain a facial image of the given user during consumption of ingredients of the selected meal recipe, determine a satisfaction level with the selected meal recipe based upon the facial image, and generate a digital promotion toward another meal recipe having at least one common ingredient with the ingredients of the selected meal recipe based upon the satisfaction level. The promotion processing server may also communicate the digital promotion to the remote device.

Claims (56)

1. A promotion processing system comprising:

a remote device associated with a given user and comprising a camera; and

a promotion processing server configured to

store a plurality of meal recipes and associated ingredients,

obtain a selected meal recipe from the given user,

cooperate with the camera of the remote device to obtain a facial image of the given user during consumption of ingredients of the selected meal recipe,

apply image processing to the facial image to extract a plurality of facial features,

apply machine learning to determine a facial expression of the given user during consumption of the ingredients based upon mapping the plurality of facial features using a regression algorithm, and

determine a satisfaction level with the selected meal recipe based upon the facial expression,

generate a digital promotion toward another meal recipe having at least one common ingredient with the ingredients of the selected meal recipe based upon the satisfaction level, and

communicate the digital promotion to the remote device.

2. The promotion processing system of claim 1 wherein at least one of the plurality of facial features comprises a visibility of teeth.

3. The promotion processing system of claim 1 wherein at least one of the plurality of facial features comprises a mouth-opening distance.

4. The promotion processing system of claim 1 wherein at least one of the plurality of facial features comprises an eyebrow raise distance.

5. The promotion processing system of claim 1 wherein the at least one digital promotion has a redemption value associated therewith; and wherein the promotion processing server is configured to set the redemption value based upon the satisfaction level.

6. The promotion processing system of claim 1 wherein the promotion processing server is configured to determine the another meal recipe based upon the satisfaction level.

7. The promotion processing system of claim 1 wherein the promotion processing server is configured to communicate the another meal recipe to the remote device.

8. The promotion processing system of claim 1 wherein the digital promotion is redeemable toward the common ingredient of the another meal recipe.

9. The promotion processing system of claim 1 wherein the promotion processing server is configured to obtain the selected meal recipe based upon user input at the remote device.

10. The promotion processing system of claim 1 wherein the remote device comprises a mobile wireless communications device.

11. A promotion processing server comprising:

a processor and an associated memory configured to

store a plurality of meal recipes and associated ingredients,

obtain a selected meal recipe from a given user,

cooperate with a camera of a remote device associated with the given user to obtain a facial image of the given user during consumption of ingredients of the selected meal recipe,

apply image processing to the facial image to extract a plurality of facial features,

apply machine learning to determine a facial expression of the given user during consumption of the ingredients based upon mapping the plurality of facial features using a regression algorithm, and

determine a satisfaction level with the selected meal recipe based upon the facial expression,

generate a digital promotion toward another meal recipe having at least one common ingredient with the ingredients of the selected meal recipe based upon the satisfaction level, and

communicate the digital promotion to the remote device.

12. The promotion processing server of claim 11 wherein the at least one digital promotion has a redemption value associated therewith; and wherein the processor is configured to set the redemption value based upon the satisfaction level.

13. The promotion processing server of claim 11 wherein the processor is configured to determine the another meal recipe based upon the satisfaction level.

14. The promotion processing server of claim 11 wherein the processor is configured to communicate the another meal recipe to the remote device.

15. A method of processing a promotion comprising:

using a promotion processing server to

store a plurality of meal recipes and associated ingredients,

obtain a selected meal recipe from a given user,

cooperate with a camera of a remote device associated with the given user to obtain a facial image of the given user during consumption of ingredients of the selected meal recipe,

apply image processing to the facial image to extract a plurality of facial features,

apply machine learning to determine a facial expression of the given user during consumption of the ingredients based upon mapping the plurality of facial features using a regression algorithm, and

determine a satisfaction level with the selected meal recipe based upon the facial expression,

generate a digital promotion toward another meal recipe having at least one common ingredient with the ingredients of the selected meal recipe based upon the satisfaction level, and

communicate the digital promotion to the remote device.

16. The method of claim 15 wherein the at least one digital promotion has a redemption value associated therewith; and wherein using the promotion processing server comprises using the promotion processing server to set the redemption value based upon the satisfaction level.

17. The method of claim 15 wherein using the promotion processing server comprises using the promotion processing server to determine the another meal recipe based upon the satisfaction level.

18. A non-transitory computer readable medium for processing a promotion, the non-transitory computer readable medium comprising computer executable instructions that when executed by a processor cause the processor to perform operations comprising:

storing a plurality of meal recipes and associated ingredients;

obtaining a selected meal recipe from a given user;

cooperating with a camera of a remote device associated with the given user to obtain a facial image of the given user during consumption of ingredients of the selected meal recipe;

applying image processing to the facial image to extract a plurality of facial features;

applying machine learning to determine a facial expression of the given user during consumption of the ingredients based upon mapping the plurality of facial features using a regression algorithm; and

determining a satisfaction level with the selected meal recipe based upon the facial expression;

generating a digital promotion toward another meal recipe having at least one common ingredient with the ingredients of the selected meal recipe based upon the satisfaction level; and

communicating the digital promotion to the remote device.

19. The non-transitory computer readable medium of claim 18 wherein the at least one digital promotion has a redemption value associated therewith; and wherein the operations comprise setting the redemption value based upon the satisfaction level.

20. The non-transitory computer readable medium of claim 18 wherein the operations comprise determining the another meal recipe based upon the satisfaction level.

Assignments (2)
SECURITY INTEREST Recorded Jun 28, 2023
From: INMAR, INC.; INMAR SUPPLY CHAIN SOLUTIONS, LLC; AKI TECHNOLOGIES, INC.; INMAR ANALYTICS, INC.; INMAR BRAND SOLUTIONS, INC.; INMAR CLEARING, INC.; INMAR RX SOLUTIONS, INC.; INMAR - YOUTECH, LLC; QUALANEX, LLC; CAROLINA COUPON CLEARING, INC. (N/K/A INMAR CLEARING, INC.); COLLECTIVE BIAS, INC. (N/K/A INMAR BRAND SOLUTIONS, INC.); MED-TURN, INC. (N/K/A INMAR RX SOLUTIONS, INC.)
To: JEFFERIES FINANCE LLC
Reel/Frame 064148/0903 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2020
From: RAAK, ALISE; MEDINA, DIANA
To: INMAR CLEARING, INC.
Reel/Frame 052097/0878 →