IP Library Granted Patent US 10,521,708
Granted Patent B2
US 10,521,708 · App. 16/024,419 · Granted Dec 31, 2019

Information management system for product ingredients to allow regulatory compliance checks

Inventors: Ronak Sheth (Chicago, IL); Anton Xavier (Chicago, IL); Dagan Xavier (Chicago, IL); Dheeraj Patri (Chicago, IL); Tyler Trollinger (Chicago, IL); Harrison Nguyen (Chicago, IL); John Castaldo (Chicago, IL); Jeffrey Williams (Chicago, IL); Abbie Bys (Chicago, IL); Paul Hutchinson (Chicago, IL); James Shedlick (Chicago, IL); Jack Mallers (Chicago, IL)
Assignee: Label Insight, Inc.
G06K19/06037G06F17/277G06F17/2725G06K7/10861G06K7/1417G06Q10/087G06K9/325G06K2209/17
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,521,708
App. No.
16/024,419
Granted
Dec 31, 2019
Kind
B2
Abstract

An ingredient data system that ingests text and graphics of product labels associated with consumer products to check compliance with rules pertaining to what can be included on the product labels generally includes a memory having instructions stored thereon, and at least one processor to execute the instructions to transmit via a network a representation of a label view to a user interface on a client computing device that displays one or more of the base attributes associated with the first request, at least a portion of each of the images of one or more of the product labels of the consumer products designated under one or more of the base attributes associated with the first request, and at least a portion of details of noncompliance when one or more of the pieces of the constituent information are identified as impermissible according to the compliance information.

Claims (43)

1. An ingredient data system that ingests text and graphics of product labels associated with consumer products to check compliance with rules pertaining to what can be included on the product labels, the system comprising:

a memory having instructions stored thereon; and

at least one processor to execute the instructions to:

process and parse the text and graphics of images of the product labels to identify at least one piece of constituent information from the text and graphics, associate one or more base attributes to each piece of the constituent information, and assign one or more of the base attributes to one or more master attributes that are descriptive of one of claims, ingredients, and nutritional information of one or more of the consumer products having the product labels;

store in a database the images of one or more of the product labels, one or more of the base attributes, and one or more of the master attributes associated with each of the product labels of the consumer products, wherein the database also stores compliance information related to one or more of the consumer products;

receive a first request about one or more of the consumer products having at least one or more of the base attributes;

retrieve at least a portion of one of one or more of the images of the product labels from the database based on one or more of the base attributes associated with the first request and the compliance information for each of the product labels associated with the consumer products; and

transmit via a network a representation of a label view to a user interface on a client computing device that displays one or more of the base attributes associated with the first request, at least a portion of each of the images of one or more of the product labels of the consumer products designated under one or more of the base attributes associated with the first request, and at least a portion of details of noncompliance when one or more of the pieces of the constituent information are identified as impermissible according to the compliance information.

2. The system of claim 1 , wherein the at least one processor further executes the instructions to:

receive a second request about one or more of the pieces of the constituent information identified as impermissible according to the compliance information; and

transmit, in response to the second request, a representation of the label view to the user interface on the client computing device that displays at least a portion of the details of the noncompliance including constituent information determined to be impermissible in one or more of the product labels associated with the first request according to the compliance information.

3. The system of claim 1 , wherein one or more of the master attributes associated with the first request provide information displayed on the user interface to the client device other than in the text and graphics of the product labels of the consumer products having the associated one or more master attributes.

4. The system of claim 2 , wherein an impermissible piece of the constituent information according to the compliance information includes constituent information identified as being one of subject to a recall, subject to a ban, and subject to an investigation.

5. The system of claim 4 , wherein the compliance information is based on rules promulgated by a rulemaking authority associated with the consumer products associated with the first request.

6. The system of claim 5 , wherein the first request originates from a jurisdiction that empowers the rulemaking authority.

7. The system of claim 6 , wherein the rulemaking authority is the Food and Drug Administration (FDA) and the jurisdiction is the United States of America.

8. The system of claim 6 , wherein the rulemaking authority is the European Food Safety Authority (EFSA) and the jurisdiction is the European Union.

9. The system of claim 5 , wherein the rulemaking authority is the World Health Organization.

10. The system of claim 5 , wherein the rulemaking authority is a Non-Government Organization.

11. The system of claim 2 , wherein the at least one processor further executes the instructions to:

generate and populate a first layer of information that includes in combination, at least a portion of the images of one or more of the product labels, one or more of the base attributes associated with the constituent information identified in the text and graphics on one or more of the product labels, and one or more of the master attributes associated with the one or more of the base attributes;

generate and populate a second layer of information with information from the first layer of information and receive changes to the second layer of information via the user interface; and

transmit a representation of the label view to the user interface to display at least the second layer of information with the changes from the user interface.

12. The system of claim 11 , wherein the at least one processor further executes the instructions to accept changes via the user interface to the second layer of information while preventing changes to the first layer of information via the user interface.

13. The system of claim 11 , wherein the at least one processor further executes the instructions to transmit the representation of the label view to the user interface to display in the label view at least a portion of the first layer of information, at least a portion of the second layer of information with the changes from the user interface, and at least a portion of the details of the noncompliance including constituent information determined to be impermissible in one or more of the product labels associated with the first request in accordance with the compliance information after the changes to the second layer of information.

14. The system of claim 1 , wherein the label view is accessible via the user interface from the client device that is selected from a group consisting of at least one of a smartphone, a handheld scanner, a kiosk by the consumer, a wearable, and a computer.

15. The system of claim 1 , wherein the consumer products having the product labels are selected from a group consisting of at least one of foods, beverages, consumer packaged goods, and personal items.

16. An ingredient data system that ingests text and graphics of product labels associated with consumer products to check compliance with rules pertaining to what can be included on the product labels, the system comprising:

a memory having instructions stored thereon; and

at least one processor to execute the instructions to:

process and parse the text and graphics of images of the product labels to identify at least one piece of constituent information from the text and graphics, associate one or more base attributes to each piece of the constituent information, and assign one or more of the base attributes to one or more master attributes that are descriptive of one of claims, ingredients, and nutritional information of one or more of the consumer products having the product labels;

store in a database the images of one or more of the product labels, one or more of the base attributes, and one or more of the master attributes associated with each of the product labels of the consumer products, wherein the database also stores compliance information related to one or more of the consumer products based on information from the Food and Drug Administration (FDA);

receive a first request about one or more of the consumer products having at least one or more of the base attributes;

retrieve at least a portion of one of one or more of the images of the product labels from the database based on one or more of the base attributes associated with the first request and the compliance information for each of the product labels associated with the consumer products; and

transmit via a network a representation of a label view to a user interface on a client computing device that displays one or more of the base attributes associated with the first request, at least a portion of each of the images of one or more of the product labels of the consumer products associated with one or more of the base attributes associated with the first request, and at least a portion of details of noncompliance when at least one of the pieces of the constituent information are identified as impermissible according to the compliance information including which of the at least one piece of constituent information set forth in one or more of the product labels associated with the first request is impermissible according to the compliance information, wherein the at least one piece of constituent information is determined to be impermissible according to the compliance information when identified as being one of subject to a recall, subject to a ban, and subject to an investigation.

17. The system of claim 16 , wherein one or more of the master attributes associated with the first request provide information via the user interface to the client device other than in the text and graphics of the product labels of the consumer products designated under the one or more master attributes.

18. The system of claim 16 , wherein the at least one processor further executes the instructions to:

generate and populate a first layer of information that includes in combination, at least a portion of the images of one or more of the product labels, one or more of the base attributes associated with the constituent information identified in the text and graphics on one or more of the product labels, and one or more of the master attributes associated with the one or more of the base attributes;

generate and populate a second layer of information with information from the first layer of information and receive changes to the second layer of information via the user interface; and

transmit contents of the label view to the user interface to display at least the second layer of information with the changes from the user interface while preventing changes to the first layer of information via the user interface.

19. The system of claim 18 , wherein the at least one processor further executes the instructions to transmit a representation of the label view to the user interface to display in the label view at least a portion of the first layer of information, at least a portion of the second layer of information with the changes from the user interface, and at least a portion of the details of the noncompliance including constituent information determined to be impermissible in one or more of the product labels associated with the first request in accordance with the compliance information after the changes to the second layer of information.

20. The system of claim 16 , wherein the label view is accessible via the user interface from the client device that is selected from a group consisting of at least one of a smartphone, a handheld scanner, a kiosk by the consumer, a wearable, and a computer.

21. The system of claim 16 , wherein the consumer products having the product labels are selected from a group consisting of at least one of foods, beverages, consumer packaged goods, and personal items.

Assignments (5)
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Dec 16, 2022
From: NIELSEN CONSUMER LLC
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 062142/0346 →
MERGER Recorded Dec 16, 2021
From: LABEL INSIGHT, INC.
To: NIELSEN CONSUMER LLC
Reel/Frame 058522/0851 →
RELEASE OF SECURITY INTEREST Recorded May 18, 2021
From: COMERICA BANK
To: LABEL INSIGHT, INC.
Reel/Frame 056275/0320 →
SECURITY INTEREST Recorded Mar 18, 2020
From: LABEL INSIGHT, INC.
To: COMERICA BANK
Reel/Frame 052157/0927 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2019
From: SHETH, RONAK; XAVIER, ANTON; XAVIER, DAGAN; PATRI, DHEERAJ; TROLLINGER, TYLER; NGUYEN, HARRISON; WILLIAMS, JEFFREY; BYS, ABBIE; HUTCHINSON, PAUL; SHEDLICK, JAMES; MALLERS, JACK
To: LABEL INSIGHT, INC.
Reel/Frame 050221/0606 →