IP Library › Granted Patent US 10,002,307
Granted Patent B2
US 10,002,307 · App. 15/164,760 · Granted Jun 19, 2018

Suggestion generation based on data extraction

Inventors: Jonathan Zaremski (San Mateo, CA); Michael Griffin (Redwood City, CA)
Assignee: Ricoh Co., Ltd.
G06K9/4604G06K9/6267G06Q10/087
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,002,307
App. No.
15/164,760
Filed
May 25, 2016
Granted
Jun 19, 2018
Kind
B2
Art Unit
2665
USPC
382/190
Abstract

The disclosure includes a system and method for classifying conditions of a data stream of object information. An image recognition receives an image and identifies a plurality of objects from the image. The image recognition application generates a data stream including information about the plurality of objects. The image recognition application generates a score based on the information about the plurality of products, determines a condition from the data stream based on the score, and generates a suggestion based on the condition. The image recognition application further provides the suggestion to a user.

Claims (70)

1. A method comprising:

receiving, by one or more processors, an image;

identifying, by the one or more processors, a plurality of objects from the image;

generating, by the one or more processors, a time-series based data stream including information about the plurality of objects;

determining, by the one or more processors, one or more conditions from the time-series based data stream by overlaying the image onto a planogram image to obtain non-overlapping position information of the plurality of objects;

identifying a first number of corrective actions from the time-series based data stream, the first number of corrective actions relating to the one or more conditions;

identifying, from the first number of corrective actions, a second number of repeating corrective actions that were previously identified from a previously generated time-series based data stream;

generating, by the one or more processors, a score based on the first number of corrective actions and the second number of repeating corrective actions;

generating, by the one or more processors, a suggestion based on the one or more conditions; and

providing, by the one or more processors, the suggestion and the score to a user along with a graphical guide that overlays on the image for identification of the one or more conditions, the suggestion including advice for performing a corrective action.

2. The method of claim 1 , wherein the score

indicates a measure of follow-through on the first number of corrective actions during a time period between a first time when the previously generated time-series based data stream was generated and a second time when the time-series based data stream is generated.

3. The method of claim 1 , further comprising:

generating a new time-series based data stream including information about the plurality of objects at a third time;

identifying a third number of repeating corrective actions using the first number of corrective actions, the second number of repeating corrective actions, and the new time-series based data stream; and

generating the score based on the third number of repeating corrective actions.

4. The method of claim 1 , further comprising determining a representative performance condition based on the score.

5. The method of claim 4 , wherein determining the representative performance condition comprises:

determining an average percentage of a shelf space that the plurality of objects occupy in a time period;

receiving a targeted percentage of the shelf space that the plurality of objects are expected to occupy in the time period; and

comparing the average percentage and the targeted percentage.

6. The method of claim 1 , wherein the one or more conditions are selected from the group of an out of stock condition, a product recall condition, a position map condition, and a new product condition.

7. The method of claim 1 , wherein providing the suggestion to the user comprises a notification, the notification identifying the one or more conditions and a portion of data in the time-series based data stream that is associated with the one or more conditions.

8. A system comprising;

one or more processors; and

a memory, the memory storing instructions, which when executed cause the one or more processor to:

receive an image;

identify a plurality of objects from the image;

generate a time-series based data stream including information about the plurality of objects;

determine one or more conditions from the time-series based data stream by overlaying the image onto a planogram image to obtain non-overlapping position information of the plurality of objects;

identify a first number of corrective actions from the time-series based data stream, the first number of corrective actions relating to the one or more conditions;

identify, from the first number of corrective actions, a second number of repeating corrective actions that were previously identified from a previously generated time-series based data stream;

generate, by the one or more processors, a score based on the first number of corrective actions and the second number of repeating corrective actions;

generate a suggestion based on the one or more conditions; and

provide the suggestion and the score to a user along with a graphical guide that overlays on the image for identification of the one or more conditions, the suggestion including advice for performing a corrective action.

9. The system of claim 8 , wherein the score

indicates a measure of follow-through on the first number of corrective actions during a time period between a first time when the previously generated time-series based data stream was generated and a second time when the time-series based data stream is generated.

10. The system of claim 8 , wherein the instructions cause the one or more processors to:

generate a new time-series based data stream including information about the plurality of objects at a third time;

identify a third number of repeating corrective actions using the first number of corrective actions, the second number of repeating corrective actions, and the new time-series based data stream; and

generate the score based on the third number of repeating corrective actions.

11. The system of claim 8 , wherein the instructions cause the one or more processors to determine a representative performance condition based on the score.

12. The system of claim 11 , wherein to determine the representative performance condition, the instructions cause the one or more processors to:

determine an average percentage of a shelf space that the plurality of objects occupy in a time period;

receive a targeted percentage of the shelf space that the plurality of objects are expected to occupy in the time period; and

compare the average percentage and the targeted percentage.

13. The system of claim 8 , wherein the one or more conditions are selected from the group of an out of stock condition, a product recall condition, a position map condition, and a new product condition.

14. The system of claim 8 , wherein providing the suggestion to the user comprises a notification, the notification identifying the one or more conditions and a portion of data in the time-series based data stream that is associated with the one or more conditions.

15. A computer program product comprising a non-transitory computer readable medium storing a computer readable program, wherein the computer readable program, when executed, causes a computer to perform operations comprising:

receiving an image;

identifying a plurality of objects from the image;

generating a time-series based data stream including information about the plurality of objects;

determining one or more conditions from the time-series based data stream by overlaying the image onto a planogram image to obtain non-overlapping position information of the plurality of objects;

identifying a first number of corrective actions from the time-series based data stream, the first number of corrective actions relating to the one or more conditions;

identifying, from the first number of corrective actions, a second number of repeating corrective actions that were previously identified from a previously generated time-series based data stream;

generating, by the one or more processors, a score based on the first number of corrective actions and the second number of repeating corrective actions;

generating a suggestion based on the one or more conditions; and

providing the suggestion and the score to a user along with a graphical guide that overlays on the image for identification of the one or more conditions, the suggestion including advice for performing a corrective action.

16. The computer program product of claim 15 , wherein the score

indicates a measure of follow-through on the first number of corrective actions during a time period between a first time when the previously generated time-series based data stream was generated and a second time when the time-series based data stream is generated.

17. The computer program product of claim 15 , wherein the computer readable program causes the computer to perform operations comprising:

generating a new time-series based data stream including information about the plurality of objects at a third time;

identifying a third number of repeating corrective actions using the first number of corrective actions, the second number of repeating corrective actions, and the new time-series based data stream; and

generating the score based on the third number of repeating corrective actions.

18. The computer program product of claim 15 , wherein the computer readable program causes the computer to perform operations comprising determining a representative performance condition based on the score.

19. The computer program product of claim 18 , wherein to determine the representative performance condition, the computer readable program causes the computer to perform operations comprising:

determining an average percentage of a shelf space that the plurality of objects occupy in a time period;

receiving a targeted percentage of the shelf space that the plurality of objects are expected to occupy in the time period; and

comparing the average percentage and the targeted percentage.

20. The computer program product of claim 15 , wherein the one or more conditions are selected from the group of an out of stock condition, a product recall condition, a position map condition, and a new product condition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2016
From: ZAREMSKI, JONATHAN; GRIFFIN, MICHAEL
To: RICOH COMPANY, LTD.
Reel/Frame 038736/0267 →
Continuity (2)
Provisional Application 62269900 · Dec 18, 2015
Related Publication 20170177969A1 · Jun 22, 2017
Cited By (1)
US 12,327,061