IP Library Granted Patent US 12,182,703
Granted Patent B2
US 12,182,703 · App. 17/598,792 · Granted Dec 31, 2024

Methods and apparatus to detect a text region of interest in a digital image using machine-based analysis

Inventors: Roberto Arroyo (Madrid, ES); Javier Tovar Velasco (Valladolid, ES); Francisco Javier Delgado Del Hoyo (Valladolid, ES); Diego González Serrador (Valladolid, ES); Emilio Almazán (Madrid, ES); Antonio Hurtado (Valladolid, ES)
Assignee: Nielsen Consumer LLC
G06N3/08G06V10/25G06V10/82G06V20/62G06V30/413G06V30/414G06V30/416
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,182,703
App. No.
17/598,792
Granted
Dec 31, 2024
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed to analyze characteristics of text of interest using a computing system. An example apparatus includes a text detector to provide text data from a first image, the first image including a first text region of interest and a second text region not of interest, a color-coding generator to generate a plurality of color-coded text-map images, the plurality of color-coded text-map images including color-coded segments with different colors, the color-coded segments corresponding to different text characteristics, and a convolutional neural network (CNN) to determine a first location in the first image as more likely to be the first text region of interest than a second location in the first image corresponding to the second text region that is not of interest based on performing a CNN analysis on the first image and the plurality of color-coded text-map images.

Claims (42)

1. An apparatus to analyze characteristics of text of interest, the apparatus comprising:

text detector circuitry to provide text data from a first image, the first image including a first text region of interest and a second text region not of interest;

color-coding generator circuitry to generate a plurality of color-coded text-map images, the color-coded text-map images including color-coded segments with different colors, the color-coded segments corresponding to different text characteristics; and

a convolutional neural network (CNN) to:

analyze the first image and the color-coded text-map images to detect visual features;

determine a first likelihood that a first location in the first image corresponds to the first text region of interest based on the CNN analysis;

determine a second likelihood that a second location in the first image corresponds to the second text region not of interest based on the CNN analysis;

classify at least one of the first location to be in the first text region based on the first likelihood or the second location to be in the second text region based on the second likelihood; and

adjust a characteristic of the first image based on the classification.

2. The apparatus of claim 1 , wherein the color-coded text-map images include a first color-coded text-map image and a second color-coded text-map image, the first color-coded text-map image including first color-coded segments of a first color, and the second color-coded text-map image including second color-coded segments of a second color.

3. The apparatus of claim 2 , wherein the first color-coded segments correspond to a first text characteristic, and the second color-coded segments correspond to a second text characteristic.

4. The apparatus of claim 3 , wherein the first color is different than the second color.

5. The apparatus of claim 1 , wherein the CNN analysis identifies the second text region that is not of interest as separate from the first text region of interest when a same keyword appears in both the first text region of interest and the second text region that is not of interest.

6. The apparatus of claim 1 , further including an interface to provide the color-coded text-map images to the CNN via a plurality of corresponding input channels of the CNN.

7. The apparatus of claim 1 , wherein the first image is at least one of a food product label, a non-food product label, a sales receipt, a webpage, or a ticket.

8. The apparatus of claim 1 , wherein the first text region of interest includes at least one of a nutrition facts table, a list of ingredients, a product description, candidate persons, numerical dates, or percentages.

9. At least one non-transitory computer readable medium comprising computer readable instructions to cause at least one processor circuit to at least:

generate text data from a first image, the first image including a first text region of interest and a second text region not of interest;

generate a plurality of color-coded text-map images, the color-coded text-map images including color-coded segments with different colors, the color-coded segments corresponding to different text characteristics;

analyze, via a convolutional neural network (CNN), the first image and the color-coded text-map images to detect visual features:

determine a first likelihood that a first location in the first image corresponds to the first text region of interest based on the CNN analysis;

determine a second likelihood that a second location in the first image corresponds to the second text region not of interest based on the CNN analysis;

classify at least one of the first location to be in the first text region based on the first likelihood or the second location to be in the second text region based on the second likelihood; and

adjust a characteristic of the first image based on the classification.

10. The at least one non-transitory computer readable medium of claim 9 , wherein the color-coded text-map images include a first color-coded text-map image and a second color-coded text-map image, the first color-coded text-map image including first color-coded segments of a first color, and the second color-coded text-map image including second color-coded segments of a second color.

11. The at least one non-transitory computer readable medium of claim 10 , wherein the first color-coded segments correspond to a first text characteristic, and the second color-coded segments correspond to a second text characteristic.

12. The at least one non-transitory computer readable medium of claim 11 , wherein the first color is different than the second color.

13. The at least one non-transitory computer readable medium of claim 9 , wherein the computer readable instructions are to cause one or more of the at least one processor circuit to identify the second text region that is not of interest as separate from the first text region of interest when a same keyword appears in both the first text region of interest and the second text region that is not of interest.

14. The at least one non-transitory computer readable medium of claim 9 , wherein the computer readable instructions are to cause one or more of the at least one processor circuit to provide the plurality of color-coded text-map images to the CNN via a plurality of corresponding input channels of the CNN.

15. The at least one non-transitory computer readable medium of claim 9 , wherein the first image is at least one of a food product label, a non-food product label, a sales receipt, a webpage, or a ticket.

16. The at least one non-transitory computer readable medium of claim 9 , wherein the first text region of interest includes at least one of a nutrition facts table, a list of ingredients, a product description, candidate persons, numerical dates, or percentages.

17. A method to analyze characteristics of text of interest, the method comprising:

generating text data from a first image, the first image including a first text region of interest and a second text region not of interest;

generating a plurality of color-coded text-map images, the color-coded text-map images including color-coded segments with different colors, the color-coded segments corresponding to different text characteristics;

analyzing, via a convolutional neural network (CNN), the first image and the color-coded text map images to detect visual features;

determining a first likelihood that a first location in the first image to the first text region of interest based on the CNN analysis;

determining a second likelihood that a second location in the first image corresponds to the second text region not of interest based on the CNN analysis;

classify at least one of the first location to be in the first text region based on the first likelihood or the second location to be in the second text region based on the second likelihood; and

adjust a characteristic of the first image based on the classification.

18. The method of claim 17 , wherein the color-coded text-map images include a first color-coded text-map image and a second color-coded text-map image, the first color-coded text-map image including first color-coded segments of a first color, and the second color-coded text-map image including second color-coded segments of a second color.

19. The method of claim 18 , wherein the first color-coded segments correspond to a first text characteristic, and the second color-coded segments correspond to a second text characteristic.

20. The method of claim 19 , wherein the first color is different than the second color.

Assignments (3)
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Dec 16, 2022
From: NIELSEN CONSUMER LLC
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 062142/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: ARROYO, ROBERTO; VELASCO, JAVIER TOVAR; DELGADO DEL HOYO, FRANCISCO JAVIER; SERRADOR, DIEGO GONZÁLEZ; ALMAZÁN, EMILIO; HURTADO, ANTONIO
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 059773/0761 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: THE NIELSEN COMPANY (US), LLC
To: NIELSEN CONSUMER LLC
Reel/Frame 059773/0881 →