IP Library › Granted Patent US 11,810,344
Granted Patent B2
US 11,810,344 · App. 17/401,814 · Granted Nov 7, 2023

Image recognition system

Inventors: Jason Lee Ertle (Portland, OR); Kevin L. Hofstee (Portland, OR); Shane K. Luke (Portland, OR)
Assignee: NIKE, Inc.
G06V20/10G06F18/2413G06T7/74G06V10/28G06V10/44G06V10/764G06F18/24323G06T2200/24G06V10/141G06V10/143G06V2201/09
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,810,344
App. No.
17/401,814
Granted
Nov 7, 2023
Kind
B2
Abstract

Systems and methods for predicting items within content and using improved, fine-grained image classification techniques to produce images used to identify consumer products in the real-world by allowing for the recognition of a product using an image captured under a variety of conditions and environments, such as angles, lighting, camera settings, and the like.

Claims (63)

1. A method, comprising:

extracting, by a computing device, one or more image frames from image data corresponding to an object;

modifying the one or more image frames to extract background information;

determining, based on the one or more modified image frames, object identification information; and

using the object identification information to identify the object.

2. The method of claim 1 , further comprising:

receiving, by the computing device, input data indicating product information; and

associating the product information with the image data corresponding to the object.

3. The method of claim 1 , further comprising:

sending, to a second computing device, the image data corresponding to the object to verify an identification of the object.

4. The method of claim 3 , wherein sending the image data further comprises:

determining that a processing threshold for the computing device has been exceeded; and

sending, to the second computing device, the image data corresponding to the object.

5. The method of claim 1 , wherein using the object identification information to identify the object further comprises:

determining a product corresponding to the identified object; and

determining a confidence level associated with the product and the identified object.

6. The method of claim 1 , further comprising:

determining one or more products corresponding to the identified object; and

determining inventory data associated with the one or more products corresponding to the identified object.

7. The method of claim 1 , wherein modifying the one or more image frames to extract background information further comprises:

using at least a first image frame to determine a pixel boundary of the object.

8. An apparatus comprising:

one or more processors; and

memory storing instructions that, when executed, cause the apparatus to:

extract, from image data corresponding to an object, one or more image frames;

modify the one or more image frames to extract background information;

determine, based on the one or more modified image frames, object identification information; and

use the object identification information to identify the object.

9. The apparatus of claim 8 , wherein the instructions, when executed, further cause the apparatus to:

receive input data indicating product information; and

associate the product information with the image data corresponding to the object.

10. The apparatus of claim 8 , wherein the instructions, when executed, further cause the apparatus to:

send, to a second computing device, the image data corresponding to the object to verify an identification of the object.

11. The apparatus of claim 10 , wherein the instructions, when executed, further cause the apparatus to send the image data by causing the apparatus to:

determine that a processing threshold for the apparatus has been exceeded; and

send, to a computing device, the image data corresponding to the object.

12. The apparatus of claim 8 , wherein the instructions, when executed, further cause the apparatus to:

determine a product corresponding to the identified object; and

determine a confidence level associated with the product and the identified object.

13. The apparatus of claim 8 , wherein the instructions, when executed, further cause the apparatus to:

determine one or more products corresponding to the identified object; and

determine inventory data associated with the one or more products corresponding to the identified object.

14. The apparatus of claim 8 , wherein the instructions, when executed, further cause the apparatus to modify the one or more image frames to extract background information by causing the apparatus to:

use at least a first image frame to determine a pixel boundary of the object.

15. A non-transitory machine readable medium storing instructions that, when executed, cause a first computing device to:

extract, from image data corresponding to an object, one or more image frames;

modify the one or more image frames to extract background information;

determine, based on the one or more modified image frames, object identification information; and

use the object identification information to identify the object.

16. The non-transitory machine readable medium of claim 15 , wherein the instructions, when executed, further cause the first computing device to:

receive input data indicating product information; and

associate the product information with the image data corresponding to the object.

17. The non-transitory machine readable medium of claim 16 , wherein the instructions, when executed, further cause the first computing device to:

send, to a second computing device, the image data corresponding to the object to verify an identification of the object.

18. The non-transitory machine readable medium of claim 15 , wherein the instructions, when executed, further cause the first computing device to send the image data by:

determining that a processing threshold for the first computing device has been exceeded; and

sending, to a second computing device, the image data corresponding to the object.

19. The non-transitory machine readable medium of claim 15 , wherein the instructions, when executed, further cause the first computing device to:

determine a product corresponding to the identified object; and

determine a confidence level associated with the product and the identified object.

20. The non-transitory machine readable medium of claim 15 , wherein the instructions, when executed, further cause the first computing device to:

determine one or more products corresponding to the identified object; and

determine inventory data associated with the one or more products corresponding to the identified object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2021
From: ERTLE, JASON LEE; HOFSTEE, KEVIN L.; LUKE, SHANE K.
To: NIKE, INC.
Reel/Frame 057213/0614 →
Continuity (3)
Continuation 16169774 · Oct 24, 2018
Provisional Application 62576250 · Oct 24, 2017
Related Publication 20210374992A1 · Dec 2, 2021