IP Library Granted Patent US 12,333,813
Granted Patent B2
US 12,333,813 · App. 17/914,745 · Granted Jun 17, 2025

Apparatus and method to facilitate identification of items

Inventor: Joshua M. Horowitz (Brooklyn, NY)
Assignee: Walmart Apollo, LLC
G06V20/52G06F16/53G06V10/762G06V20/50G06V20/70G06Q10/087
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,813
App. No.
17/914,745
Granted
Jun 17, 2025
Kind
B2
Abstract

A control circuit accesses a digitized image of a particular item and then processes that digitized image to thereby assign various aspects of the digitized image to various dimensions in N-dimensional Euclidean space to thereby provide an N-dimensional representation. The control circuit then accesses a database containing a plurality of various clustered groups of N-dimensional representations. At least some of the clustered groups have a corresponding identifying label. Conducting a nearest neighbor search serves to identify a clustered group to which the particular item most likely belongs to thereby provide an identified cluster group. When the identified cluster group does not have a corresponding identifying label, the control circuit can then further determine whether a predetermined condition has also been met. When true, the control circuit alerts a user via a user interface that the identified cluster group should be assigned an identifying label.

Claims (22)

1. A method comprising:

by a control circuit:

accessing a digitized image of a particular item, wherein the particular item is an item being offered for sale at retail;

processing the digitized image to thereby assign various aspects of the digitized image to various dimensions in N-dimensional Euclidian space to thereby provide an N-dimensional representation (where N comprises an integer);

accessing a database containing a plurality of clustered groups of other N-dimensional representations, wherein at least some of the clustered groups have a corresponding identifying label, and conducting a nearest neighbor search to identify a clustered group to which the particular item most likely belongs to thereby provide an identified clustered group;

when the identified clustered group does not have a corresponding identifying label, determining whether the identified clustered group that does not have a corresponding identifying label has at least a predetermined number of members, wherein the predetermined number of members is an integer greater than one;

when the identified clustered group that does not have a corresponding identifying label does have at least the predetermined number of members, alerting a user via a user interface that the identified clustered group should be assigned an identifying label.

2. The method of claim 1 wherein Nis an even number.

3. The method of claim 2 wherein N equals 512.

4. The method of claim 1 wherein the corresponding identifying label for any given one of the plurality of clustered groups identifies any item that corresponds to that clustered group.

5. An apparatus comprising:

a memory having stored therein a database containing a plurality of clustered groups of N-dimensional image representations, wherein at least some of the clustered groups have a corresponding identifying label;

a user interface;

a control circuit operably coupled to the memory and the user interface and configured to:

access a digitized image of a particular item, wherein the particular item is an item being offered for sale at retail;

process the digitized image to thereby assign various aspects of the digitized image to various dimensions in N-dimensional Euclidian space to thereby provide an N-dimensional image representation (where N comprises an integer);

access the database and conduct a nearest neighbor search to identify a clustered group to which the particular item most likely belongs to thereby provide an identified clustered group;

when the identified clustered group does not have a corresponding identifying label, determine whether the identified clustered group that does not have a corresponding identifying label has at least a predetermined number of members, wherein the predetermined number of members is an integer greater than one;

when the identified clustered group that does not have a corresponding identifying label does have at least the predetermined number of members, alert a user via a user interface that the identified clustered group should be assigned an identifying label.

6. The apparatus of claim 5 wherein N is an even number.

7. The apparatus of claim 6 wherein N equals 512.

8. The apparatus of claim 5 wherein the corresponding identifying label for any given one of the plurality of clustered groups identifies any item that corresponds to that clustered group.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2022
From: HOROWITZ, JOSHUA M.
To: WALMART APOLLO, LLC
Reel/Frame 061244/0808 →
Continuity (2)
Provisional Application 63000029 · Mar 26, 2020
Related Publication 20230129852A1 · Apr 27, 2023
References Cited (102)
US 6142317A · Merl · 2000 [cited by applicant]
US 7631808B2 · Kundu · 2009 [cited by applicant]
US 7909248B1 · Goncalves · 2011 [cited by applicant]
US 7962365B2 · Bobbitt · 2011 [cited by applicant]
US 8068674B2 · Goncalves · 2011 [cited by applicant]
US 8196822B2 · Goncalves · 2012 [cited by applicant]
US 8233702B2 · Gokturk · 2012 [cited by applicant]
US 8260456B2 · Siegel · 2012 [cited by applicant]
US 8448858B1 · Kundu · 2013 [cited by applicant]
US 8494909B2 · Goncalves · 2013 [cited by applicant]
US 8577136B1 · Ascher · 2013 [cited by applicant]
US 8582802B2 · Clippard · 2013 [cited by examiner]
US 9299229B2 · Bobbitt · 2016 [cited by applicant]
US 9589433B1 · Thramann · 2017 [cited by applicant]
US 9727838B2 · Campbell · 2017 [cited by applicant]
US 9740955B2 · Shi · 2017 [cited by applicant]
US 9820584B2 · Hardy · 2017 [cited by applicant]
US 10074016B2 · Migdal · 2018 [cited by applicant]
US 10192208B1 · Catoe · 2019 [cited by applicant]
US 10349755B2 · Dipaolo · 2019 [cited by applicant]
US 10430776B2 · Svetal · 2019 [cited by applicant]
US 10614514B2 · Glaser · 2020 [cited by applicant]
US 10963692B1 · Corcoran · 2021 [cited by examiner]
US 11375827B2 · Yang · 2022 [cited by applicant]
US 20050021512A1 · Koenig · 2005 [cited by examiner]
US 20090039164A1 · Herwig · 2009 [cited by applicant]
US 20090090583A1 · Bonner · 2009 [cited by applicant]
US 20090272801A1 · Connell, II · 2009 [cited by applicant]
US 20100023497A1 · Magdy · 2010 [cited by examiner]
US 20100067745A1 · Kovtun · 2010 [cited by examiner]
US 20100171826A1 · Hamilton · 2010 [cited by applicant]
US 20100217678A1 · Goncalves · 2010 [cited by applicant]
US 20110215147A1 · Goncalves · 2011 [cited by applicant]
US 20110286628A1 · Goncalves · 2011 [cited by applicant]
US 20120203647A1 · Smith · 2012 [cited by applicant]
US 20120280040A1 · Carney · 2012 [cited by applicant]
US 20120310781A1 · Battle · 2012 [cited by applicant]
US 20120321146A1 · Kundu · 2012 [cited by applicant]
US 20130066592A1 · Aupetit · 2013 [cited by examiner]
US 20130235206A1 · Smith · 2013 [cited by applicant]
US 20140129395A1 · Groenovelt · 2014 [cited by applicant]
US 20140180865A1 · Argue · 2014 [cited by applicant]
US 20150002675A1 · Kundu · 2015 [cited by applicant]
US 20150088703A1 · Yan · 2015 [cited by applicant]
US 20150221191A1 · Doyle · 2015 [cited by applicant]
US 20150242805A1 · Sakurai · 2015 [cited by applicant]
US 20150262116A1 · Katircioglu · 2015 [cited by applicant]
US 20160110786A1 · Herring · 2016 [cited by applicant]
US 20160132910A1 · Appel · 2016 [cited by applicant]
US 20160187199A1 · Brunk · 2016 [cited by applicant]
US 20160224857A1 · Zhang · 2016 [cited by applicant]
US 20170178061A1 · Griffin · 2017 [cited by applicant]
US 20170249491A1 · MacIntosh · 2017 [cited by applicant]
US 20170262910A1 · Allen · 2017 [cited by applicant]
US 20170286773A1 · Skaff · 2017 [cited by applicant]
US 20170330059A1 · Novotny · 2017 [cited by applicant]
US 20170337508A1 · Bogolea · 2017 [cited by applicant]
US 20180096567A1 · Farrow · 2018 [cited by applicant]
US 20180110345A1 · Sun · 2018 [cited by applicant]
US 20180153313A1 · Padvoiskis · 2018 [cited by applicant]
US 20190057435A1 · Chomley · 2019 [cited by applicant]
US 20190087772A1 · Medina · 2019 [cited by applicant]
US 20190156152A1 · Scott · 2019 [cited by applicant]
US 20190197560A1 · Migdal · 2019 [cited by applicant]
US 20190220690A1 · Johnson · 2019 [cited by applicant]
US 20190236684A1 · Davis · 2019 [cited by applicant]
US 20200005225A1 · Chaubard · 2020 [cited by applicant]
US 20200184270A1 · Omer · 2020 [cited by applicant]
US 20210241208A1 · Tang · 2021 [cited by applicant]
US 20230120798A1 · Palande · 2023 [cited by applicant]
US 20230131444A1 · Palande · 2023 [cited by applicant]
US 20230177458A1 · Kim · 2023 [cited by applicant]
US 20230252407A1 · Kim · 2023 [cited by applicant]
US 20230368175A1 · Coverstone · 2023 [cited by applicant]
WO WO2009061434A1 · 2009 [cited by examiner]
WO 2018203512A1 · 2018 [cited by applicant]
WO 2019013711 · 2019 [cited by applicant]
WO 2019140091A1 · 2019 [cited by applicant]
WO 2021194882 · 2021 [cited by applicant]
WO 2021195314 · 2021 [cited by applicant]
WO 2021195523 · 2021 [cited by applicant]
WO 2021216329 · 2021 [cited by applicant]
WO 2021216357 · 2021 [cited by applicant]
Schroff, F.—“FaceNet: A Unified Embedding for Face Recognition and Clustering”—CVPR 2015, pp. 815-823 (Year: 2015). [cited by examiner]
PCT; App. No. PCT/US2021/024052; International Search Report and Written Opinion mailed Jun. 4, 2021; (12 pages). [cited by applicant]
PCT; App. No. PCT/US2021/024052; International Preliminary Report on Patentability mailed Oct. 6, 2022; (6 pages). [cited by applicant]
PCT; App. No. PCT/US2021/023207; International Preliminary Report on Patentability mailed Oct. 6, 2022; (7pages). [cited by applicant]
PCT; App. No. PCT/US2021/023207; International Search Report and Written Opinion mailed Jun. 8, 2021; (14 pages). [cited by applicant]
PCT; App. No. PCT/US2021/024403; International Preliminary Report on Patentability mailed Oct. 6, 2022; (11 pages). [cited by applicant]
PCT; App. No. PCT/US2021/024403; International Search Report and Written Opinion mailed Jul. 1, 2021; (20 pages). [cited by applicant]
Sridhar et al. “Real-time joint tracking of a hand manipulating an object from rgb-d input.” European Conference on Computer Vision. Springer, Cham, 2016. Oct. 16, 2016 (Oct. 16, 2016) Retrieved on May 30, 2021 (May 30,… [cited by applicant]
PCT; App. No. PCT/US2021/027199; International Search Report and Written Opinion mailed Aug. 11, 2021; (21 pages). [cited by applicant]
PCT; App. No. PCT/US2021/027199; International Preliminary Report on Patentability mailed Nov. 3, 2022; (14 pages). [cited by applicant]
Infosearch; “Image Annotation, Tagging & Data Annotation, Labeling Services for Machine Learning”; <https://www.infosearchbpo.com/image-labeling-annotation.php>; available at least as early as Feb. 18, 2020; pp. 1-3. [cited by applicant]
Image Annotation.AI; “Image Annotation for Retail Stores | Supermarkets | Image Annotation.ai”; <https://www.imageannotation.ai/retail 1/5>; available at least as early as Feb. 18, 2020; pp. 1-5. [cited by applicant]
Low, Jiayin; “What is Image Annotation?”; <https://medium.com/supahands-techblog/what-is-image-annotation-caf4107601b7>; Jan. 10, 2020; pp. 1-5. [cited by applicant]
PCT; App. No. PCT/US2021/027608; International Preliminary Report on Patentability mailed Nov. 3, 2022; (10 pages). [cited by applicant]
PCT; App. No. PCT/US2021/027608; International Search Report and Written Opinion mailed Jul. 15, 2021; (15 pages). [cited by applicant]
USPTO; U.S. Appl. No. 17/920,610; Non-Final Rejection mailed Oct. 7, 2024; (pp. 1-12). [cited by applicant]
USPTO; U.S. Appl. No. 17/910,503; Non-Final Rejection mailed Dec. 16, 2024; (pp. 1-18). [cited by applicant]
USPTO; U.S. Appl. No. 17/920,610; Notice of Allowance and Fees Due (PTOL-85) mailed Jan. 27, 2025; (pp. 1-9). [cited by applicant]
USPTO; U.S. Appl. No. 17/920,692; Non-Final Rejection mailed Jan. 31, 2025; (pp. 1-23). [cited by applicant]
Cited By (1)
US 12,541,738