IP Library Granted Patent US 12,211,088
Granted Patent B2
US 12,211,088 · App. 16/806,447 · Granted Jan 28, 2025

Method and system for automated product localization through mobile data analysis

Inventors: Wilfred Edwin Booij (Oslo, NO); Magnus Oplenskedal (Oslo, NO)
Assignee: Sonitor Technologies AS
G06Q30/0639H04W4/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,211,088
App. No.
16/806,447
Granted
Jan 28, 2025
Kind
B2
Abstract

An approach for product localization is described that includes detecting one or more movement activities of a user in an indoor environment, and determining a respective position for each of the one or more movement activities using a sensor associated with the user. The approach further includes identifying one or more stoppage locations from the detected one or more movement activities, and receiving a list of one or more purchased items purchased by the user in the indoor environment. Finally, the approach further includes correlating at least one of the more purchased items with at least one of the one or more stoppage locations, and predicting the location of the one or more purchased items based on the correlating.

Claims (33)

1. A computer-implemented method of product localization comprising:

detecting, using a real-time location system (RTLS), one or more stoppage locations each user of a plurality of users makes in an indoor environment, wherein detecting the one or more stoppage locations includes using the RTLS that is an electromagnetic technology-based system;

determining, by the RTLS, whether each user stays within a small area relative to the indoor environment for a predetermined amount of time;

receiving a list of one or more purchased items purchased by each user of the plurality of users in the indoor environment, the list being provided by a purchasing system associated with the indoor environment;

correlating at least one of the one or more purchased items with at least one of the one or more stoppage locations, wherein the correlating includes populating a two-dimensional item-stop array for each user of the plurality of users, wherein one dimension of the two-dimensional item-stop array represents purchased items and the other dimension of the two-dimensional item-stop array represents the one or more stoppage locations; and

predicting a location of the one or more purchased items based on the correlating, wherein the predicting further includes accumulating respective two-dimensional item-stop arrays for respective multiple users to form an accumulated two-dimensional item-stop array, wherein the accumulating includes matrix addition of the respective two-dimensional item-stop arrays, and the predicting is based on the location having a highest score in the accumulated two-dimensional item-stop array for the respective one or more purchased items.

2. The computer-implemented method of claim 1 , wherein the detecting the one or more stoppage locations includes using the RTLS that is also an ultrasound-based system.

3. The computer-implemented method of claim 1 , wherein the detecting the one or more stoppage locations includes using the RTLS that is also an infrared-based system.

4. The computer-implemented method of claim 1 , wherein the small area relative to the indoor environment is an area of one meter diameter and the predetermined amount of time is at least three seconds.

5. The computer-implemented method of claim 1 , wherein the detecting the one or more stoppage locations includes using a human activity classifying algorithm in conjunction with the RTLS.

6. The computer-implemented method of claim 1 , wherein the receiving the list of one or more purchased items includes receiving the list via a user application on a smartphone.

7. The computer-implemented method of claim 1 , wherein a non-zero entry of the two-dimensional item-stop array is indicative that the user purchased the respective purchased item and the user stopped at the respective stoppage location.

8. The computer-implemented method of claim 1 , wherein the predicting the location further includes:

using a leaky customer score accumulation algorithm.

9. The computer-implemented method of claim 1 , wherein the predicting the location further includes:

using a softmax-inference based algorithm.

10. A product localization system comprising at least one processor, the at least one processor configured to:

identify, using a real-time location system (RTLS), one or more stoppage locations made by each user of a plurality of users in an indoor environment, wherein identifying the one or more stoppage locations includes using the RTLS that is an electromagnetic technology-based system;

determine, by the RTLS, whether each user stays within a small area relative to the indoor environment for a predetermined amount of time;

receive a list of one or more purchased items purchased by each user of the plurality of users in the indoor environment, the list being provided by a purchasing system associated with the indoor environment;

correlate at least one of the one or more purchased items with at least one of the one or more stoppage locations, wherein the correlating includes populating a two-dimensional item-stop array for each user of the plurality of users, wherein one dimension of the two-dimensional item-stop array represents purchased items and the other dimension of the two-dimensional item-stop array represents the one or more stoppage locations; and

predict a location of the one or more purchased items based on the correlating, wherein the predicting further includes accumulating respective two-dimensional item-stop arrays for respective multiple users to form an accumulated two-dimensional item-stop array, wherein the accumulating includes matrix addition of the respective two-dimensional item-stop arrays, and the predicting is based on the location having a highest score in the accumulated two-dimensional item-stop array for the respective one or more purchased items.

11. The system of claim 10 , wherein the at least one processor is further configured to identify the one or more stoppage locations by using the RTLS that is also an ultrasound-based system.

12. The system of claim 10 , wherein the at least one processor is further configured to identify the one or more stoppage locations by using the RTLS that is also an infrared-based system.

13. The system of claim 10 , wherein the small area relative to the indoor environment is an area of one meter diameter and the predetermined amount of time is at least three seconds.

14. The system of claim 10 , wherein the at least one processor is further configured to identify the one or more stoppage locations by using a human activity classifying algorithm in conjunction with the RTLS.

15. The system of claim 10 , wherein a non-zero entry of the two-dimensional item-stop array is indicative that the user purchased the respective purchased item and the user stopped at the respective stoppage location.

16. The system of claim 10 , wherein the at least one processor is further configured to predict the location by:

using a leaky customer score accumulation algorithm.

17. The system of claim 10 , wherein the at least one processor is further configured to predict the location by:

using a dynamic leaky customer score accumulation algorithm.

18. The system of claim 10 , wherein the at least one processor is further configured to predict the location by:

using a softmax-inference based algorithm.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2023
From: FORKBEARD TECHNOLOGIES AS
To: SONITOR TECHNOLOGIES AS
Reel/Frame 062581/0275 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2021
From: BOOIJ, WILFRED EDWIN; OPLENSKEDAL, MAGNUS
To: FORKBEARD TECHNOLOGIES AS
Reel/Frame 056056/0565 →
Continuity (2)
Provisional Application 62812433 · Mar 1, 2019
Related Publication 20200279318A1 · Sep 3, 2020
References Cited (18)
US 6123259A · Ogasawara · 2000 [cited by applicant]
US 7010498B1 · Berstis · 2006 [cited by applicant]
US 11126861B1 · Evans · 2021 [cited by examiner]
US 20060200378A1 · Sorensen · 2006 [cited by examiner]
US 20080004796A1 · Schott · 2008 [cited by examiner]
US 20150169597A1 · Edge et al. · 2015 [cited by applicant]
US 20150262197A1 · Chao · 2015 [cited by examiner]
US 20160313790A1 · Clement · 2016 [cited by examiner]
US 20170186077A1 · Srinivasan et al. · 2017 [cited by applicant]
US 20180012267A1 · Bordewieck · 2018 [cited by examiner]
US 20200074125A1 · Rein · 2020 [cited by examiner]
US 20200273013A1 · Garner · 2020 [cited by examiner]
CN 105981426A · 2016 [cited by applicant]
CN 108431851A · 2018 [cited by applicant]
This shopper assistant app shows the exact location a product is kept in a store. (Oct. 30, 2019). M2 Presswire Retrieved from https://dialog.proquest.com/professional/docview/2310481940?accountid=131444 (Year: 2019). [cited by examiner]
International Search Report, mailed Jul. 17, 2020 for Appl. No. PCT/IB2020/051762, 4 pages. [cited by applicant]
Written Opinion, mailed Jul. 17, 2020 for Appl. No. PCT/IB2020/051762, 7 pages. [cited by applicant]
Deak, Gabriel et al., “A survey of active and passive indoor localization systems,” Computer Communications, vol. 35, No. 16, Jun. 26, 2012, pp. 1939-1954 XPO28938403, ISSN: 0140-3664, DOI: 10.106/J.COMCOM.2012.06.004. [cited by applicant]