Granted Patent B2

US 12,561,729 · App. 17/582,957 · Granted Feb 24, 2026

Inventors: Bradley Bogolea (Burlingame, CA); Jariullah Safi (Burlingame, CA)

Assignee: Simbe Robotics, Inc.

G06Q30/0633B25J19/04G06Q10/06311G06Q10/087G06Q30/0639

Abstract

Claims (131)

1 . A method for managing virtual shopping lists comprising:

during a first time period, for each store in a set of stores:

during a first scan cycle, by a computer system, dispatching a mobile robotic system in the store to autonomously scan inventory structures within the store and capture electronic scan data via a set of optical sensors integrated within the mobile robotic system;

during the first scan cycle, by the mobile robotic system deployed in the store:

scanning inventory structures throughout the store;

capturing a set of electronic scan data via the set of optical sensors; and

uploading the set of electronic data to the computer system;

by the computer system:

receiving the set of electronic scan data captured by the mobile robotic system during the first scan cycle;

extracting a set of features from the set of electronic scan data; and

deriving a current stock condition of the store during the first scan cycle based on the set of features;

during a second time period succeeding the first time period, by the computer system:

initializing a virtual shopping list for a user at a computing device;

in response to selection of a first product, from a population of products, at the computing device:

identifying a subset of stores, in the set of stores, associated with current stock conditions indicating presence of the first product; and

in response to the subset of stores comprising at least one store, adding a first identifier of the first product to the virtual shopping list; and

identifying a particular store, in the subset of stores, for fulfillment of a set of products on the virtual shopping list;

during a third time period succeeding the second time period and prior to fulfillment of the virtual shopping list, by the computer system:

accessing electronic scan data captured by the mobile robotic system during a second scan cycle; and

updating the current stock condition of the particular store for the third time period based on electronic scan data recorded by the mobile robotic system during the second scan cycle; and

by the computer system, in response to selection of the particular store and in response to the current stock condition of the particular store indicating absence of the first product prior to fulfillment of the virtual shopping list by a delivery associate:

serving a photographic image of an inventory structure in the particular store to the computing device, the photographic image generated based on electronic scan data recorded by the mobile robotic system during the second scan cycle;

generating a prompt to replace the first product on the virtual shopping list with an alternate product depicted in the photographic image; and

serving the prompt to the computing device.

2 . The method of claim 1 , further comprising, in response to receiving approval of the alternate product from the user:

updating the virtual shopping list to replace the first product with the alternate product;

annotating the photographic image of the inventory structure with a location of the alternate product in the photographic image; and

serving the photographic image of the inventory structure to a mobile device associated with the delivery associate.

3 . The method of claim 1 , further comprising:

generating a product location map identifying locations of products in the store based on the current stock condition of the store during the first time period; and

receiving selection of the first product comprising:

serving the product location map for presentation on the computing device; and

receiving selection of the first product on the product location map presented on the computing device.

4 . The method of claim 1 , further comprising:

generating a product location map identifying locations of products in the store based on the current stock conditions of the store during the third time period;

annotating the virtual shopping list with locations of products on the virtual shopping list based on the product location map of the store for the third time period.

5 . The method of claim 1 , further comprising:

in response to selection of a second product, from the population of products, at the computing device and in response to the current stock condition of the particular store indicating absence of the second product, identifying a second store associated with a second current stock condition indicating presence of the first product and the second product for fulfillment of the virtual shopping list; and

reassigning the virtual shopping list to the second store.

6 . The method of claim 1 , further comprising:

dispatching the delivery associate to the particular store to fulfill the virtual shopping list;

accessing a map of the particular store;

based on the map and the current stock condition during the third time period, calculating a route through the particular store to a location of each product specified in the virtual shopping list; and

serving the route to a mobile device affiliated with the delivery associate.

7 . The method of claim 6 , wherein calculating the route through the store comprises:

further comprising, during the second time period, receiving selection of a second product, from the population of products, at the computing device; and

wherein calculating the route through the store comprises:

identifying a first location in the particular store indicated in the map as stocked with units of the first product;

identifying a second location in the particular store indicated in the map as stocked with units of the second product during the third time period; and

calculating the route intersecting the first location and the second location.

8 . A method for managing virtual shopping lists comprising:

during a first time period:

by a computer system, during a first scan cycle, dispatching a mobile robotic system in a store to autonomously scan inventory structures within the store and capture electronic scan data via a set of optical sensors integrated within the mobile robotic system; and

by the mobile robotic system, during the first scan cycle:

scanning inventory structures within the store;

capturing a first set of electronic scan data via the set of optical sensors; and

uploading the first set of electronic data to the computer system;

by a computer system:

receiving the first set of electronic scan data captured by the mobile robotic system during the first scan cycle; and

deriving a current stock condition of the store based on the first set of electronic scan data;

during a second time period succeeding the first time period, by the computer system:

receiving selection of a first product, from a population of products, for a user at a computing device; and

specifying the store for fulfillment of the virtual shopping list; and

during a third time period and prior to fulfillment of the virtual shopping list, by the computer system:

accessing a second set of electronic scan data captured by an optical sensor deployed in the store during a second scan cycle succeeding the first scan cycle;

updating the current stock condition of the store for the third time period based on the second set of electronic scan data; and

in response to the current stock condition of the store indicating absence of the first product:

serving a first image of an inventory structure in the store to the computing device, the first image generated based on the second set of electronic scan data, the inventory structure associated with the first product.

9 . The method of claim 8 , further comprising, in response to the current stock condition of the store indicating absence of the first product:

generating a prompt to approve replacement of the first product on the virtual shopping list with an alternate product depicted in the first image; and

serving the prompt to the computing device.

10 . The method of claim 9 , further comprising, in response to receiving approval of the alternate product from the user:

updating the virtual shopping list to replace the first product with the alternate product;

annotating the first image of the inventory structure with a location of the alternate product in the first image; and

serving the first image of the inventory structure to a mobile device associated with the delivery associate.

11 . The method of claim 8 , wherein specifying the store for fulfillment of the virtual shopping list comprises specifying the store for fulfillment of the virtual shopping list in response to the current stock condition of the store indicating presence of the first product in the store.

12 . The method of claim 8 , wherein accessing the second set of electronic scan data comprises accessing the second set of electronic scan data captured by the optical sensor arranged on the mobile robotic system.

13 . The method of claim 8 :

further comprising generating a product location map identifying locations of products in the store based on the current stock condition of the store during the first time period; and

wherein receiving selection of the first product comprises:

serving the product location map for presentation on the computing device; and

receiving selection of the first product on the product location map presented on the computing device.

14 . The method of claim 8 , further comprising:

generating a product location map identifying locations of products in the store based on the current stock conditions of the store during the third time period;

annotating the virtual shopping list with locations of products on the virtual shopping list based on the product location map of the store for the third time period.

15 . The method of claim 8 , further comprising:

in response to selection of a second product, from the population of products, at the computing device and in response to the current stock condition of the store indicating absence of the second product, identifying a second store associated with a second current stock condition indicating presence of the first product and the second product for fulfillment of the virtual shopping list; and

reassigning the virtual shopping list to the second store.

16 . The method of claim 8 , further comprising:

dispatching a delivery associate to the store to fulfill the virtual shopping list;

based on the current stock condition of the store during the third time period and a map of the store, calculating a route through the store to a location of each product specified in the virtual shopping list; and

serving the route to a mobile device affiliated with the delivery associate.

17 . The method of claim 16 , wherein calculating the route through the store comprises:

identifying a first location in the store indicated in the map as stocked with units of the first product during the third time period;

in response to selection of a second product, from the population of products, at the computing device, identifying a second location in the store indicated in the map as stocked with units of the second product during the third time period; and

calculating the route that intersects the first location and the second location in the map of the store.

18 . The method of claim 8 , further comprising, for the first product specified in the virtual shopping list:

identifying a slot in the store assigned to the first product; and

serving a photographic image to the computing device during the second time period, the photographic image depicting the slot and captured by the mobile robotic system deployed in the store.

19 . A method for managing virtual shopping lists comprising:

during a first time period, for each store in a set of stores:

during a first scan cycle, by a computer system, dispatching a mobile robotic system to autonomously scan inventory structure within the store and capture electronic scan data via a set of optical sensors integrated within the mobile robotic system;

during the first scan cycle, by the mobile robotic system deployed in the store:

autonomously scanning inventory structures within the store;

capturing a set of electronic scan data via the set of optical sensors; and

uploading the set of electronic scan data to the computer system;

by the computer system:

receiving the set of electronic scan data captured by the mobile robotic system during the first scan cycle;

extracting a set of features from the set of electronic scan data; and

deriving a current stock condition of the store during the first scan cycle based on the set of features;

during a second time period succeeding the first time period, by the computer system:

initializing a virtual shopping list for a user at a computing device;

in response to selection of a first product, from a population of products, at the computing device, identifying a first subset of stores, in the set of stores, associated with current stock conditions indicating presence of the first product;

in response to selection of a second product, from the population of products, at the computing device, identifying a second subset of stores, in the first set of stores, associated with current stock conditions indicating presence of the first product and the second product;

in response to the second subset of stores comprising at least one store:

adding a first identifier of the first product to the virtual shopping list; and

adding a second identifier of the second product to the virtual shopping list;

identifying a particular store, in the second subset of stores, for fulfillment of a set of products on the virtual shopping list, the set of products comprising the first product and the second product;

during a third time period succeeding the second time period and prior to fulfillment of the virtual shopping list, by the computer system:

accessing electronic scan data captured by the mobile robotic system during a second scan cycle; and

updating the current stock condition of the particular store for the third time period based on electronic scan data recorded by the mobile robotic system during the second scan cycle; and

by the computer system, in response to selection of the particular store and in response to the current stock condition of the store indicating absence of the second product prior to fulfillment of the virtual shopping list by a delivery associate:

serving a photographic image of the inventory structure in the particular store to the computing device, the photographic image generated based on electronic scan data recorded by the mobile robotic system during the second scan cycle;

generating a prompt to replace the second product on the virtual shopping list with an alternate product depicted in the photographic image; and

serving the prompt to the computing device; and

in response to selection of the alternate product by the user:

updating the virtual shopping list to replace the second product with the alternate product;

identifying a first location of the first product in the particular store indicated in a map of the particular store as stocked with units of the first product;

identifying a second location of the alternate product in the particular store indicated in the map as stocked with units of the alternate product;

calculating a route intersecting the first location and the second location in the map of the store;

serving the route to a mobile device affiliated with the delivery associate.

Assignments (3)

Continuity (9)

References Cited (27)