Granted Patent B2

US 12,227,219 · App. 17/873,526 · Granted Feb 18, 2025

Inventors: Lin Gao (Miami, FL); Yilin Huang (Shanghai, CN); Shiyuan Yang (Shanghai, CN); Xiaofei Zhou (Shanghai, CN); Kaiyang Chu (Shanghai, CN); Sikun Zhu (Shanghai, CN)

Assignee: Maplebear Inc.

B62B5/0096B62B3/1424G01C21/16G01C21/383G01S5/0036G07C5/04H04W4/029

Abstract

Claims (78)

1. A method of tracking a shopping cart in an indoor environment, the method comprising:

detecting, by a wireless device located on the shopping cart, one or more signals from one or more external wireless devices in the indoor environment;

determining, by a computer processor, a first baseline location of the shopping cart at a first timestamp based on the detected one or more signals from the one or more external wireless devices in the indoor environment;

receiving, by the computer processor, wheel motion data from one or more wheel sensors coupled to one or more wheels of the shopping cart, wherein the wheel motion data describes a rotation of each of the one or more wheels and an orientation of each of the one or more wheels measured as an angle along an axis orthogonal to a ground plane;

calculating, by the computer processor, a translation traveled by the shopping cart from the first baseline location, the translation indicating a direction and a distance traveled by the shopping cart, wherein calculating the translation comprises:

calculating the direction traveled by aggregating the orientations of the one or more wheels, and

calculating the distance traveled by integrating the rotations of the one or more wheels over time;

determining, by the computer processor, an estimated location of the shopping cart at a second timestamp based on the first baseline location and the translation including the direction and the distance traveled; and

updating, by the computer processor, a map with the estimated location of the shopping cart.

2. The method of claim 1 ,

wherein detecting the one or more signals from the one or more external wireless devices in the indoor environment comprises:

sending an interrogation pulse using the wireless device located on the shopping cart;

receiving a first response signal from a first external wireless device in the indoor environment; and

wherein determining, by the computer processor, the first baseline location of the shopping cart at the first timestamp based on the detected one or more signals from the one or more external wireless devices in the indoor environment comprises:

calculating, by the computer processor, a first distance between the shopping cart and the first external wireless device based on time of flight between the interrogation pulse and the first response signal, wherein the first baseline location is based on the first distance.

3. The method of claim 2 ,

wherein detecting, by the computer processor, the one or more signals from the one or more external wireless devices in the indoor environment further comprises:

receiving a second response signal from a second external wireless device in the indoor environment; and

wherein determining, by the computer processor, the first baseline location of the shopping cart at the first timestamp based on the detected one or more signals from the one or more external wireless devices in the indoor environment comprises:

calculating, by the computer processor, a second distance between the shopping cart and the second external wireless device based on time of flight between the interrogation pulse and the second response signal, wherein the first baseline location is further based on the second distance.

4. The method of claim 1 , wherein rotation of a wheel is about an axis that is parallel to a ground plane.

5. The method of claim 1 , wherein the wheel sensor is a rotary encoder.

6. The method of claim 1 , wherein the wheel motion data describes rotation and orientation of two of the wheels on the shopping cart.

7. The method of claim 1 , further comprising:

displaying, on a display on the shopping cart, the estimated location of the shopping cart.

8. The method of claim 1 , further comprising:

displaying, on a display on the shopping cart, content based on the estimated location of the shopping cart.

9. The method of claim 1 , further comprising:

receiving acceleration data from an accelerometer describing acceleration of the shopping cart; and

wherein the estimated location of the shopping cart is determined further based on the acceleration data.

10. The method of claim 1 , further comprising:

detecting, by the wireless device located on the shopping cart, one or more subsequent signals from the one or more external wireless devices;

determining a second baseline location of the shopping cart at the second timestamp based on the detected one or more subsequent signals; and

calibrating the one or more wheel sensors based on a location drift between the second baseline location of the shopping cart and the estimated location of the shopping cart.

11. A non-transitory computer-readable storage medium storing instructions for tracking a shopping cart in an indoor environment, wherein the instructions, when executed by a computer processor, cause the computer processor to perform operations comprising:

detecting, by a wireless device located on the shopping cart, one or more signals from one or more external wireless devices in the indoor environment;

determining a first baseline location of the shopping cart at a first timestamp based on the detected one or more signals from the one or more external wireless devices in the indoor environment;

receiving wheel motion data from one or more wheel sensors coupled to one or more wheels of the shopping cart, wherein the wheel motion data describes rotation of the one or more wheels and an orientation of each of the one or more wheels measured as an angle along an axis orthogonal to a ground plane;

calculating a translation traveled by the shopping cart from the first baseline location, the translation indicating a direction and a distance traveled by the shopping cart, wherein calculating the translation comprises:

calculating the direction traveled by aggregating the orientations of the one or more wheels, and

calculating the distance traveled by integrating the rotations of the one or more wheels over time;

determining an estimated location of the shopping cart at a second timestamp based on the first baseline location and the translation including the direction and the distance traveled; and

updating a map with the estimated location of the shopping cart.

12. The non-transitory computer-readable storage medium of claim 11 ,

wherein detecting the one or more signals from the one or more external wireless devices in the indoor environment comprises:

sending an interrogation pulse using the wireless device located on the shopping cart;

receiving a first response signal from a first external wireless device in the indoor environment; and

wherein determining, by the computer processor, the first baseline location of the shopping cart at the first timestamp based on the detected one or more signals from the one or more external wireless devices in the indoor environment comprises:

calculating, by the computer processor, a first distance between the shopping cart and the first external wireless device based on time of flight between the interrogation pulse and the first response signal, wherein the first baseline location is based on the first distance.

13. The non-transitory computer-readable storage medium of claim 12 ,

wherein detecting, by the computer processor, the one or more signals from the one or more external wireless devices in the indoor environment further comprises:

receiving a second response signal from a second external wireless device in the indoor environment; and

wherein determining, by the computer processor, the first baseline location of the shopping cart at the first timestamp based on the detected one or more signals from the one or more external wireless devices in the indoor environment comprises:

calculating, by the computer processor, a second distance between the shopping cart and the second external wireless device based on time of flight between the interrogation pulse and the second response signal, wherein the first baseline location is further based on the second distance.

14. A system for tracking a shopping cart in an indoor environment, the system comprising:

a wireless device configured to detect one or more signals from one or more external wireless devices in an indoor environment;

a computer processor; and

a computer-readable storage medium storing instructions that, when executed by the computer processor, cause the computer processor to perform operations comprising:

determining a first baseline location of the shopping cart at a first timestamp based on one or more signals detected by the wireless device from the one or more external wireless devices in the indoor environment;

receiving wheel motion data from one or more wheel sensors coupled to one or more wheels of the shopping cart, wherein the wheel motion data describes a rotation of each of the one or more wheels and an orientation of each of the one or more wheels measured as an angle along an axis orthogonal to a ground plane;

calculating a translation traveled by the shopping cart from the first baseline location, the translation indicating a direction and a distance traveled by the shopping cart, wherein calculating the translation comprises:

calculating the direction traveled by aggregating the orientations of the one or more wheels, and

calculating the distance traveled by integrating the rotations of the one or more wheels over time;

determining an estimated location of the shopping cart at a second timestamp based on the first baseline location and the translation including the direction and the distance traveled; and

updating a map with the estimated location of the shopping cart.

15. The system of claim 14 , wherein the wheel sensor is a rotary encoder.

16. The system of claim 14 , wherein the wheel motion data describes rotation and orientation of two of the wheels on the shopping cart.

17. The system of claim 14 , the operations further comprising:

displaying, on a display on the shopping cart, the estimated location of the shopping cart.

18. The system of claim 14 , the operations further comprising:

displaying, on a display on the shopping cart, content based on the estimated location of the shopping cart.

19. The system of claim 14 , the operations further comprising:

receiving acceleration data from an accelerometer describing acceleration of the shopping cart; and

wherein the estimated location of the shopping cart is determined further based on the acceleration data.

20. The system of claim 14 , the operations further comprising:

detecting, by the wireless device located on the shopping cart, one or more subsequent signals from the one or more external wireless devices;

determining a second baseline location of the shopping cart at the second timestamp based on the detected one or more subsequent signals; and

calibrating the one or more wheel sensors based on a location drift between the second baseline location of the shopping cart and the estimated location of the shopping cart.

Assignments (1)

Continuity (2)

References Cited (11)