IP Library Granted Patent US 12,093,039
Granted Patent B2
US 12,093,039 · App. 16/796,744 · Granted Sep 17, 2024

System and method for automatically determining to follow a divergent vehicle in a vehicle's autonomous driving mode

Inventors: Anthony Levandowski (San Francisco, CA); Bernward Schwarte (San Francisco, CA); Oscar Argueta (San Francisco, CA)
Assignee: Kache.Al
G05D1/0088G05D1/0287G05D1/692G05D1/81G06N20/00G06T7/292G06T7/593G06T7/80G06T7/85H04N13/246G06T2207/10012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,039
App. No.
16/796,744
Granted
Sep 17, 2024
Kind
B2
Abstract

Systems and methods for implementing one or more autonomous features for autonomous and semi-autonomous control of one or more vehicles are provided. More specifically, image data is obtained from an image acquisition device and processed utilizing one or more machine learning models to identify, track, and extract one or more features of the image utilized in decision making processes for providing steering angle and/or acceleration/deceleration input to one or more vehicle controllers. In some instances, techniques are employed such that the autonomous and semi-autonomous control of a vehicle changes between lane follow and vehicle follow modes. Further, a vehicle may determine whether to continue to follow a vehicle after the followed vehicle moves in relation to the following vehicle.

Claims (43)

1. A method comprising:

entering, by a first vehicle and while the first vehicle is in a first lane, an autonomous driving mode that mimics movements of a second vehicle, which is also in the first lane and ahead of the first vehicle, as captured at least by an optical sensor, to follow the second vehicle;

determining a change of the second vehicle from the first lane to a second lane while the first vehicle is following the second vehicle;

maintaining the autonomous driving mode to continue to follow the second vehicle;

determining, by the first vehicle, not to match the change from the first lane to the second lane; and

continuing to mimic movements of the second vehicle, as captured at least by the optical sensor, to follow the second vehicle while the second vehicle is in the second lane and the first vehicle is in the first lane.

2. The method of claim 1 , wherein a position of the second vehicle in the second lane is determined by sensor data of a driving environment associated with the first vehicle, and wherein the sensor data is at least an image of the driving environment.

3. The method of claim 2 , wherein the position of the second vehicle in the second lane is determined by drawing a box over the second vehicle in the image.

4. The method of claim 3 , wherein the box delineates extents of the second vehicle within the image.

5. The method of claim 4 , wherein a center of the box is determined and the first vehicle determines the center of the box is in the second lane.

6. The method of claim 5 , wherein to follow the second vehicle, the first vehicle automatically maintains a steering angle to maintain a direction of the first vehicle while a visual location of the second vehicle changes position in subsequent images.

7. The method of claim 6 , wherein determining not to match the change from the first lane to the second lane comprises the first vehicle maintaining position in the first lane.

8. The method of claim 6 , wherein the second vehicle is in a caravan with the first vehicle.

9. The method of claim 8 , wherein a view of the second vehicle in the optical sensor changes when the second vehicle moves to the second lane.

10. The method of claim 9 , wherein the second vehicle is identified by indicia on the second vehicle.

11. A system comprising:

a memory;

a processor in communication with the memory, wherein the processor executes instructions stored in the memory, which cause the processor to execute a method, the method comprising:

capturing, by at least an optical sensor, images of a second vehicle;

entering, by a first vehicle, an autonomous driving mode that follows the second vehicle;

while in the autonomous driving mode, mimicking movements of the second vehicle by maintaining a position of the second vehicle in the images of the second vehicle by changing operating parameters of the first vehicle;

determining that the second vehicle has made a change to another lane while the first vehicle is following the second vehicle;

maintaining the autonomous driving mode to continue to follow the second vehicle;

determining not to match the change to the other lane; and

continuing to mimic movements of the second vehicle, as captured at least by the optical sensor, to follow the second vehicle while the second vehicle is in the other lane.

12. The system of claim 11 , wherein the position of the second vehicle in the second lane is determined by sensor data of a driving environment associated with the first vehicle, and wherein the sensor data is at least an image of the driving environment.

13. The system of claim 11 , wherein the position of the second vehicle in the second lane is determined by drawing a box over the second vehicle in an image of a driving environment, wherein the box delineates extents of the second vehicle within the image, and wherein a center of the box is determined.

14. The system of claim 11 , wherein to follow the second vehicle, the first vehicle automatically maintains a steering angle to maintain a direction of the first vehicle while a visual location of the second vehicle changes position in subsequent images of a sensor of the first vehicle.

15. The system of claim 11 , wherein the second vehicle is located in a different position in the images after changing lanes.

16. A non-transitory computer readable medium having stored thereon instructions, which when executed by a processor cause the processor to execute a method, the method comprising:

receiving, from at least an optical sensor, captured images of a second vehicle in a driving environment;

drawing a box over the second vehicle in an image of the driving environment, wherein the box delineates extents of the second vehicle within the image;

determining a center of the box;

entering an autonomous driving mode that follows a second vehicle;

while in the autonomous driving mode, mimicking movements of the second vehicle by maintaining a position of the center of the box in images of the second vehicle by changing operating parameters of the first vehicle;

determining that the second vehicle has made a change from a first lane to a second lane based on a movement of the center of the box; and

maintaining the autonomous driving mode to continue to follow the second vehicle;

determining not to match the change to the second lane; and

continuing to mimic movements of the second vehicle, as captured at least by the optical sensor, to follow the second vehicle while the second vehicle is in the second lane.

17. The non-transitory computer readable medium of claim 16 , wherein the position of the second vehicle in the second lane is determined by sensor data of a driving environment associated with the first vehicle, and wherein the sensor data is at least an image of the driving environment.

18. The non-transitory computer readable medium of claim 16 , wherein the second lane is marked by at least one different lane line.

19. The non-transitory computer readable medium of claim 16 , wherein to follow the second vehicle, the first vehicle automatically maintains a steering angle to maintain a direction of the first vehicle while a visual location of the second vehicle changes lane in subsequent images of a sensor of the first vehicle.

20. The non-transitory computer readable medium of claim 16 , wherein the first vehicle mimics the movement of the center of the box when the center is in a different location in images after the second vehicle moves to the second lane.

Assignments (3)
CHANGE OF NAME Recorded Aug 29, 2024
From: KACHE.AI, INC.
To: PRONTO.AI, INC.
Reel/Frame 068808/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2023
From: SCHWARTE, BERNWARD
To: KACHE.AI
Reel/Frame 064053/0313 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2023
From: LEVANDOWSKI, ANTHONY; BERNSTEIN, DAVID; ARGUETA, OSCAR; VO, ALBERT; RICCI, CHRISTOPHER
To: KACHE.AI
Reel/Frame 064005/0457 →
Continuity (18)
Continuation 16511968 · Jul 15, 2019
Continuation PCTUS2019041720 · Jul 12, 2019
Provisional Application 62697946 · Jul 13, 2018
Provisional Application 62697957 · Jul 13, 2018
Provisional Application 62697960 · Jul 13, 2018
Provisional Application 62697962 · Jul 13, 2018
Provisional Application 62697930 · Jul 13, 2018
Provisional Application 62697919 · Jul 13, 2018
Provisional Application 62697965 · Jul 13, 2018
Provisional Application 62697915 · Jul 13, 2018
Provisional Application 62697922 · Jul 13, 2018
Provisional Application 62697912 · Jul 13, 2018
Provisional Application 62697940 · Jul 13, 2018
Provisional Application 62697971 · Jul 13, 2018
Provisional Application 62697938 · Jul 13, 2018
Provisional Application 62697969 · Jul 13, 2018
Provisional Application 62697952 · Jul 13, 2018
Related Publication 20200192377A1 · Jun 18, 2020