IP Library Granted Patent US 11,861,913
Granted Patent B2
US 11,861,913 · App. 17/216,351 · Granted Jan 2, 2024

Determining autonomous vehicle status based on mapping of crowdsourced object data

Inventor: Gil Golov (Backnang, DE)
Assignee: Lodestar Licensing Group LLC
G06V20/56G01C21/30G01C21/3602G05D1/0088G06F16/29G06N3/02G06N20/00G06V20/58G06V20/582G06V20/584G06V20/588G06N3/048G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,861,913
App. No.
17/216,351
Granted
Jan 2, 2024
Kind
B2
Abstract

A map in a cloud service stores physical objects previously detected by other vehicles that have previously traveled over the same road that a current vehicle is presently traveling on. New data received by the cloud service from the current vehicle regarding new objects that are being encountered by the current vehicle can be compared to the previous object data stored in the map. Based on this comparison, an operating status of the current vehicle is determined. In response to determining the status, an action such as terminating an autonomous navigation mode of the current vehicle is performed.

Claims (77)

1. A system comprising:

at least one memory; and

at least one processor coupled to the memory;

wherein the memory and processor are configured to:

receive data regarding objects, each object detected by at least one of a plurality of vehicles;

store, based on the received data, a map including the detected objects, each of the detected objects associated with a respective location;

receive first data including an object detected by a first vehicle;

determine, based on comparing the received first data to the map, a mismatch between the first data and the map;

determine, based on the mismatch, that an aspect of the first vehicle is not functioning properly; and

send a communication regarding the mismatch to the first vehicle, wherein in response to receiving the communication, the first vehicle performs at least one action to change an operating status of the first vehicle based on the mismatch and the determined aspect that is not functioning properly.

2. The system of claim 1 , wherein a first object of the detected objects is a physical structure.

3. The system of claim 2 , wherein the physical structure is a traffic sign or a road lane.

4. The system of claim 1 , wherein the system further comprises a machine learning model, and at least one of the received data or the first data are inputs to the machine learning model.

5. The system of claim 1 , wherein the first data is packaged in compressed data by the first vehicle and communicated by the first vehicle to the system.

6. The system of claim 1 , wherein the mismatch between the first data and the map includes at least one of a failure to detect the object in the first data, or a failure to detect the object of the first data in the map.

7. The system of claim 1 , wherein the first data fails to match stored data for the map for at least one object.

8. The system of claim 1 , wherein the mismatch between the first data and the map includes a failure to match within a predetermined tolerance.

9. The system of claim 1 , wherein the mismatch is further based on comparing the first data to output from a machine learning model.

10. The system of claim 1 , wherein the first data is received from the first vehicle.

11. The system of claim 1 , wherein the at least one action is locally determined within the first vehicle.

12. The system of claim 1 , wherein the at least one action is locally determined by a computing device mounted on or within the first vehicle, and wherein the mounted computing device includes at least one of a controller or an in-memory processing device.

13. The system of claim 1 , wherein the at least one action includes at least one of:

deactivating an autonomous driving mode;

activating a backup navigation device of the first vehicle;

controlling at least one of steering, braking, acceleration, seat position, window status, or driving style;

controlling at least one system of the first vehicle;

controlling an infotainment system of the first vehicle; or

controlling a communication device of the first vehicle.

14. The system of claim 1 , wherein the memory and processor are further configured to:

update the map with the first data; and

wirelessly communicate the updated map to the plurality of vehicles.

15. The system of claim 1 , wherein the first data comprises data from at least one sensor in the first vehicle.

16. A system comprising:

at least one memory; and

at least one processor coupled to the memory;

wherein the system is configured to:

receive data regarding objects, each object detected by at least one of a plurality of vehicles;

store, based on the received data, a map including the detected objects, each of the detected objects associated with a respective location;

communicate the map to a first vehicle;

receive first data collected by the first vehicle;

determine, based on comparing the first data to the map, a mismatch between the first data and the map;

determine, based on the mismatch, that an aspect of the first vehicle is not functioning properly; and

cause the first vehicle to perform at least one action based on the determination of the mismatch and the determination of the aspect not functioning properly, wherein performing the at least one action changes an operating status of the first vehicle.

17. The system of claim 16 , wherein the system is further configured to communicate the map to vehicles other than the first vehicle.

18. The system of claim 17 , wherein the other vehicles include a second vehicle that collects and sends data to the system.

19. The system of claim 16 , wherein a first object of the detected objects is a physical structure.

20. The system of claim 19 , wherein the physical structure is a traffic sign or a road lane.

21. The system of claim 16 , wherein the system further comprises a machine learning model, and at least one of the received data or the first data are inputs to the machine learning model.

22. The system of claim 16 , wherein the first data is packaged as compressed data by the first vehicle, and the compressed data is communicated by the first vehicle to the system.

23. The system of claim 16 , wherein the mismatch between the first data and the map includes at least one of a failure to detect an object in the first data, or a failure to detect an object of the first data in the map.

24. The system of claim 16 , wherein the first data fails to match stored data for the map for at least one object.

25. The system of claim 16 , wherein the mismatch between the first data and the map includes a failure to match within a predetermined tolerance.

26. The system of claim 16 , wherein the mismatch is further based on comparing the first data to output from a machine learning model.

27. The system of claim 16 , wherein the first data is received from the first vehicle.

28. The system of claim 16 , wherein the at least one action is locally determined by the first vehicle.

29. The system of claim 16 , wherein the at least one action is locally determined by a computing device mounted on or within the first vehicle, and wherein the mounted computing device includes at least one of a controller or an in-memory processing device.

30. The system of claim 16 , wherein the at least one action includes at least one of:

deactivating an autonomous driving mode;

activating a backup navigation device of the first vehicle;

controlling at least one of steering, braking, acceleration, seat position, window status, or driving style;

controlling at least one system of the first vehicle;

controlling an infotainment system of the first vehicle; or

controlling a communication device of the first vehicle.

31. The system of claim 16 , wherein the system is further configured to:

update the map with the first data; and

wirelessly communicate the updated map to the plurality of vehicles.

32. The system of claim 16 , wherein the first data comprises data from at least one sensor in the first vehicle.

33. A system comprising:

at least one memory; and

at least one processor configured to cause the system to:

receive data regarding objects, each object detected by a respective vehicle;

store, in the memory and based on the received data, a map including the detected objects;

receive first data collected by at least one sensor of a first vehicle;

determine a mismatch between the first data and the map;

determine, based on the mismatch, that an aspect of the first vehicle is not functioning properly; and

in response to determining the mismatch, change an operating configuration of the first vehicle.

34. The system of claim 33 , wherein changing the operating configuration comprises sending a communication to the first vehicle that causes the first vehicle to change an operation of a vehicle system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2025
From: MICRON TECHNOLOGY, INC.
To: LODESTAR LICENSING GROUP LLC
Reel/Frame 072410/0259 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2021
From: GOLOV, GIL
To: MICRON TECHNOLOGY, INC.
Reel/Frame 055758/0439 →
Continuity (2)
Continuation 15951087 · Apr 11, 2018
Related Publication 20210216790A1 · Jul 15, 2021
Cited By (3)
US 12,530,381 US 12,608,406 US 12,709,252