Granted Patent B2

US 12,346,117 · App. 18/740,131 · Granted Jul 1, 2025

Inventors: Chenyi Chen (Fremont, CA); Artem Provodin (Highlands, NJ); Urs Muller (Keyport, NJ)

Assignee: NVIDIA Corporation

G05D1/0221B60W30/00B60W30/18154B62D15/02B62D15/025B62D15/0255G05D1/0088G05D1/81G06N3/045G06N3/08G06N20/00G06V10/764G06V10/82G06V20/588B60W2420/403B60W2420/408

Abstract

Claims (56)

1. A system on a chip (SoC) comprising:

one or more central processing units (CPUs);

one or more graphics processing units (GPUs);

one or more image signal processors (ISPs);

one or more vision accelerators;

one or more processor subsystems for safety management,

wherein the SoC, at least in part, causes performance of one or more maneuvers corresponding to a vehicle based at least on control data determined using one or more learning models and based at least on map data from one or more maps and sensor data from one or more sensors of the vehicle.

2. The SoC of claim 1 , further comprising one or more dedicated processors for security enforcement.

3. The SoC of claim 1 , further comprising a plurality of reduced instruction set computer (RISC) cores.

4. The SoC of claim 1 , further comprising one or more vector processing units (VPUs).

5. The SoC of claim 1 , further comprising one or more deep learning accelerators (DLAs).

6. The SoC of claim 1 , wherein the one or more maneuvers comprise at least one of a parking maneuver, a reversing maneuver, a braking maneuver, a steering maneuver, a throttling maneuver, or a lane maneuver.

7. The SoC of claim 6 , wherein the lane maneuver is one of a lane change, a lane split, or a turn.

8. The SoC of claim 1 , wherein the one or more learning models comprise at least one of a neural network (NN), a deep neural network (DNN), or a machine learning model (MLM).

9. The SoC of claim 1 , wherein the one or more sensors of the vehicle comprise at least one of:

one or more cameras;

one or more LiDAR sensors;

one or more RADAR sensors;

one or more ultrasonic sensors;

one or more inertial measurement sensors;

one or more global positioning system (GPS) sensors; or

one or more global navigation satellite systems (GNSS) sensors.

10. The SoC of claim 1 , wherein the sensor data includes image data depicting at least a portion of an environment corresponding to a location of the vehicle.

11. The SoC of claim 1 , wherein the SoC is associated with at least one of:

a control system for an autonomous or semi-autonomous machine;

a perception system for an autonomous or semi-autonomous machine;

a system for performing deep learning operations;

a system implemented using an edge device; or

a system implemented at least partly using cloud computing resources.

12. A system comprising:

one or more central processing units (CPUs);

one or more graphics processing units (GPUs);

one or more image signal processors (ISPs);

one or more vision accelerators;

one or more processor subsystems for managing safety,

wherein the SoC, at least in part, causes performance of one or more controls corresponding to a vehicle based at least on trajectory data determined using one or more learning models and based at least on map data from one or more maps and sensor data from one or more sensors of the vehicle.

13. The system of claim 12 , further comprising at least one of:

dedicated processors for security enforcement;

a plurality of reduced instruction set computer (RISC) cores;

one or more vector processing units (VPUs); or

one or more deep learning accelerators (DLAs).

14. The system of claim 12 , wherein the system implements one or more cache coherency protocols.

15. The system of claim 12 , wherein the one or more learning models comprise at least one of a neural network (NN), a deep neural network (DNN), or a machine learning model (MLM).

16. A vehicle comprising:

one or more sensors; and

at least one computing system comprising:

one or more central processing units (CPUs);

one or more graphics processing units (GPUs);

one or more image signal processors (ISPs);

one or more vision accelerators;

one or more processor subsystems for managing safety,

wherein the at least one SoC, at least in part, causes performance of one or more operations corresponding to a vehicle based at least on recommendation data determined using one or more learning models applied to map data from one or more maps and sensor data from one or more sensors of the vehicle.

17. The vehicle of claim 16 , wherein the recommendation data comprises vehicle trajectory data.

18. The vehicle of claim 16 , wherein the at least one computing system comprises at least one system on a chip (SoC).

19. The vehicle of claim 16 , wherein the sensor data includes image data depicting at least a portion of an environment corresponding to a location of the vehicle.

20. The vehicle of claim 16 , wherein the one or more learning models comprise at least one of a neural network (NN), a deep neural network (DNN), or a machine learning model (MLM).

Assignments (1)

Continuity (6)

References Cited (163)