IP Library › Granted Patent US 11,037,000
Granted Patent B2
US 11,037,000 · App. 16/586,470 · Granted Jun 15, 2021

Intent-based dynamic change of resolution and region of interest of vehicle perception system

Inventor: Pranay Agrawal (San Francisco, CA)
Assignee: GM Cruise Holdings LLC
G06K9/00791G05D1/0246G05D1/0257G06K9/2054G06T7/11G06T7/174G06T7/207G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,037,000
App. No.
16/586,470
Granted
Jun 15, 2021
Kind
B2
Abstract

The present disclosure provides perception system for a vehicle that includes a plurality of imaging devices for producing images of an environment of the vehicle; a perception filter for receiving the images produced by the imaging devices, wherein the perception filter crops and filters the received images based on an intent of the vehicle and a current state of the vehicle; and a perception module for receiving at least one of the cropped and filtered images from the perception filter and perceiving the environment of the vehicle based on the received at least one of the cropped and filtered images.

Claims (36)

1. A perception system for a vehicle, the perception system comprising:

a plurality of imaging devices for producing images of an environment of the vehicle;

a perception filter for receiving the images produced by the imaging devices, wherein the perception filter crops and filters the received images based on an intent of the vehicle and a current state of the vehicle; and

a perception module for receiving at least one of the cropped and filtered images from the perception filter and perceiving the environment of the vehicle based on the received at least one of the cropped and filtered images.

2. The perception system of claim 1 , wherein the perception filter further scanning instructions to at least one of the imaging devices.

3. The perception system of claim 1 , wherein the perception filter determines a region of interest (“ROI”) for the vehicle based on the intent of the vehicle and the current state of the vehicle and wherein the ROI is used by the perception filter to filter the received images by selecting at least one of the received images.

4. The perception system of claim 3 , wherein the ROI is used by the perception filter to crop the selected at least one the received images.

5. The perception system of claim 3 , wherein the ROI is used by the perception filter to determine a resolution of the selected at least one of the received images.

6. The perception system of claim 1 , wherein the perception filter further uses the vehicle's intent and vehicle's current state to determine compute resource priority instructions.

7. The perception system of claim 6 further comprising a compute module for receiving the compute resource priority instructions from the perception module and allocating compute resources among the imaging devices in accordance with the compute resource priority instructions.

8. The perception system of claim 1 , wherein the vehicle comprises an autonomous vehicle.

9. The perception system of claim 1 , wherein the imaging devices comprise at least one of a camera, a LIDAR device, and a RADAR device.

10. An autonomous vehicle (“AV”) comprising:

an onboard computer;

a sensor suite comprising a plurality of imaging devices for producing images of an environment of the AV; and

a perception system including:

a perception filter for receiving the images produced by the imaging devices, wherein the perception filter crops and filters the received images based on an intent of the AV and a current state of the AV; and

a perception module for receiving at least one of the cropped and filtered images from the perception filter and perceiving the environment of the AV based on the received at least one of the cropped and filtered images.

11. The AV of claim 10 , wherein the perception filter determines a region of interest (“ROI”) for the AV based on the intent of the AV and the current state of the AV and wherein the ROI is used by the perception filter to filter the received images by selecting at least one of the received images.

12. The AV of claim 11 , wherein the ROI is used by the perception filter to crop the selected at least one the received images and to determine a resolution of the selected at least one of the received images.

13. The AV of claim 10 , wherein the perception filter further uses the AV's intent and AV's current state to determine compute resource priority instructions, the perception system further comprising a compute module for receiving the compute resource priority instructions from the perception module and allocating compute resources among the imaging devices in accordance with the compute resource priority instructions.

14. The AV of claim 10 , wherein the imaging devices comprise at least one of a camera, a LIDAR device, and a RADAR device.

15. The AV of claim 10 , wherein the perception filter further provides scanning instructions to at least one of the imaging devices.

16. A method comprising:

deploying a plurality of imaging devices for producing images of an environment of a vehicle;

receiving by a perception filter the images produced by the imaging devices, wherein the perception filter crops and filters the received images based on an intent of the vehicle and a current state of the vehicle;

receiving by a perception module at least one of the cropped and filtered images from the perception filter; and

perceiving by the perception module the environment of the vehicle based on the received at least one of the cropped and filtered images.

17. The method of claim 16 further comprising using the perception filter to:

determine a region of interest (“ROI”) for the vehicle based on the intent of the vehicle and the current state of the vehicle; and

use the ROI to filter the received images by selecting at least one of the received images.

18. The method of claim 17 , wherein the ROI is used by the perception filter to crop the selected at least one the received images and to determine a resolution of the selected at least one of the received images.

19. The method of claim 16 further comprising:

using the perception filter to use the vehicle's intent and the vehicle's current state to determine compute resource priority instructions; and

providing the compute resource priority instructions to a compute module, the compute module allocating compute resources among the imaging devices in accordance with the compute resource priority instructions.

20. The method of claim 16 , wherein the perception filter further provides scanning instructions to at least one of the imaging devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2019
From: AGRAWAL, PRANAY
To: GM CRUISE HOLDINGS LLC
Reel/Frame 050527/0185 →
Continuity (1)
Related Publication 20210097301A1 · Apr 1, 2021
Cited By (1)
US 12,187,295