IP Library Granted Patent US 10,431,082
Granted Patent B2
US 10,431,082 · App. 15/627,304 · Granted Oct 1, 2019

Systems and methods for emergency vehicle response in an autonomous vehicle

Inventors: Valor Yaldo (West Bloomfield, MI); Xiaofeng F. Song (Novi, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G08G1/0965B60W30/00G05D1/0027G05D1/0246G05D1/0287G06T7/90G08G1/0175G05D2201/0213G06K9/00791G06K9/4652G06K2209/23G06T2207/10024G06T2207/30252H04N7/181H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,431,082
App. No.
15/627,304
Granted
Oct 1, 2019
Kind
B2
Abstract

Systems and methods are provided for controlling an autonomous vehicle. In one embodiment, a method includes: receiving image data from a camera device coupled to the autonomous vehicle; computing, by a processor, a value based on the image data; determining, by a processor, an existence of an emergency vehicle based on the computed value; selecting, by a processor, a first control strategy based on the determined existence of an emergency vehicle; and generating, by a processor, at least one signal to autonomously control the autonomous vehicle based on the control strategy.

Claims (32)

1. A method of controlling an autonomous vehicle, comprising:

receiving image data from a camera device coupled to the autonomous vehicle;

computing, by a processor, a value based on the image data;

determining, by the processor, an existence of an emergency vehicle based on the computed value;

determining, by the processor, when the emergency vehicle is not traveling behind the autonomous vehicle based on the image data and an environment behind the autonomous vehicle;

when the emergency vehicle is determined to be not traveling behind the autonomous vehicle, receiving audio data from an audio device coupled to the autonomous vehicle;

determining, by the processor, whether the emergency vehicle is traveling towards or away from the autonomous vehicle based on at least one of an increasing and a decreasing of decibels of the audio data;

selecting, by the processor, a first control strategy based on the determined travel of the emergency vehicle; and

generating, by the processor, at least one signal to autonomously control the autonomous vehicle based on the first control strategy.

2. The method of claim 1 , wherein the computing the value comprises computing a color value based on the image data.

3. The method of claim 2 , wherein the color value is a red value or a blue value.

4. The method of claim 2 , wherein the computing the value comprises computing a pattern of colors across frames of the image data.

5. The method of claim 4 , wherein the colors include red and blue.

6. The method of claim 1 , wherein the computing the value comprises computing a pattern of color in an image associated with an environment behind the autonomous vehicle.

7. A system for controlling an autonomous vehicle, comprising:

a non-transitory computer readable medium comprising:

a first module configured to, by a processor, receive image data from a camera device coupled to the autonomous vehicle;

a second module configured to, by the processor, compute a value based on the image data, and determine an existence of an emergency vehicle based on the computed value;

a fifth module that, by the processor, determines when the emergency vehicle is not traveling behind the autonomous vehicle based on the image data and an environment behind the autonomous vehicle, and when the emergency vehicle is determined to be not traveling behind the autonomous vehicle, receives audio data from an audio device coupled to the autonomous vehicle, and determines whether the emergency vehicle is traveling towards or away from the autonomous vehicle based on at least one of an increasing and a decreasing of decibels of the audio data;

a third module configured to, by the processor, select a first control strategy based on the determined travel of the emergency vehicle; and

a fourth module configured to, by the processor, generate, at least one signal to autonomously control the autonomous vehicle based on the first control strategy.

8. The system of claim 7 , wherein the second module computes the value by computing a color value based on the image data.

9. The system of claim 8 , wherein the color value is a red value or a blue value.

10. The system of claim 8 , wherein the second module computes the value by computing a pattern of colors across frames of the image data.

11. The system of claim 10 , wherein the colors include red and blue.

12. The system of claim 7 , wherein the second module computes the value by computing a pattern of color in an image associated with an environment behind the autonomous vehicle.

13. A vehicle, comprising:

a plurality of camera devices distributed about the vehicle, the camera devices sense an environment associated with the vehicle; and

a controller that is configured to, by a processor, receive image data from the plurality of camera devices coupled to the vehicle, compute a value based on the image data, determine an existence of an emergency vehicle based on the computed value, determine when the emergency vehicle is not traveling behind the autonomous vehicle based on the image data and an environment behind the autonomous vehicle, and when the emergency vehicle is determined to be not traveling behind the autonomous vehicle, receive audio data from an audio device coupled to the autonomous vehicle, determine whether the emergency vehicle is traveling towards or away from the autonomous vehicle based on at least one of an increasing and a decreasing of decibels of the audio data, select a first control strategy based on the determined travel of the emergency vehicle, and generate, at least one signal to autonomously control the vehicle based on the first control strategy.

14. The vehicle of claim 13 , wherein the controller computes a color value as the value based on the image data.

15. The vehicle of claim 14 , wherein the color value is red or blue.

16. The vehicle of claim 13 , wherein the controller computes a pattern of red and blue.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2017
From: YALDO, VALOR; SONG, XIAOFENG A.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 042758/0567 →
Continuity (1)
Related Publication 20180364732A1 · Dec 20, 2018