IP Library Granted Patent US 11,708,068
Granted Patent B2
US 11,708,068 · App. 16/910,516 · Granted Jul 25, 2023

Processing data for driving automation system

Inventor: Adam John Boulton (Wirral, GB)
Assignee: BlackBerry Limited
B60W30/08B60W40/09B60W60/001G06V20/588B60W2030/082B60W2420/54
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,708,068
App. No.
16/910,516
Granted
Jul 25, 2023
Kind
B2
Abstract

A method of processing data for a driving automation system, the method comprising steps of: obtaining sound data from a microphone of an autonomous vehicle; processing the sound data to obtain a sound characteristic; and updating a context of the autonomous vehicle based on the sound characteristic.

Claims (37)

1. A method of processing data for a driving automation system, the method comprising steps of:

obtaining sound data from a microphone of an autonomous vehicle;

processing the sound data to obtain a type of sound, wherein the processing comprises:

obtaining a sound pattern from the sound data, wherein the sound pattern is based on a characteristic of the sound data, the obtaining comprising performing frequency analysis on the sound data within a time window of at least five seconds;

comparing the sound pattern with at least one sound signature to determine the type of sound; and

upon determining that the type of sound comprises a braking sound followed by a collision sound, transmitting an emergency call signal, the emergency call signal comprising a location of the autonomous vehicle; and

updating a context of the autonomous vehicle based on the characteristic of the sound data.

2. The method of claim 1 , wherein the sound data comprises a background sound of an external environment of the autonomous vehicle and the sound pattern, and wherein the sound pattern comprises an anomaly in the background sound.

3. The method of claim 1 , wherein the sound data comprises a background sound of an external environment of the autonomous vehicle and the sound characteristic is a decibel level of the background sound.

4. The method of claim 1 , further comprising providing the updated context to at least one of an instrument cluster of the autonomous vehicle and at least one sensor of the autonomous vehicle.

5. The method of claim 1 , further comprising responsive to updating the context, modifying a behavior of the driving automation system.

6. The method of claim 1 , further comprising generating a control signal comprising instructions configured to cause the driving automation system to change at least one state of the autonomous vehicle.

7. The method of claim 6 , wherein the at least one state is at least one of a road position, a lane position, a speed, a direction and a volume of a sound system of the autonomous vehicle.

8. The method of claim 1 , wherein the microphone is an external microphone of the autonomous vehicle.

9. A non-transitory computer readable medium for storing a computer program which, when executed by at least one processor, is configured to:

obtain sound data from a microphone of an autonomous vehicle;

process the sound data to obtain a type of sound, the processing comprising:

obtaining a sound pattern from the sound data, wherein the sound pattern is based on a characteristic of the sound data, the obtaining comprising performing frequency analysis on the sound data within a time window of at least five seconds;

comparing the sound pattern with at least one sound signature to determine the type of sound; and

upon determining that the type of sound comprises a braking sound followed by a collision sound, transmitting an emergency call signal, the emergency call signal comprising a location of the autonomous vehicle; and

update a context of the autonomous vehicle based on the characteristic of the sound data.

10. The non-transitory computer readable medium of claim 9 , wherein the sound data comprises a background sound of an external environment of the autonomous vehicle and the sound pattern, and wherein the sound pattern comprises an anomaly in the background sound.

11. The non-transitory computer readable medium of claim 9 , wherein the sound data comprises a background sound of an external environment of the autonomous vehicle and the sound characteristic is a decibel level of the background sound.

12. The non-transitory computer readable medium of claim 9 , wherein the at least one processor is configured to provide the updated context to at least one of an instrument cluster of the autonomous vehicle and at least one sensor of the autonomous vehicle.

13. The non-transitory computer readable medium of claim 9 , wherein the at least one processor is configured to modify a behaviour of the driving automation system responsive to updating the context.

14. The non-transitory computer readable medium of claim 9 , wherein the at least one processor is configured to generate a control signal comprising instructions configured to cause the driving automation system to change at least one state of the autonomous vehicle.

15. The non-transitory computer readable medium of claim 14 , wherein the at least one state is at least one of a road position, a lane position, a speed, a direction and a volume of a sound system of the autonomous vehicle.

16. The non-transitory computer readable medium of claim 9 , wherein the microphone is an external microphone of the autonomous vehicle.

17. A computing device comprising:

interface circuitry; and

processing circuitry configured to:

obtain sound data from a microphone of an autonomous vehicle;

process the sound data to obtain a type of sound, the processing comprising:

obtaining a sound pattern from the sound data, wherein the sound pattern is based on a characteristic of the sound data, the obtaining comprising performing frequency analysis on the sound data within a time window of at least five seconds;

comparing the sound pattern with at least one sound signature to determine the type of sound; and

upon determining that the type of sound comprises a braking sound followed by a collision sound, transmitting an emergency call signal, the emergency call signal comprising a location of the autonomous vehicle; and

update a context of the autonomous vehicle based on the characteristic of the sound data.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064104/0103 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2020
From: BLACKBERRY UK LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 053741/0961 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2020
From: BOULTON, ADAM JOHN
To: BLACKBERRY UK LIMITED
Reel/Frame 053604/0271 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2020
From: BOULTON, ADAM JOHN
To: BLACKBERRY UK LIMITED
Reel/Frame 053227/0482 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2020
From: BLACKBERRY UK LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 053227/0551 →
Priority Claims (1)
GB 1910864 · Jul 30, 2019 · national
Continuity (1)
Related Publication 20210031757A1 · Feb 4, 2021