IP Library Granted Patent US 12,553,723
Granted Patent B2
US 12,553,723 · App. 18/034,459 · Granted Feb 17, 2026

System and method for detecting the surroundings of a vehicle

Inventors: Erwin Biebl (Munich, DE); Rodrigo Perez (Munich, DE); Ralph Helmar Rasshofer (Aichach, DE)
Assignee: Bayerische Motoren Werke Aktiengesellschaft
G01C21/28G06N3/045G06F18/24G06V20/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,553,723
App. No.
18/034,459
Granted
Feb 17, 2026
Kind
B2
Abstract

A system for detecting the surroundings of a vehicle includes a sensor module and a plurality of computing devices which are spatially separated from one another and which are configured to process the detected surroundings data by way of an artificial neural network. The artificial neural network includes multiple layers of artificial neurons. Each computing device implements a partial number of the layers.

Claims (35)

1 . A system for detecting surroundings of a vehicle, the system comprising:

a sensor module for acquiring surroundings data; and

a plurality of computing devices that are spatially separate from one another and that are configured to process the acquired surroundings data by way of an artificial neural network, wherein the artificial neural network comprises multiple layers of artificial neurons, and each of the computing devices implements a subset of the layers;

wherein one of the computing devices is configured to output data from an output layer of the subset of layers assigned to the one of the computing devices to a downstream computing device from the plurality of computing devices;

wherein the output data is received by the downstream computing device;

wherein the output data is further processed by the subset of layers of the artificial neural network assigned to the downstream computing device; and

wherein the artificial neural network is trained such that, with a given data amount of the acquired surroundings data to be processed, a smallest possible amount of the output data is transmitted from the one of the computing devices to the downstream computing device.

2 . The system according to claim 1 , wherein:

at least one of the computing devices is configured to output output data from an output layer of a subset of layers assigned thereto to a downstream computing device from the plurality of computing devices, and

the downstream computing device is configured to receive the output data and to further process the output data by way of the subset of layers assigned thereto.

3 . The system according to claim 1 , wherein at least one of the computing devices is integrated in the sensor module.

4 . The system according to claim 1 , wherein at least one of the computing devices is arranged in or on the vehicle.

5 . The system according to claim 1 , wherein at least one of the computing devices is arranged at a distance from the vehicle.

6 . The system according to claim 1 , further comprising an interface for wireless data transmission of an intermediate result between one of the computing devices and another of the computing devices.

7 . The system according to claim 1 , wherein:

the system comprises a plurality of sensor modules for acquiring the surroundings data,

the computing devices jointly implement a plurality of artificial neural networks, and

each of the networks of the plurality of networks is assigned to a respective sensor module from the plurality of sensor modules and is configured to process the surroundings data acquired by way of the assigned sensor module.

8 . The system according to claim 7 , wherein:

each of the sensor modules is assigned a computing device close to a sensor from the plurality of computing devices, and

each of the assigned computing devices implements a subset of the layers of the network assigned to the respective sensor module.

9 . The system according to claim 8 , wherein at least one computing device separate from the sensor modules from the plurality of computing devices implements subsets of the layers of the plurality of networks.

10 . A computer product comprising a non-transitory computer readable medium having stored thereon program code which, when executed on a processor, causes the system according to claim 1 to carry out a method of detecting the surroundings of the vehicle by:

acquiring the surroundings data by way of the sensor module; and

processing the acquired surroundings data by way of the artificial neural network.

11 . A method for detecting surroundings of a vehicle, the method comprising:

acquiring surroundings data by way of a sensor module;

processing the acquired surroundings data by way of an artificial neural network, wherein:

the network is implemented by a plurality of computing devices that are spatially separate from one another,

the network comprises multiple layers of artificial neurons, and

each of the computing devices implements a subset of the layers;

outputting, by way of one of the computing devices, output data from an output layer of the subset of layers assigned to the one of the computing devices to a downstream computing device from the plurality of computing devices;

receiving the output data by way of the downstream computing device;

further processing the output data by way of the subset of layers of the network assigned to the downstream computing device; and

training the network such that, with a given data amount of the acquired surroundings data to be processed, a smallest possible amount of the output data is transmitted from the one of the computing devices to the downstream computing device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2023
From: BIEBL, ERWIN; PEREZ, RODRIGO; RASSHOFER, RALPH HELMAR
To: BAYERISCHE MOTOREN WERKE AKTIENGESELLSCHAFT
Reel/Frame 063502/0803 →
Priority Claims (1)
DE 10 2020 128 461.6 · Oct 29, 2020 · national
Continuity (1)
Related Publication 20240353229A1 · Oct 24, 2024
References Cited (18)
US 11221929B1 · Katz · 2022 [cited by examiner]
US 20180308202A1 · Appu et al. · 2018 [cited by applicant]
US 20200175286A1 · Major · 2020 [cited by examiner]
US 20200202168A1 · Mao · 2020 [cited by examiner]
US 20210303872A1 · Makke · 2021 [cited by examiner]
US 20210383209A1 · Brahma · 2021 [cited by examiner]
US 20210406560A1 · Park · 2021 [cited by examiner]
US 20220092412A1 · Srivastava · 2022 [cited by examiner]
DE 102018209595A1 · 2019 [cited by applicant]
Bose, L. et al., “A Camera That CNNs: Towards Embedded Neural Networks on Pixel Processor Arrays”, 2019 IEEE/CVF International Conference on Computer Vision (ICCV), IEEE, Oct. 27, 2019, pp. 1335-1344, XP033723837 (10 pa… [cited by applicant]
International Search Report (PCT/ISA/210) issued in PCT Application No. PCT/EP2021/075810 dated Dec. 13, 2021 with English translation (six (6) pages). [cited by applicant]
German-language Written Opinion (PCT/ISA/237) issued in PCT Application No. PCT/EP2021/075810 dated Dec. 13, 2021 (seven (7) pages). [cited by applicant]
German-language Search Report issued in German Application No. 10 2020 128 461.6 dated Jun. 10, 2021 with partial English translation (12 pages). [cited by applicant]
“Rechtsfolgen zunehmender Fahrzeugautomatisierung”, Bundesanstalt fuer Strassenwesen (BASt) [German Federal Highway Research Institute], Forschung kompakt [Research News] , Edition Nov. 2012 with English Abstract (two (… [cited by applicant]
“(R) Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles”, Surface Vehicle Recommended Practice, SAE (Society of Automotive Engineering) International, J3016™, Sep. 2016, … [cited by applicant]
Grigorescu S. et al., A Survey of Deep Learning Techniques for Autonomous Driving, Mar. 24, 2020 (28 pages). [cited by applicant]
Huang Y. et al., Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies, Jul. 4, 2020, XP055868668 (33 pages). [cited by applicant]
FLIR launches industry's first' deep learning camera, Jan. 19, 2020, pp. 1-2, XP055868732 (two (2) pages). [cited by applicant]