IP Library › Granted Patent US 12,258,045
Granted Patent B2
US 12,258,045 · App. 17/168,406 · Granted Mar 25, 2025

Systems and methods for vehicular-network-assisted federated machine learning

Inventors: Seyhan Ucar (Mountain View, CA); Takamasa Higuchi (Mountain View, CA); Chang-Heng Wang (Mountain View, CA); Enes Krijestorac (Los Angeles, CA); Onur Altintas (Mountain View, CA)
Assignee: Toyota Motor Engineering & Manufacturing North America, Inc.
B60W60/00184G01C21/343G06F18/214G06F18/2148G06N20/00G06V20/56H04W4/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,258,045
App. No.
17/168,406
Filed
Feb 5, 2021
Granted
Mar 25, 2025
Kind
B2
Art Unit
3667
USPC
701/23
Abstract

Systems and methods for vehicular-network-assisted federated machine learning are disclosed herein. One embodiment transmits first metadata from a connected vehicle to at least one other connected vehicle; receives, at the connected vehicle, second metadata from the at least one other connected vehicle; receives, at the connected vehicle based on analysis of the first and second metadata, a notification that the connected vehicle has been elected to participate in the current training phase of a federated machine learning process; receives, at the connected vehicle, instructions to prepare the connected vehicle for the next training phase; trains a machine learning model to perform a task at the connected vehicle during the current training phase to produce a locally trained machine learning model; and submits the locally trained machine learning model for aggregation with at least one other locally trained machine learning model to produce an aggregated locally trained machine learning model.

Claims (33)

1. A system for vehicular-network-assisted federated machine learning, the system comprising:

a processor; and

a memory storing computer-readable instructions that, when executed by the processor, cause the processor to:

exchange metadata between a connected vehicle and at least one other connected vehicle in a vehicular micro cloud, wherein the metadata includes information regarding sensor capabilities of the connected vehicle and the at least one other connected vehicle;

receive, at the connected vehicle based on an analysis of the metadata, a notification that the connected vehicle has been elected to participate in a current training phase of a federated machine learning process;

receive, at the connected vehicle, instructions that position the connected vehicle to provide information about an object of interest to the federated machine learning process;

train a machine learning model to perform a task at the connected vehicle during the current training phase to produce a locally trained machine learning model; and

submit the locally trained machine learning model for aggregation with at least one other locally trained machine learning model produced by at least one other elected vehicle in the vehicular micro cloud to produce an aggregated locally trained machine learning model that is used as a starting point for a next training phase of the federated machine learning process.

2. The system of claim 1 , wherein the metadata includes information regarding at least one of availability of particular types of sensors, capabilities of specific available sensors, quality of the specific available sensors, and an itinerary that includes scheduled stops.

3. The system of claim 1 , wherein the connected vehicle receives the instructions that position the connected vehicle through coordination among a cloud leader of the vehicular micro cloud and at least one other cloud leader of a different vehicular micro cloud within a same vehicular macro cloud.

4. The system of claim 1 , wherein the analysis of the metadata is performed at one of a cloud server and an edge server, the analysis of the metadata resulting in the connected vehicle being elected to participate in the current training phase of the federated machine learning process.

5. The system of claim 1 , wherein the analysis of the metadata is performed at the connected vehicle and the at least one other connected vehicle in a distributed fashion, the analysis of the metadata resulting in the connected vehicle being elected to participate in the current training phase of the federated machine learning process.

6. The system of claim 1 , wherein the connected vehicle and the at least one other connected vehicle communicate via one or more vehicle-to-vehicle (V2V) communication links.

7. The system of claim 1 , wherein the aggregated locally trained machine learning model is further aggregated with at least one other aggregated locally trained machine learning model from another vehicular micro cloud at one of a cloud server and an edge server in preparation for the next training phase of the federated machine learning process.

8. The system of claim 1 , wherein the connected vehicle is an autonomous vehicle.

9. A non-transitory computer-readable medium for vehicular-network-assisted federated machine learning and storing instructions that, when executed by a processor, cause the processor to:

exchange metadata between a connected vehicle and at least one other connected vehicle in a vehicular micro cloud, wherein the metadata includes information regarding sensor capabilities of the connected vehicle and the at least one other connected vehicle;

receive, at the connected vehicle based on an analysis of the metadata, a notification that the connected vehicle has been elected to participate in a current training phase of a federated machine learning process;

receive, at the connected vehicle, instructions that position the connected vehicle to provide information about an object of interest to the federated machine learning process;

train a machine learning model to perform a task at the connected vehicle during the current training phase to produce a locally trained machine learning model; and

submit the locally trained machine learning model for aggregation with at least one other locally trained machine learning model produced by at least one other elected vehicle in the vehicular micro cloud to produce an aggregated locally trained machine learning model that is used as a starting point for a next training phase of the federated machine learning process.

10. The non-transitory computer-readable medium of claim 9 , wherein the metadata includes information regarding at least one of availability of particular types of sensors, capabilities of specific available sensors, quality of the specific available sensors, and an itinerary that includes scheduled stops.

11. A method, comprising:

exchanging metadata between a connected vehicle and at least one other connected vehicle in a vehicular micro cloud, wherein the metadata includes information regarding sensor capabilities of the connected vehicle and the at least one other connected vehicle;

receiving, at the connected vehicle based on an analysis of the metadata, a notification that the connected vehicle has been elected to participate in a current training phase of a federated machine learning process;

receiving, at the connected vehicle, instructions that position the connected vehicle to provide information about an object of interest to the federated machine learning process;

training a machine learning model to perform a task at the connected vehicle during the current training phase to produce a locally trained machine learning model; and

submitting the locally trained machine learning model for aggregation with at least one other locally trained machine learning model produced by at least one other elected vehicle in the vehicular micro cloud to produce an aggregated locally trained machine learning model that is used as a starting point for a next training phase of the federated machine learning process.

12. The method of claim 11 , wherein the metadata includes information regarding at least one of availability of particular types of sensors, capabilities of specific available sensors, quality of the specific available sensors, and an itinerary that includes scheduled stops.

13. The method of claim 11 , wherein the analysis of the metadata is performed at one of a cloud server and an edge server, the analysis of the metadata resulting in the connected vehicle being elected to participate in the current training phase of the federated machine learning process.

14. The method of claim 11 , wherein the analysis of the metadata is performed at the connected vehicle and the at least one other connected vehicle in a distributed fashion, the analysis of the first and second metadata resulting in the connected vehicle being elected to participate in the current training phase of the federated machine learning process.

15. The method of claim 11 , wherein the connected vehicle and the at least one other connected vehicle communicate via one or more vehicle-to-vehicle (V2V) communication links.

16. The method of claim 11 , wherein the aggregated locally trained machine learning model is further aggregated with at least one other aggregated locally trained machine learning model from another vehicular micro cloud at one of a cloud server and an edge server in preparation for the next training phase of the federated machine learning process.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2025
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 070763/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2021
From: UCAR, SEYHAN; HIGUCHI, TAKAMASA; WANG, CHANG-HENG; KRIJESTORAC, ENES; ALTINTAS, ONUR
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 055199/0288 →
Continuity (1)
Related Publication 20220250656A1 · Aug 11, 2022
References Cited (18)
US 20180191867A1 · Siebel · 2018 [cited by examiner]
US 20200017117A1 · Milton · 2020 [cited by examiner]
US 20200027019A1 · Yang · 2020 [cited by examiner]
US 20220250656A1 · Ucar · 2022 [cited by examiner]
WO 2020115273A1 · 2020 [cited by applicant]
Hao Ye et al. “Machine Learning for Vehicular Networks: Recent Advances and Application Examples,” IEEE Vehicular Technology Magazine (vol. 13, 2018, Issue: 2, pp. 94-101), (Year: 2018). [cited by examiner]
Savazzi et al., “Federated Learning with Mutually Cooperating Devices: A Consensus Approach Towards Server-Less Model Optimization,” Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal … [cited by applicant]
Lu et al., “Federated Learning for Data Privacy Preservation in Vehicular Cyber-Physical Systems,” IEEE, 2020, found at http://heim.ifi.uio.no/˜yanzhang/IEEENetworkMayJune2020.pdf. [cited by applicant]
He et al., “Central Server Free Federated Learning over Single-Sided Trust Social Networks,” arXiv:1910.04956v2, Aug. 1, 2020, found at https://arxiv.org/pdf/1910.04956.pdf. [cited by applicant]
Elbamby et al., “Wireless Edge Computing with Latency and Reliability Guarantees,” arXiv:1905.05316v1, May 13, 2019, found at https://arxiv.org/pdf/1905.05316.pdf. [cited by applicant]
Lu et al., “Blockchain Empowered Asynchronous Federated Learning for Secure Data Sharing in Internet of Vehicles,” IEEE Transactions on Vehicular Technology, vol. 69, No. 4, Apr. 2020, found at http://heim.ifi.uio.no/˜y… [cited by applicant]
Samarakoon et al., “Federated Learning for Ultra-Reliable Low-Latency V2V Communications,” arXiv:1805.09253v1, May 11, 2018, found at https://arxiv.org/pdf/1805.09253.pdf. [cited by applicant]
Chiu et al., “Semisupervised Distributed Learning with Non-IID Data for AIoT Service Platform,” IEEE Internet of Things Journal, vol. 7, No. 10, Oct. 2020. [cited by applicant]
Du et al., “Federated Learning for Vehicular Internet of Things: Recent Advances and Open Issues,” IEEE Open Journal of the Computer Society, May 6, 2020, available at https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumbe… [cited by applicant]
Elbir et al., “Federated Learning in Vehicular Networks,” arXiv:2006.01412v2, Sep. 19, 2020, available at https://arxiv.org/pdf/2006.01412.pdf. [cited by applicant]
McMahan et al., “Communication-Efficient Learning of Deep Networks from Decentralized Data,” Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS) 2017, Fort Lauderdale, Fl… [cited by applicant]
Ye et al., “Federated Learning in Vehicular Edge Computing: A Selective Model Aggregation Approach,” IEEE Access, Jan. 21, 2020, available at https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8964354. [cited by applicant]
Deveaux et al., “On the Orchestration of Federated Learning Through Vehicular Knowledge Networking”, 2020 IEEE Vehicular Networking Conference (VNC), New York, NY, USA, 2020, pp. 1-8. [cited by applicant]
Cited By (1)
US 12,683,644