Systems and methods for improved monitoring of a vehicle integration platform
Example aspects of the present disclosure are directed to systems and methods that generate simulated communications traffic to enable improved monitoring of the performance of a vehicle integration platform (VIP) associated with a service provider entity. For instance, the VIP can provide services to or otherwise communicate with a number of different clients (e.g., autonomous vehicles included in one or more fleets of autonomous vehicles). However, when, for various operational reasons, the one or more fleets of autonomous vehicle are not operating or otherwise communicating with the VIP, it can be difficult to assess whether the VIP is correctly operating. As such, according to an aspect of the present disclosure, a watchdog monitoring system can be included in or otherwise interoperate with the VIP.
1. A computer-implemented method, comprising:
determining, by a computing system comprising one or more computing devices, a first level of communications traffic, wherein the first level of communications traffic is indicative of an amount of actual communications traffic occurring via a vehicle integration platform, wherein the vehicle integration platform comprises a plurality of application programming interfaces configured to facilitate message communication among clients;
determining, by the computing system, a predetermined minimum level of desired communications traffic occurring via the vehicle integration platform, wherein the predetermined minimum level of desired communications traffic is representative of a level at which performance measures of the vehicle integration platform are evaluated;
generating, by the computing system, a second level of communications traffic, wherein the second level of communications traffic comprises an amount of simulated communications traffic determined such that the second level of communications traffic plus the first level of communications traffic is greater than or equal to the predetermined minimum level of desired communications traffic occurring via the vehicle integration platform, wherein the simulation communications traffic is generated based on historical actual communication; and
monitoring, by the computing system, one or more performance characteristics of the vehicle integration platform while at least the second level of communications traffic is occurring via the vehicle integration platform.
2. The computer-implemented method of claim 1 , further comprising:
generating, by the computing system, an alert when the one or more performance characteristics of the vehicle integration platform satisfies one or more predetermined conditions; and
relaying, by the computing system, the alert to one of the clients of the vehicle integration platform.
3. The computer-implemented method of claim 1 , wherein the first level of communications traffic and the second level of communications traffic are indistinguishable by the vehicle integration platform.
4. The computer-implemented method of claim 1 , wherein the clients comprise at least one third-party client associated with a fleet of autonomous vehicles and at least one first-party client associated with a service provider entity.
5. The computer-implemented method of claim 1 , wherein:
the one or more performance characteristics of the vehicle integration platform comprises at least one latency value determined for a request communicated by one of the clients through the vehicle integration platform between first and second communication nodes thereof; and
the method further comprises publishing, by the computing system, the at least one latency value to a source accessible by one or more of the clients of the vehicle integration platform.
6. The computer-implemented method of claim 5 , further comprising generating, by the computing system, an alert when the at least one latency value exceeds a predetermined threshold level.
7. The computer-implemented method of claim 1 , wherein the one or more performance characteristics of the vehicle integration platform comprise a transmission performance rating associated with one or more of a request provided to the vehicle integration platform and a response received from the vehicle integration platform.
8. The computer-implemented method of claim 1 , further comprising publishing, by the computing system, the amount of simulated communications traffic corresponding to the second level of communications traffic on a periodic basis to a source accessible by one or more of the clients of the vehicle integration platform.
9. The computer-implemented method of claim 1 , wherein the steps of determining a first level of communications traffic and generating a second level of communications traffic are implemented periodically to dynamically ensure over different increments of time that the second level of communications traffic plus the first level of communications traffic is greater than or equal to the predetermined minimum level of desired communications traffic occurring via the vehicle integration platform.
10. A computing system, comprising:
one or more processors; and
one or more memories including instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
determining a first level of communications traffic, wherein the first level of communications traffic is indicative of an amount of actual communications traffic occurring via a vehicle integration platform, wherein the vehicle integration platform comprises a plurality of application programming interfaces configured to facilitate message communication among clients;
determining a predetermined minimum level of desired communications traffic occurring via the vehicle integration platform, wherein the predetermined minimum level of desired communications traffic is representative of a level at which performance measures of the vehicle integration platform are evaluated;
generating a second level of communications traffic, wherein the second level of communications traffic comprises an amount of simulated communications traffic determined such that the second level of communications traffic plus the first level of communications traffic is greater than or equal to the predetermined minimum level of desired communications traffic occurring via the vehicle integration platform, wherein the simulation communications traffic is generated based on historical actual communication; and
monitoring one or more performance characteristics of the vehicle integration platform while at least the second level of communications traffic is occurring via the vehicle integration platform.
11. The computing system of claim 10 , wherein the operations further comprise:
generating an alert when the one or more performance characteristics of the vehicle integration platform satisfies one or more predetermined conditions; and
relaying the alert to one of the clients of the vehicle integration platform.
12. The computing system of claim 10 , wherein the first level of communications traffic and the second level of communications traffic are indistinguishable by the vehicle integration platform.
13. The computing system of claim 10 , wherein the clients comprise at least one third-party client associated with a fleet of autonomous vehicles and at least one first-party client associated with a service provider entity.
14. The computing system of claim 10 , wherein:
the one or more performance characteristics of the vehicle integration platform comprises at least one latency value determined for a request communicated by one of the clients through the vehicle integration platform between first and second communication nodes thereof; and
the operations further comprise: publishing the at least one latency value to a source accessible by one or more of the clients of the vehicle integration platform.
15. The computing system of claim 14 , wherein the operations further comprise: generating an alert when the at least one latency value exceeds a predetermined threshold level.
16. The computing system of claim 10 , wherein the one or more performance characteristics of the vehicle integration platform comprise a transmission performance rating associated with one or more of a request provided to the vehicle integration platform and a response received from the vehicle integration platform.
17. The computing system of claim 10 , wherein the operations of determining the first level of communications traffic and generating the second level of communications traffic are implemented periodically to dynamically ensure over different increments of time that the second level of communications traffic plus the first level of communications traffic is greater than or equal to the predetermined minimum level of desired communications traffic occurring via the vehicle integration platform.
18. A communication infrastructure, comprising:
a vehicle integration platform comprising a plurality of application programming interfaces configured to facilitate message communication among clients, the clients comprising at least one third-party client associated with a fleet of autonomous vehicles and at least one first-party client associated with a service provider entity; and
a monitoring system configured to:
determine a first level of communications traffic, wherein the first level of communications traffic is indicative of an amount of actual communications traffic occurring via a vehicle integration platform;
determine a predetermined minimum level of desired communications traffic occurring via the vehicle integration platform, wherein the predetermined minimum level of desired communications traffic is representative of a level at which performance measures of the vehicle integration platform are evaluated;
generate a second level of communications traffic, wherein the second level of communications traffic comprises an amount of simulated communications traffic determined such that the second level of communications traffic plus the first level of communications traffic is greater than or equal to the predetermined minimum level of desired communications traffic occurring via the vehicle integration platform, wherein the simulation communications traffic is generated based on historical actual communication; and
monitor one or more performance characteristics of the vehicle integration platform while at least the second level of communications traffic is occurring via the vehicle integration platform.
19. The communication infrastructure of claim 18 , wherein the monitoring system is configured to publish one or more of the amount of simulated communications traffic corresponding to the second level of communications traffic and the one or more performance characteristics to a source accessible by one or more of the clients of the vehicle integration platform.
20. The communication infrastructure of claim 18 , wherein:
the one or more performance characteristics of the vehicle integration platform comprises at least one latency value determined for a request communicated by one of the clients through the vehicle integration platform between first and second communication nodes thereof; and
the monitoring system is configured to generate an alert when the at least one latency value exceeds a predetermined threshold level.