System and method for integrating cameras with visual artificial intelligence in electric vehicle charging stations
The present disclosure introduces an Electric Vehicle (EV) Charger Camera Visual Artificial Intelligence System (EV-CVAIS), integrating cameras with visual artificial intelligence into electric vehicle charging stations. These stations may incorporate EV-CVAIS, featuring a camera for monitoring, security, and visual AI analysis. The camera can capture images or video of the EV and its surroundings, regardless of charging status or EV presence, with options for remote viewing or local storage. The EV-CVAIS may serve security purposes by detecting and deterring theft or vandalism. Moreover, the EV-CVAIS utilizes visual AI algorithms to analyze captured images or video, offering insights such as EV make and model identification, maintenance issue detection, or EV occupancy assessment. Additionally, an integrated alarm system is included in the EV-CVAIS, activated upon vandalism or certain actions detection, enhancing security measures.
1 . A system comprising:
an electric vehicle (EV) charger camera visual artificial intelligence system (EV-CVAIS);
an EV charging station;
a camera mounted on the EV charging station;
a computing device integrated within the EV charging station, the computing device comprising, at least one of the following integrated within the EV charging station executing an electric vehicle (EV) charger camera visual artificial intelligence module: a processing unit, and a memory storage;
wherein the computing device is embodied as at least one of: a mobile computing device, a tablet, a smartphone, a drone, a wearable camera, a handheld camera, an installed camera, and a remotely operable recording device;
wherein the computing device further comprises sensing devices, wherein the sensing devices further comprise at least one of: a camera, a speaker, and a microphone;
wherein the computing device communicates with the sensing devices;
wherein the sensing devices provide telemetry data associated with the computing device;
wherein the electric vehicle (EV) charger camera visual artificial intelligence system (EV-CVAIS) is integrated into the EV charging station and detecting vehicle presence and readiness to charge based on visual inputs captured by the camera mounted on the EV charging station;
wherein the camera provides data to an onboard computing module executing AI-based object recognition algorithms;
wherein the EV-CVAIS is a component of an EV charger;
wherein the computing device having the processing unit follows a set of computer instructions enabling the operation of at least one of the following modules: a Temperature Module, a Humidity Module, a Pressure Module, a Voltage Module, a Power Module, a Current Module, a Near Field Communication (NFC) Module, a Motion Module, an Audio Module, an Alarm Module, a Security Module, a Visual AI Module, a Dust Module, an EV-CVAIS Module, a Content Display Module, Content Transmission Module, and a Streaming Module; and
wherein the EV-CVAIS performs at least one of the following:
capturing images and video of the EV and its surroundings, regardless of charging status and EV presence,
providing for viewing with at least one of local storage and cloud based storage,
providing security of the EV by detecting and deterring theft and vandalism,
analyzing capture images and video utilizing visual AI algorithms, wherein the visual AI algorithms perform at least one of:
determining EV make and model identification,
determining maintenance issue detection,
determining EV occupancy assessment,
activating of an integrated alarm system when sensing devices detect vandalism and certain actions triggering activation.
2 . The system of claim 1 , the system controlling at least one of: a user interface module, a content capturing module, a timing module, a location module, an orientation module, and a communications module; and wherein the EV-CVAIS comprises a convolutional neural network trained to detect vehicle alignment and charging port visibility.
3 . The system of claim 1 , wherein the camera is used for security purposes, including but not limited to detecting and deterring theft and vandalism of the electric vehicle and its charging station; and wherein the EV-CVAIS further includes edge-based object classifiers identifying charging port readiness.
4 . The system of claim 1 , further comprising a network connection for viewing of the captured images and videos; and wherein a controller is transmitting telemetry feedback to at least one of a mobile application and utility network interface based on an AI-classified readiness state.
5 . The system of claim 1 , further comprising a local storage device that stores the captured images and videos; and
further comprising a modular architecture wherein a base version includes the camera and an AI module, and a premium version includes additional environmental sensors selected from the group consisting of audio sensors, thermal sensors, voltage monitors, and motion detectors.
6 . The system of claim 1 , further comprising an onboard battery for powering the camera and other internal components during a power outage; and
wherein at least one visual AI algorithm is utilized by the EV-CVAIS to perform at least one of: analyze captured images or video, offering insights such as EV make and model identification, detect a maintenance issue, and assess EV occupancy status.
7 . The system of claim 1 , further comprising visual AI algorithms that analyze the captured images and video to provide valuable insights.
8 . The system of claim 1 , wherein the at least one module processes image data captured by the cameras integrated within the EV charging station.
9 . A method performed by an electric vehicle (EV) charging station, the method comprising:
activating one or more cameras mounted on an electric vehicle (EV) charging station;
integrating charging station mounted cameras with an electric vehicle (EV) charger camera visual artificial intelligence system (EV-CVAIS) in the electric vehicle (EV) charging station;
capturing image data using one or more cameras integrated within the charging station wherein image data comprises at least one of: images, video, and information to store, wherein storage is locally within the electric vehicle (EV) charging station;
analyzing operational sensor data from sensors integrated within the electric vehicle (EV) charging station by the electric vehicle (EV) charger camera visual artificial intelligence system (EV-CVAIS) to determine at least one of:
a pressure sensor registered an impact,
an audio sensor detected loud noise above a predetermined sound threshold,
a humidity sensor detected water,
a temperature sensor detected extreme temperatures,
a voltage sensor detected a power surge,
a current sensor detected a power surge,
a power sensor detected a power surge;
determining no sensor has been triggered, thereby remaining in a passive state;
wherein remaining in a passive state, further comprises:
periodically capturing at least one of: images, video, and information to store, wherein storage is locally within the electric vehicle (EV) charging station;
upon determining that a sensor among the sensors integrated within the electric vehicle (EV) charging station has affirmatively been triggered, the EV-CVAIS performs at least one of:
activating live video recording,
sending alerts to an owner,
notifying the owner,
activating sound, and
activating an alarm system;
wherein the electric vehicle (EV) charger camera visual artificial intelligence system (EV-CVAIS) classifies visual indicators captured by the camera and transmits instructions to initiate charging without requiring manual input from the vehicle or user; and
wherein image processing and decision-making occurs locally within the EV charging station.
10 . The method of claim 9 , further comprising the EV-CVAIS performing at least one of:
dialing an emergency contact;
dialing local law enforcement;
sending the live video recording to an emergency contact;
sending the live video recording to local law enforcement; and
wherein visual AI processing includes at least one of: evaluating EV charger vehicle open or closed port status, and ambient lighting conditions.
11 . The method of claim 9 , wherein the EV-CVAIS performs at least one of the following responsive to commands from the owner:
deactivating the live feed;
continuing recording and sending alerts to the owner; and
further comprising transmitting a status signal to a grid operator and cloud dashboard based on AI-classified visual data.
12 . The method of claim 9 , wherein the camera is activated by triggering of at least one of: a motion sensor, a proximity sensor, a change in external temperature, a change in humidity, a change in voltage, a change in pressure, a change in sound, a change in dust, a change in near field communication sensor, and in response to a user command.
13 . The method of claim 9 , wherein the EV-CVAIS returns to a passive state.
14 . The method of claim 9 , further comprising:
analyzing, by a processor of the electric vehicle charging station, data acquired from one or more sensors integrated within the electric vehicle charging station to determine whether a vehicle is within a threshold distance near the electric vehicle charging station;
determining, by a visual artificial intelligence integrated into the electric vehicle charging station, whether at least one sensor of the one or more sensors has been triggered;
responsive to determining that the at least one sensor has been triggered, performing at least one of:
capturing vehicle-related data by the camera,
determining, by the processor, whether the vehicle-related data matches a scheduled booking request,
notifying, by the processor, a vehicle driver regarding charging status, or
determining, by the processor, that the vehicle has left the electric vehicle charging station; and
wherein image processing and decision-making are performed by the visual artificial intelligence.
15 . A method for operating an electric vehicle charging station, the method comprising:
activating at least one camera coupled to the electric vehicle charging station;
capturing image data using the at least one camera coupled to the electric vehicle charging station;
analyzing sensor data received by an electric vehicle (EV) charger camera visual artificial intelligence system (EV-CVAIS) integrated into the electric vehicle charging station, by a processor disposed within the electric vehicle charging station to determine if a vehicle is within a threshold distance near the electric vehicle charging station,
determining, by a processor disposed within the electric vehicle charging station, no sensor has been triggered, thereby remaining in a passive state;
wherein remaining in a passive state, further comprises:
periodically capturing, by the at least one camera coupled to the electric vehicle charging station, at least one of: images, video, and information to store, wherein storage is at least one of locally and remotely;
upon determining that a sensor, disposed within the electric vehicle charging station, has affirmatively been triggered, the EV-CVAIS performs at least one of:
capturing vehicle data, by the electric vehicle charging station, wherein vehicle data is at least one of license plate number, car type, vehicle model, phone location;
determining, by a processor disposed within the electric vehicle charging station, vehicle data matches a scheduled booking request;
capturing, by the at least one camera coupled to the electric vehicle charging station, snapshots of vehicle tires, windshield, and every part of the vehicle in view;
comparing, by the at least one camera coupled to the electric vehicle charging station, captured snapshots with manufacturer provided images of a new vehicle;
determining a degree of difference or congruence between the captured snapshots and the manufacturer provided images;
assessing the degree of difference to determine if the degree of difference meets a predetermined threshold;
notifying a vehicle driver, the manufacturer, and a dealer regarding a vehicle status including recommendations and one or more parts that need to be repaired, when determined the degree of difference meets the predetermined threshold;
notifying the vehicle driver and returning to a passive state, that a charging cycle is complete, when the determined the degree of difference does not meet the predetermined threshold;
classifying, by the electric vehicle (EV) charger camera visual artificial intelligence system (EV-CVAIS), visual indicators captured by the camera and transmits instructions to initiate charging without requiring manual input from the vehicle or user; and
performing image processing and decision-making occurs locally within the EV charging station.