IP Library Granted Patent US 11,156,573
Granted Patent B2
US 11,156,573 · App. 15/640,135 · Granted Oct 26, 2021

Solar panel inspection using unmanned aerial vehicles

Inventors: Bernard J. Michini (San Francisco, CA); Fabien Blanc-Paques (San Francisco, CA); Edward Dale Steakley (Cupertino, CA)
Assignee: Skydio, Inc.
G01N25/72H02S50/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,156,573
App. No.
15/640,135
Granted
Oct 26, 2021
Kind
B2
Abstract

Methods, systems, and program products of inspecting solar panels using unmanned aerial vehicles (UAVs) are disclosed. A UAV can obtain a position of the Sun in a reference frame, a location of a solar panel in the reference frame, and an orientation of the solar panel in the reference frame. The UAV can determine a viewing position of the UAV in the reference frame based on at least one of the position of the Sun, the location of the solar panel, and the orientation of the solar panel. The UAV can maneuver to the viewing position and point a thermal sensor onboard the UAV at the solar panel. The UAV can capture, by the thermal sensor, a thermal image of at least a portion of the solar panel. A server onboard the UAV or connected to the UAV can detect panel failures based on the thermal image.

Claims (114)

1. A system comprising one or more processors, and a non-transitory computer-readable medium including one or more sequences of instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

determining viewing positions of an unmanned aerial vehicle (UAV) used for inspection of one or more solar panels based at least upon orientations of the one or more solar panels;

determining a flight path for the UAV for inspection of the one or more solar panels based on the viewing positions;

navigating the UAV according to the flight path;

obtaining, at a plurality of geo-spatial locations associated with the viewing positions, respective thermal images of the one or more solar panels;

determining, based on the obtained thermal images, whether the one or more solar panels or one or more solar cells of a respective solar panel failed; and

generating a report indicating whether the one or more solar panels, or the one or more solar cells failed.

2. The system of claim 1 , wherein determining the viewing positions of the UAV comprises:

obtaining a position of the Sun in a reference frame, a location of a solar panel of the one or more solar panels in the reference frame, and an orientation of the solar panel in the reference frame;

determining a viewing position of the UAV in the reference frame based on at least one of the position of the Sun, the location of the solar panel, and the orientation of the solar panel.

3. The system of claim 2 , wherein obtaining the position of the Sun comprises:

obtaining a time of capturing the thermal images; and

determining the position of the Sun based on the time of capturing the thermal images.

4. The system of claim 2 , wherein obtaining the position of the Sun comprises:

obtaining an image of the sky by the UAV;

associating the image of the sky with the reference frame; and

determining the position of the Sun in the reference frame based on the image of the sky.

5. The system of claim 2 , wherein determining the viewing position comprises:

determining a UAV position that is within a threshold distance from the location of the solar panel, and determining a viewing angle of a thermal sensor relative to the solar panel that avoids or reduces a reflection of the Sun from the solar panel; and

designating the UAV position as the viewing position.

6. The system of claim 1 , wherein determining whether at least a portion of the solar panel failed comprises:

comparing the thermal image with one or more thermal images of one or more other thermal panels; and

determining that the solar panel failed upon determining that a difference between thermal energies represented in the thermal image and thermal energies represented in the one or more other thermal image exceeds a panel fail threshold.

7. The system of claim 1 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that thermal energy of a solar cell of the solar panel exceeds thermal energies of one or more other solar cells of the solar panel by at least a threshold difference amount; and

in response, determining that at the solar cell of the solar panel failed.

8. The system of claim 1 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a string of solar cells of the solar panel are overheating; and

in response, determining that the string of solar cells failed.

9. The system of claim 1 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that at least a threshold number of overheating cells are randomly distributed in the solar panel; and

in response, determining that the solar panel failed.

10. The system of claim 1 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a part of a solar cell of the solar panel is overheating; and

determining that the overheating solar cell failed due to a rupture.

11. The system of claim 1 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a portion of the solar panel including a plurality of solar cells is overheating; and

determining that the solar panel failed due to one or more cracks at the portion of the solar panel.

12. A method implemented by a system comprising one or more processors, the method comprising:

determining viewing positions of an unmanned aerial vehicle (UAV) used for inspection of one or more solar panels based at least upon orientations of the one or more solar panels;

determining a flight path for the UAV for inspection of the one or more solar panels based on the viewing positions;

navigating the UAV according to the flight path;

obtaining, at a plurality of geo-spatial locations associated with the viewing positions, respective thermal images of the one or more solar panels;

determining, based on the obtained thermal images, whether the one or more solar panels or one or more solar cells of a respective solar panel failed; and

generating a report indicating whether the one or more solar panels, or the one or more solar cells failed.

13. The method of claim 12 , wherein determining the viewing positions of the UAV comprises:

obtaining a position of the Sun in a reference frame, a location of a solar panel of the one or more solar panels in the reference frame, and an orientation of the solar panel in the reference frame;

determining a viewing position of the UAV in the reference frame based on at least one of the position of the Sun, the location of the solar panel, and the orientation of the solar panel.

14. The method of claim 13 , wherein obtaining the position of the Sun comprises:

obtaining a time of capturing the thermal images; and

determining the position of the Sun based on the time of capturing the thermal images.

15. The method of claim 13 , wherein obtaining the position of the Sun comprises:

obtaining an image of the sky by the UAV;

associating the image of they sky with the reference frame; and

determining the position of the Sun in the reference frame based on the image of the sky.

16. The method of claim 13 , wherein determining the viewing position comprises:

determining a UAV position that is within a threshold distance from the location of the solar panel, and determining a viewing angle of a thermal sensor relative to the solar panel that avoids or reduces a reflection of the Sun from the solar panel; and

designating the UAV position as the viewing position.

17. The method of claim 12 , wherein determining whether at least a portion of the solar panel failed comprises:

comparing the thermal image with one or more thermal images of one or more other thermal panels; and

determining that the solar panel failed upon determining that a difference between thermal energies represented in the thermal image and thermal energies represented in the one or more other thermal image exceeds a panel fail threshold.

18. The method of claim 12 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that thermal energy of a solar cell of the solar panel exceeds thermal energies of one or more other solar cells of the solar panel by at least a threshold difference amount; and

in response, determining that at the solar cell of the solar panel failed.

19. The method of claim 12 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a string of solar cells of the solar panel are overheating; and

in response, determining that the string of solar cells failed.

20. The method of claim 12 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that at least a threshold number of overheating cells are randomly distributed in the solar panel; and

in response, determining that the solar panel failed.

21. The method of claim 12 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a part of a solar cell of the solar panel is overheating; and

determining that the overheating solar cell failed due to a rupture.

22. The method of claim 12 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a portion of the solar panel including a plurality of solar cells is overheating; and

determining that the solar panel failed due to one or more cracks at the portion of the solar panel.

23. A non-transitory computer storage medium comprising instructions that when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:

determining viewing positions of an unmanned aerial vehicle (UAV) used for inspection of one or more solar panels based at least upon orientations of the one or more solar panels;

determining a flight path for the UAV for inspection of the one or more solar panels based on the viewing positions;

navigating the UAV according to the flight path;

obtaining, at a plurality of geo-spatial locations associated with the viewing positions, respective thermal images of the one or more solar panels;

determining, based on the obtained thermal images, whether the one or more solar panels or one or more solar cells of a respective solar panel failed; and

generating a report indicating whether the one or more solar panels, or the one or more solar cells failed.

24. The non-transitory computer storage medium of claim 23 , wherein determining the viewing positions of the UAV comprises:

obtaining a position of the Sun in a reference frame, a location of a solar panel of the one or more solar panels in the reference frame, and an orientation of the solar panel in the reference frame;

determining a viewing position of the UAV in the reference frame based on at least one of the position of the Sun, the location of the solar panel, and the orientation of the solar panel.

25. The non-transitory computer storage medium of claim 24 , wherein obtaining the position of the Sun comprises:

obtaining a time of capturing the thermal images; and

determining the position of the Sun based on the time of capturing the thermal images.

26. The non-transitory computer storage medium of claim 24 , wherein obtaining the position of the Sun comprises:

obtaining an image of the sky by the UAV;

associating the image of the sky with the reference frame; and

determining the position of the Sun in the reference frame based on the image of the sky.

27. The non-transitory computer storage medium of claim 24 , wherein determining the viewing position comprises:

determining a UAV position that is within a threshold distance from the location of the solar panel, and determining a viewing angle of a thermal sensor relative to the solar panel that avoids or reduces a reflection of the Sun from the solar panel; and

designating the UAV position as the viewing position.

28. The non-transitory computer storage medium of claim 23 , wherein determining whether at least a portion of the solar panel failed comprises:

comparing the thermal image with one or more thermal images of one or more other thermal panels; and

determining that the solar panel failed upon determining that a difference between thermal energies represented in the thermal image and thermal energies represented in the one or more other thermal image exceeds a panel fail threshold.

29. The non-transitory computer storage medium of claim 23 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that thermal energy of a solar cell of the solar panel exceeds thermal energies of one or more other solar cells of the solar panel by at least a threshold difference amount; and

in response, determining that at the solar cell of the solar panel failed.

30. The non-transitory computer storage medium of claim 23 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a string of solar cells of the solar panel are overheating; and

in response, determining that the string of solar cells failed.

31. The non-transitory computer storage medium of claim 23 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that at least a threshold number of overheating cells are randomly distributed in the solar panel; and

in response, determining that the solar panel failed.

32. The non-transitory computer storage medium of claim 23 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a part of a solar cell of the solar panel is overheating; and

determining that the overheating solar cell failed due to a rupture.

33. The non-transitory computer storage medium of claim 23 , wherein determining whether at least a portion of the solar panel failed comprises:

determining, based on the thermal image, that a portion of the solar panel including a plurality of solar cells is overheating; and

determining that the solar panel failed due to one or more cracks at the portion of the solar panel.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2023
From: MICHINI, BERNARD J.; BLANC-PAQUES, FABIEN; STEAKLEY, EDWARD DALE
To: UNMANNED INNOVATION, INC.
Reel/Frame 064740/0403 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CONVEYING PARTY DATA WAS ERRONEOUSLY ENTER AS UNMMANED INNOVATIONS, INC. IT SHOULD READ UNMANNED INNOVATIONS, INC PREVIOUSLY RECORDED AT REEL: 053144 FRAME: 0591. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 15, 2020
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053210/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 053144/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: UNMMANED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053144/0591 →
Continuity (2)
Provisional Application 62357340 · Jun 30, 2016
Related Publication 20180003656A1 · Jan 4, 2018
Cited By (1)
US 12,339,242