IP Library Granted Patent US 11,614,616
Granted Patent B2
US 11,614,616 · App. 16/715,624 · Granted Mar 28, 2023

System and method for a sensor protection mechanism

Inventors: Jinpeng Li (San Jose, CA); Greg Seyfarth (Los Altos, CA); Qiaoyu Zhang (Cupertino, CA); Amit Kumar (Sunnyvale, CA)
Assignee: PlusAI, Inc.
G02B27/0006B08B3/04B08B5/02G01D11/245B60R11/04H04N5/2252H04N5/2253
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,614,616
App. No.
16/715,624
Granted
Mar 28, 2023
Kind
B2
Abstract

The present teaching relates to method, system, medium, and implementation for sensor protection. It is determined whether a cleaning operation needs to be applied to a portion of a sensor assembly deployed on a vehicle and hosting a sensor therein to acquire information of a surrounding through the portion to facilitate autonomous driving. If the cleaning operation is to be applied, at least one type of cleaning is selected to be carried out by one or more devices mounted on the sensor assembly with respect to the portion. For each of the devices, needed control signal is generated for activating the device to perform a cleaning task the device is configured for and sent to the device to clean the certain portion of the sensor assembly in order to prevent degradation in the information acquired by the sensor through the portion.

Claims (75)

1. A method implemented on at least one machine including at least one processor, memory, and communication platform capable of connecting to a network for sensor protection, the method comprising:

determining whether a cleaning operation needs to be applied to a portion of a sensor assembly deployed on a vehicle and hosting a sensor therein to acquire information of a surrounding through the portion to facilitate autonomous driving;

selecting, if the cleaning operation is to be applied, at least one type of cleaning to be carried out by one or more devices mounted on the sensor assembly with respect to the portion; and

with respect to each of the one or more devices,

generating at least one control signal for activating each of the one or more devices to perform a cleaning task the device is configured for, and

sending the control signals to the one or more cleaning devices to clean the certain portion of the sensor assembly to prevent degradation in the information acquired by the sensor through the portion.

2. The method of claim 1 , wherein

the portion is transparent surface located in the front of the sensor assembly;

the sensor is a camera and acquires visual information of the surrounding through the transparent surface.

3. The method of claim 1 , wherein the step of determining comprises:

obtaining a cleaning schedule configured for governing how frequent the sensor assembly is to be cleaned in order to minimize negative impact on the information acquired by the sensor through the sensor assembly;

checking a timer against the cleaning schedule to determine if it is a time to perform the cleaning operation.

4. The method of claim 1 , wherein the step of determining comprises:

analyzing the information to assess degradation in the information;

estimating a cause of the degradation, including a presence of undesired objects deposited on the portion of the sensor assembly;

if the cause being related to presence of undesired objects deposited on the portion of the sensor assembly, determining to apply the cleaning operation to remove the undesired objects.

5. The method of claim 1 , wherein the one or more devices include a fluid cleaning device, a wiper assembly, and an air blower assembly.

6. The method of claim 5 , wherein

the fluid cleaning device comprises a spray manifold with spray holes thereon,

the wiper assembly comprises a wiper blade and a motor; and

the air blower assembly comprises an air hose and an air source.

7. The method of claim 6 , wherein:

the manifold and spray holes are configured to deliver cleaning fluid from a source to the slanted surface;

the wiper blade is configured to move along the slanted surface when the motor is activated; and

the air hose includes at least one slot to direct air from the air source towards the slanted surface to remove any deposit thereon.

8. Machine readable and non-transitory medium having information recorded thereon for sensor protection, wherein the information, when read by the machine, causes the machine to perform:

determining whether a cleaning operation needs to be applied to a portion of a sensor assembly deployed on a vehicle and hosting a sensor therein to acquire information of a surrounding through the portion to facilitate autonomous driving;

selecting, if the cleaning operation is to be applied, at least one type of cleaning to be carried out by one or more devices mounted on the sensor assembly with respect to the portion; and

with respect to each of the one or more devices,

generating at least one control signal for activating each of the one or more devices to perform a cleaning task the device is configured for, and

sending the control signals to the one or more cleaning devices to clean the certain portion of the sensor assembly to prevent degradation in the information acquired by the sensor through the portion.

9. The medium of claim 8 , wherein

the portion is transparent surface located in the front of the sensor assembly;

the sensor is a camera and acquires visual information of the surrounding through the transparent surface.

10. The medium of claim 8 , wherein the step of determining comprises:

obtaining a cleaning schedule configured for governing how frequent the sensor assembly is to be cleaned in order to minimize negative impact on the information acquired by the sensor through the sensor assembly;

checking a timer against the cleaning schedule to determine if it is a time to perform the cleaning operation.

11. The medium of claim 8 , wherein the step of determining comprises:

analyzing the information to assess degradation in the information;

estimating a cause of the degradation, including a presence of undesired objects deposited on the portion of the sensor assembly;

if the cause being related to presence of undesired objects deposited on the portion of the sensor assembly, determining to apply the cleaning operation to remove the undesired objects.

12. The medium of claim 8 , wherein the one or more devices include a fluid cleaning device, a wiper assembly, and an air blower assembly.

13. The medium of claim 12 , wherein

the fluid cleaning device comprises a spray manifold with spray holes thereon,

the wiper assembly comprises a wiper blade and a motor; and

the air blower assembly comprises an air hose and an air source.

14. The medium of claim 13 , wherein:

the manifold and spray holes are configured to deliver cleaning fluid from a source to the slanted surface;

the wiper blade is configured to move along the slanted surface when the motor is activated; and

the air hose includes at least one slot to direct air from the air source towards the slanted surface to remove any deposit thereon.

15. A sensor protection mechanism, comprising:

a cleaning need determiner configured for determining whether a cleaning operation needs to be applied to a portion of a sensor assembly deployed on a vehicle and hosting a sensor therein to acquire information of a surrounding through the portion to facilitate autonomous driving;

a cleaning activity configuration unit configured for selecting, if the cleaning operation is to be applied, at least one type of cleaning to be carried out by one or more devices mounted on the sensor assembly with respect to the portion; and

a cleaning control signal generator configured for, with respect to each of the one or more devices,

generating at least one control signal for activating each of the one or more devices to perform a cleaning task the device is configured for, and

sending the control signals to the one or more cleaning devices to clean the certain portion of the sensor assembly to prevent degradation in the information acquired by the sensor through the portion.

16. The system of claim 15 , wherein

the portion is transparent surface located in the front of the sensor assembly;

the sensor is a camera and acquires visual information of the surrounding through the transparent surface.

17. The system of claim 15 , further comprising a cleaning activity scheduler configured for

obtaining a cleaning schedule configured for governing how frequent the sensor assembly is to be cleaned in order to minimize negative impact on the information acquired by the sensor through the sensor assembly; and

checking a timer against the cleaning schedule to determine if it is a time to perform the cleaning operation.

18. The system of claim 15 , further comprising:

a sensor data feature extractor configured for analyzing the information to assess degradation in the information; and

a degradation cause classifier configured for estimating a cause of the degradation, including a presence of undesired objects deposited on the portion of the sensor assembly, wherein

if the cause being related to presence of undesired objects deposited on the portion of the sensor assembly, the cleaning need determiner is configured for determining to apply the cleaning operation to remove the undesired objects.

19. The system of claim 15 , wherein the one or more devices include a fluid cleaning device, a wiper assembly, and an air blower assembly.

20. The system of claim 19 , wherein

the fluid cleaning device comprises a spray manifold with spray holes thereon,

the wiper assembly comprises a wiper blade and a motor; and

the air blower assembly comprises an air hose and an air source.

21. The system of claim 20 , wherein:

the manifold and spray holes are configured to deliver cleaning fluid from a source to the slanted surface;

the wiper blade is configured to move along the slanted surface when the motor is activated; and

the air hose includes at least one slot to direct air from the air source towards the slanted surface to remove any deposit thereon.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2021
From: PLUSAI LIMITED
To: PLUSAI, INC.
Reel/Frame 056909/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2021
From: PLUSAI CORP
To: PLUSAI LIMITED
Reel/Frame 055441/0135 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2020
From: LI, JINPENG; SEYFARTH, GREG; ZHANG, QIAOYU; KUMAR, AMIT
To: PLUSAI CORP
Reel/Frame 052107/0617 →
Continuity (1)
Related Publication 20210181502A1 · Jun 17, 2021