IP Library Granted Patent US 10,721,376
Granted Patent B2
US 10,721,376 · App. 15/960,685 · Granted Jul 21, 2020

System and method to identify backup camera vision impairment

Inventor: Kunal Jaggi (Troy, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
H04N5/2171G06K9/00805H04N7/188B60R2300/307
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,721,376
App. No.
15/960,685
Granted
Jul 21, 2020
Kind
B2
Abstract

A system to identify vision sensor impairment, the system including: a memory with one or more executable instructions; a controller to execute the executable instructions; a vision sensor located on a vehicle to capture at least one image of at least a portion of an environment surrounding the vehicle; where the executable instructions enable the controller to: receive a request communicated from a mobile computing device; in response to the request, communicate an activation signal to the vision sensor, the activation signal to activate the vision sensor to capture an image of the environment surrounding the vehicle; receive the captured image from the vision sensor; determine whether the view of the captured image includes a substantially impairing weather debris object; and based on this determination, generate a notification and communicate the notification to the mobile computing device.

Claims (39)

1. A system to identify backup camera impairment, the system comprising:

a memory configured to comprise one or more executable instructions;

a controller configured to execute the executable instructions;

a backup camera located on a rear end of a vehicle exterior, the backup camera configured to capture at least one image of at least a portion of an area behind a vehicle; and

wherein the executable instructions enable the controller to:

receive a request communicated from a mobile computing device;

in response to the request, communicate an activation signal to the backup camera, the activation signal configured to activate the backup camera to capture at least one image of at least a portion of an area behind the vehicle upon the vehicle being turned on and before the vehicle begins to move;

receive the at least one captured image from the backup camera;

determine whether the view of the at least one captured image comprises an impairing amount of weather debris that has covered the lens of the backup camera such that the at least one captured image cannot operatively assist a user while attempting to operate the vehicle in reverse; and

based on the determination of whether the view of the at least one captured image comprises at least one substantially impairing debris object, generate a notification and communicate the notification to the mobile computing device, wherein the notification is configured to provide a warning for the user to manually clean the lens of the backup camera such that the user should substantially remove the weather debris from the lens.

2. The system of claim 1 , wherein the executable instructions further enable the controller to, in response to the request, communicate a remote start signal to the vehicle, the remote start signal configured to turn on the vehicle.

3. The system of claim 1 , wherein the notification is further configured to be displayed via a vehicle app installed onto the mobile computing device.

4. The system of claim 1 , wherein the determination of whether the view of the at least one captured image comprises at least one substantially impairing debris object is further based on a result from at least one object recognition technique carried out at a data center.

5. The system of claim 1 , wherein the determination of whether the view of the at least one captured image comprises at least one substantially impairing debris object is further based on a result from at least one object recognition technique carried out at the backup camera.

6. The system of claim 1 , wherein the memory and controller are located at a data center.

7. A method to identify backup camera impairment, the method comprising:

providing a memory configured to comprise one or more executable instructions;

providing a controller configured to execute the executable instructions;

providing a backup camera located on a rear end of a vehicle exterior, the backup camera configured to capture at least one image of at least a portion of an area behind a vehicle;

receiving (via the controller) a request communicated from a mobile computing device;

in response to the request, communicating (via the controller) an activation signal to the backup camera, the activation signal configured to activate the backup camera to capture at least one image of at least a portion of an area behind the vehicle upon the vehicle being turned on and before the vehicle begins to move;

receiving (via the controller) the at least one captured image from the backup camera;

determining (via the controller) whether the view of the at least one captured image comprises an impairing amount of weather debris that has covered the lens of the backup camera such that the at least one captured image cannot operatively assist a user while attempting to operate the vehicle in reverse; and

based on the determination step, generating and communicating (via the controller) a notification to the mobile computing device, wherein the notification is configured to provide a warning for the user to manually clean the lens of the backup camera such that the user should substantially remove the weather debris from the lens.

8. The method of claim 7 , further comprising, in response to the request, communicating (via the controller) a remote start signal to the vehicle, the remote start signal configured to turn on the vehicle.

9. The method of claim 7 , wherein the notification is further configured to be displayed via a vehicle app installed onto the mobile computing device.

10. The method of claim 7 , wherein the determination of whether the view of the at least one captured image comprises at least one substantially impairing weather debris object is further based on a result from at least one object recognition technique carried out at a data center.

11. The method of claim 7 , wherein the determination of whether the view of the at least one captured image comprises at least one substantially impairing weather debris object is further based on a result from at least one object recognition technique carried out at the backup camera.

12. The method of claim 7 , wherein the memory and controller are located at a data center.

13. A non-transitory and machine-readable medium having stored thereon executable instructions adapted to identify backup camera impairment, which when provided to a controller and executed thereby, causes the controller to:

receive a request communicated from a mobile computing device;

in response to the request, communicate an activation signal to a backup camera, wherein the backup camera located on a rear end of a vehicle exterior, and wherein the activation signal configured to activate the backup camera to capture at least one image of at least a portion of an area behind the vehicle upon the vehicle being turned on and before the vehicle begins to move;

receive the at least one captured image from the backup camera;

determine whether the view of the at least one captured image comprises an impairing amount of weather debris that has covered the lens of the backup camera such that the at least one captured image cannot operatively assist a user while attempting to operate the vehicle in reverse; and

based on the determination of whether the view of the at least one captured image comprises the impairing amount of weather debris, generate and communicate a notification to the mobile computing device, wherein the notification is configured to provide a warning for the user to manually clean the lens of the backup camera such that the user should substantially remove the weather debris from the lens.

14. The non-transitory and machine-readable memory of claim 13 , further comprising, in response to the request, communicate a remote start signal to the vehicle, the remote start signal configured to turn on the vehicle.

15. The non-transitory and machine-readable memory of claim 13 , wherein the notification is further configured to be displayed via a vehicle app installed onto the mobile computing device.

16. The non-transitory and machine-readable memory of claim 13 , wherein the determination of whether the view of the at least one captured image comprises at least one substantially impairing weather debris object is further based on a result of at least one object recognition technique carried out at a data center.

17. The non-transitory and machine-readable memory of claim 13 , wherein the determination of whether the view of the at least one captured image comprises at least one substantially impairing weather debris object is further based on a result of at least one object recognition technique carried out at the backup camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2018
From: JAGGI, KUNAL
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 045618/0712 →
Continuity (1)
Related Publication 20190327391A1 · Oct 24, 2019