IP Library Granted Patent US 8,907,771
Granted Patent B2
US 8,907,771 · App. 13/942,075 · Granted Dec 9, 2014

Vehicle and mobile device traffic hazard warning techniques

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,907,771
App. No.
13/942,075
Granted
Dec 9, 2014
Kind
B2
Abstract

A computer-implemented method includes monitoring an environment external to a vehicle via a sensor of the vehicle or a mobile device. The monitoring includes recording audio or video signals based on an output of the sensor. Audio or image recognition is performed via the mobile device based on the audio or video signals. Based on results of the audio or image recognition, objects in an area through which the vehicle is to pass are detected. The method includes determining which ones of the detected objects satisfy a predetermined criteria. The predetermined criteria includes object features that are indiscernible or marginally discernible to a vehicle operator with a perception deficiency. Selected ones of the detected objects that satisfy the predetermined criteria are monitored. The vehicle operator is alerted of the selected ones of the detected objects with an alert predetermined to be discernible to the vehicle operator.

Claims (42)

1. A mobile device, comprising:

a memory adapted to store one or more input parameters identifying at least one object to monitor;

a sensor configured to:

monitor an environment external to a vehicle,

capture images of such environment from a location within the vehicle, and

generate an image signal representing a captured image;

one or more processing units configured to:

perform image recognition based on the captured image utilizing the input parameters,

detect objects in the environment external to the vehicle based on results of the image recognition, and

identify selected ones of the detected objects as traffic indicators based on one or more predetermined criteria; and

an output device configured to output an alert to a vehicle operator of the detected objects identified;

wherein the one or more processing units are further configured to determine that the traffic indicators are marginally discernible or indiscernible to the vehicle operator with a perception deficiency.

2. The mobile device of claim 1 , wherein the alert comprises an audio alert.

3. The mobile device of claim 1 , wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

4. The mobile device of claim 1 , wherein the traffic indicators include one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator, wherein the alert comprises an alert to the vehicle operator of the detected objects identified as having one or more of the colors.

5. The mobile device of claim 1 , wherein the output device is a display screen, and outputting the alert comprises altering an image of the traffic indicators on the display screen in an augmented reality of the environment displayed on the display screen.

6. A computer-implemented method, comprising:

monitoring, via a sensor associated with at least one of a vehicle and a mobile device, an environment external to the vehicle, wherein the monitoring of the environment includes recording video signals of the environment based on an output of the sensor;

performing image recognition based on the video signals;

detecting, at the mobile device and based on results of the image recognition, objects in the environment external to the vehicle;

identifying that at least one of the objects detected comprises a traffic indicator;

outputting an alert corresponding to the traffic indicator;

determining, by one or more processors, that the traffic indicators are marginally discernible or indiscernible to a vehicle operator with a perception deficiency.

7. The computer-implemented method of claim 6 , wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

8. The computer-implemented method of claim 6 , further comprising monitoring the environment via a sensing network including:

monitoring the area via the sensor, wherein the sensing network comprises the sensor and a second sensor; and

monitoring, via a second sensor, an area other than the environment external to the vehicle monitored by the sensor, wherein the video signals are generated based on an output of the second sensor.

9. The computer-implemented method of claim 6 , wherein the sensor is mounted at least one of in and on the mobile device.

10. The computer-implemented method of claim 6 , wherein the traffic indicator includes one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator, wherein outputting the alert comprises alerting the vehicle operator of detected objects identified as having one or more of the colors.

11. The computer-implemented method of claim 6 , wherein the alert comprises an audio alert.

12. The computer-implemented method of claim 6 , wherein outputting the alert comprises altering an image of the traffic indicator in an augmented reality of the environment displayed on the mobile device.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause a computing device to output an alert, by performing the steps of:

monitoring, via a sensor associated with at least one of a vehicle and a mobile device, an environment external to the vehicle, wherein the monitoring of the environment includes recording video signals of the environment based on an output of the sensor;

performing image recognition based on the video signals;

detecting, at the mobile device and based on results of the image recognition, objects in the environment external to the vehicle;

identifying that at least one of the objects detected comprises a traffic indicator;

outputting an alert corresponding to the traffic indicator;

determining that the traffic indicators are marginally discernible or indiscernible to a vehicle operator with a perception deficiency.

14. The computer-readable storage medium of claim 13 , wherein the alert comprises an audio alert.

15. The computer-readable storage medium of claim 13 , wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

16. The computer-readable storage medium of claim 13 , wherein the traffic indicator includes one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator, wherein outputting the alert comprises alerting the vehicle operator of detected objects identified as having one or more of the colors.

17. The computer-readable storage medium of claim 13 , wherein outputting the alert comprises altering an image of the traffic indicator in an augmented reality of the environment displayed on the mobile device.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE REMOVAL OF THE INCORRECTLY RECORDED APPLICATION NUMBERS 14/149802 AND 15/419313 PREVIOUSLY RECORDED AT REEL: 44144 FRAME: 1. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 4, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068092/0502 →
SUBMISSION TO CORRECT AN ERROR MADE IN A PREVIOUSLY RECORDED DOCUMENT THAT ERRONEOUSLY AFFECTS THE IDENTIFIED APPLICATIONS Recorded Nov 11, 2019
From: WAYMO LLC
To: WAYMO LLC
Reel/Frame 050978/0359 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044144/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2017
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 042108/0021 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2017
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 042099/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2013
From: VASQUEZ, JUAN; MOK, VINSON
To: GOOGLE INC.
Reel/Frame 030798/0413 →