IP Library Granted Patent US 11,767,016
Granted Patent B2
US 11,767,016 · App. 17/242,082 · Granted Sep 26, 2023

Optical route examination system and method

Inventors: Nidhi Naithani (Dublin, IE); Dattaraj Jagdish Rao (Bangalore, IN); Anju Bind (Bangalore, IN); Sreyashi Dey Chaki (Bangalore, IN); James D. Brooks (Grove City, PA); Jeffrey Armstrong (Haslet, TX); Michael Scott Miner (Titusville, FL); Shannon Joseph Clouse (Erie, PA); Harry Kirk Mathews, Jr. (Clifton Park, NY)
Assignee: Transportation IP Holdings, LLC
B60W30/16B61C17/12B61L3/127
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,767,016
App. No.
17/242,082
Granted
Sep 26, 2023
Kind
B2
Abstract

A method includes obtaining one or more images of a segment of a route from a camera while a vehicle is moving along the route. The segment of the route includes one or more guide lanes. The method also includes comparing, with one or more computer processors, the one or more images of the segment of the route with a benchmark visual profile of the route based at least in part on an overlay of the one or more images onto the benchmark visual profile or an overlay of the benchmark visual profile onto the one or more images. The one or more processors identify a misaligned segment of the route based on one or more differences between the one or more images and the benchmark visual profile and respond to the identification of the misaligned segment of the route by modifying an operating parameter of the vehicle.

Claims (36)

1. A method comprising:

obtaining one or more images of a route while a vehicle is moving along the route, the route including a first guide lane;

determining a position of the vehicle relative to the first guide lane by measuring a first distance between the vehicle and the first guide lane, the first distance being perpendicular to a direction of movement of the vehicle;

determining whether a number of pixels of the one or more images exceeds a threshold value, the pixels corresponding to one or more wheels of the vehicle and that is disposed outside of a region of a benchmark visual profile of the route corresponding to a target position of the one or more wheels;

determining whether the position of the vehicle is to be changed based on one or more of the first distance or the number of the pixels disposed outside of the region of the benchmark visual profile exceeding the threshold value; and

modifying an operating parameter of the vehicle to change the position of the vehicle relative to the first guide lane responsive to determining that the position of the vehicle is to be changed.

2. The method of claim 1 , further comprising determining a position of a first wheel of the one or more wheels relative to the first guide lane.

3. The method of claim 1 , further comprising determining the position of the vehicle by measuring an intensity of the pixels in the one or more images.

4. The method of claim 1 , further comprising identifying portions of the one or more images that represent the vehicle by measuring intensities of the pixels in the one or more images and distinguishing the portions of the one or more images that represent the vehicle from other portions of the one or more images based on the intensities.

5. The method of claim 1 , wherein modifying the operating parameter of the vehicle includes adjusting steering of the vehicle based on the position of the vehicle relative to the first guide lane.

6. The method of claim 1 , further comprising obtaining the one or more images of the route for a determined distance of travel of the vehicle, and determining whether the position of the vehicle is to be changed based on the position of the vehicle changing by a threshold value along the determined distance of travel of the vehicle.

7. The method of claim 1 , further comprising comparing the one or more images with the benchmark visual profile of the route based at least in part on an overlay of the one or more images onto the benchmark visual profile or an overlay of the benchmark visual profile onto the one or more images, the benchmark visual profile comprising designated areas corresponding to each of the first guide lane and a region corresponding to the target position of the vehicle.

8. The method of claim 7 , further comprising determining the position of the vehicle based at least in part on the overlay of the one or more images onto the benchmark visual profile or the overlay of the benchmark visual profile onto the one or more images.

9. The method of claim 1 , further comprising:

determining the position of the vehicle relative to a second guide lane by measuring a second distance between the vehicle and the second guide lane;

determining whether the position of the vehicle is to be changed based at least in part on the second distance; and

modifying an operating parameter of the vehicle to change the position of the vehicle relative to the second guide lane responsive to determining that the position of the vehicle is to be changed.

10. A system, comprising:

a camera configured to be detachably coupled or mounted to a vehicle and to obtain one or more images of a route and the vehicle while the vehicle moves along the route, wherein the route includes a first guide lane; and

a controller having one or more processors configured to determine a position of the vehicle relative to the first guide lane by measuring a first distance between the vehicle and a first guide lane, the first distance being perpendicular to a direction of movement of the vehicle,

the one or more processors configured to determine whether a number of pixels of the one or more images exceeds a threshold value, the pixels corresponding to one or more wheels of the vehicle and that is disposed outside of a region of a benchmark visual profile of the route corresponding to a target position of the one or more wheels,

the one or more processors further configured to determine whether an operating parameter of the vehicle is to be changed based on one or more of the first distance or the number of the pixels disposed outside of the region of the benchmark visual profile exceeding the threshold value, and

responsive to determining that the operating parameter of the vehicle is to be changed, the one or more processors being further configured to modify the operating parameter of the vehicle to change the position of the vehicle relative to the first guide land.

11. The system of claim 10 , wherein the one or more processors are configured to determine a position of a first wheel of the one or more wheels relative to the first guide lane, and determine a position of the vehicle based at least in part on the position of the first wheel.

12. The system of claim 10 , wherein the one or more processors are further configured to determine the position of the wheel of the vehicle by measuring intensities of pixels in the one or more images.

13. The system of claim 10 , wherein the one or more processors are configured to identify portions of the one or more images that represent the one or more wheels of the vehicle by measuring intensities of the pixels in the one or more images and distinguishing the portions of the one or more images that represent the one or more wheels of the vehicle from other portions of the one or more images based on the intensities.

14. The system of claim 10 , wherein the one or more processors are configured to compare the one or more images with the benchmark visual profile of the route based at least in part on an overlay of the one or more images onto the benchmark visual profile or an overlay of the benchmark visual profile onto the one or more images, the benchmark visual profile comprising designated areas corresponding to the first guide lane and a region corresponding to the target position of a wheel.

15. The system of claim 10 , wherein the one or more processors are further configured to adjust steering of the vehicle based on the position of the vehicle relative to the first guide lane.

16. A method comprising:

obtaining one or more images of a route and a wheel of a vehicle while the vehicle is moving along the route, the route including guide lanes;

comparing the one or more images with a benchmark visual profile of the route based at least in part on an overlay of the one or more images onto the benchmark visual profile or an overlay of the benchmark visual profile onto the one or more images, the benchmark visual profile comprising designated areas corresponding to each of the guide lanes and a region corresponding to a target position of the wheel;

identifying a position of the wheel of the vehicle relative to the guide lanes based in part on the comparing of the one or more images with the benchmark visual profile of the route;

determining whether the position of the wheel of the vehicle is to be changed based on a number of pixels of the one or more images corresponding to the wheel disposed outside of the region of the benchmark visual profile exceeding a threshold value; and

modifying an operating parameter of the vehicle to change the position of the wheel responsive to determining that the position of the wheel of the vehicle is to be changed.

17. The system of claim 10 , wherein the one or more processors are configured to determine the position of the vehicle relative to a second guide lane by measuring a second distance between the vehicle and the second guide lane.

18. The system of claim 17 , wherein the one or more processors are configured to determine whether the position of the vehicle is to be changed based at least in part on the second distance, the one or more processors configured to modify an operating parameter of the vehicle to change the position of the vehicle relative to the second guide lane responsive to determining that the position of the vehicle is to be changed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2022
From: NAITHANI, NIDHI; RAO, DATTARAJ JAGDISH; BROOKS, JAMES D.; ARMSTRONG, JEFFERY; MINER, MICHAEL SCOTT; CLOUSE, SHANNON JOSEPH; MATHEWS, HARRY KIRK, JR.
To: TRANSPORTATION IP HOLDINGS, LLC
Reel/Frame 059934/0681 →
Continuity (28)
Continuation In Part 16244286 · Jan 10, 2019
Continuation In Part 14217672 · Mar 18, 2014
Continuation In Part 17242082
Continuation In Part 16577819 · Sep 20, 2019
Continuation 15412692 · Jan 23, 2017
Continuation 17242082
Continuation In Part 16450024 · Jun 24, 2019
Continuation 15482240 · Apr 7, 2017
Continuation 17242082
Continuation In Part 16136423 · Sep 20, 2018
Division 14541370 · Nov 14, 2014
Continuation In Part 14217672 · Mar 18, 2014
Continuation In Part 14253294 · Apr 15, 2014
Continuation In Part 14457353 · Aug 12, 2014
Continuation In Part 14479847 · Sep 8, 2014
Continuation In Part 14485398 · Sep 12, 2014
Continuation In Part 13109209 · May 17, 2011
Division 11146831 · Jun 6, 2005
Continuation In Part 10361968 · Feb 10, 2003
Continuation In Part 14217672 · Mar 18, 2014
Provisional Application 62469142 · Mar 9, 2017
Provisional Application 61940813 · Feb 17, 2014
Provisional Application 61940696 · Feb 17, 2014
Provisional Application 61940610 · Feb 17, 2014
Provisional Application 61940660 · Feb 17, 2014
Provisional Application 60626573 · Nov 10, 2004
Provisional Application 60385645 · Jun 4, 2002
Related Publication 20210245747A1 · Aug 12, 2021