IP Library Granted Patent US 11,544,868
Granted Patent B2
US 11,544,868 · App. 16/764,897 · Granted Jan 3, 2023

Object location coordinate determination

Inventors: Jovan Milivoje Zagajac (Ann Arbor, MI); Ivan Vukovic (Arlington Heights, IL)
Assignee: FORD GLOBAL TECHNOLOGIES, LLC
G06T7/73G05D1/0246G06T7/20G06T7/60G06V20/54G08G1/164G01S19/42G05D2201/0213G06T2207/30236G06T2207/30241G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,544,868
App. No.
16/764,897
Granted
Jan 3, 2023
Kind
B2
Abstract

A system includes a processor and a memory. The memory stores instructions executable by the processor to receive an image from a stationary camera. The memory stores instructions to determine location coordinates of an object identified in the image based on location coordinates specified for the image. The memory stores instructions to operate a vehicle based on the object location coordinates.

Claims (34)

1. A system, comprising a processor and a memory, the memory storing instructions executable by the processor to:

receive an image from a stationary camera;

based on location coordinates specified for the image, determine location coordinates of an object identified in the image, wherein the location coordinates specified for the image are associated with a visual feature in the received image that includes a calibration sign, wherein the calibration sign is a portable sign and the calibration sign further includes a GPS sensor and a second processor programmed to transmit the location coordinates of the calibration sign based on data received from the GPS sensor of the calibration sign;

receive geometrical properties of the visual feature and location coordinates of the visual feature;

detect the visual feature in the received camera image based on the received geometrical properties;

specify location coordinates for the image by associating the received location coordinates to a projection point of the visual feature in the received image; and

based on the object location coordinates, operate a vehicle.

2. The system of claim 1 , wherein the instructions further include instructions to determine the object location coordinates based on stored location coordinates of each of a plurality of reference points in the image.

3. The system of claim 2 , wherein the instructions further include instructions to:

determine the object location coordinates by identifying one or more projection points in the image associated with the object; and

determine the object location coordinates based on the stored location coordinates.

4. The system of claim 1 , wherein the instructions further include instructions to:

upon determining that a projection point in the image associated with a reference location has moved, adjust predetermined location coordinates of the reference location; and

determine the object location coordinates based on the adjusted location coordinates of the reference location.

5. The system of claim 1 , wherein the instructions further include instructions to determine the location coordinates specified for the image based on a camera location and an orientation of the camera.

6. The system of claim 1 , wherein the instructions further include instructions to determine at least one of a trajectory and a speed of the object based on the received camera image.

7. The system of claim 1 , wherein instructions further include instructions to operate the vehicle by actuating a vehicle brake actuator based on the location coordinates of the detected object and a trajectory of the vehicle.

8. A method, comprising:

receiving an image from a stationary camera;

based on location coordinates specified for the image, determining location coordinates of an object identified in the image, wherein the location coordinates specified for the image are associated with a visual feature in the received image that includes a calibration sign, wherein the calibration sign is a portable sign and the calibration sign further includes a GPS sensor and a second processor programmed to transmit the location coordinates of the calibration sign based on data received from the GPS sensor of the calibration sign;

receive geometrical properties of the visual feature and location coordinates of the visual feature;

detect the visual feature in the received camera image based on the received geometrical properties;

specify location coordinates for the image by associating the received location coordinates to a projection point of the visual feature in the received image; and

based on the object location coordinates, operating a vehicle.

9. The method of claim 8 , further comprising determining the object location coordinates based on stored location coordinates of each of a plurality of reference points in the image.

10. The method of claim 9 , further comprising:

determining the object location coordinates by identifying one or more projection points in the image associated with the object; and

determining the object location coordinates based on the stored location coordinates.

11. The method of claim 8 , further comprising:

upon determining that a projection point in the image associated with a reference location has moved, adjusting the predetermined location coordinates of the reference location; and

determining the object location coordinates based on the adjusted location coordinates of the reference location.

12. The method of claim 8 , further comprising determining the location coordinates specified for the image based on a camera location and an orientation of the camera.

13. The method of claim 8 , further comprising determining at least one of a trajectory and a speed of the object based on the received camera image.

14. The method of claim 8 , further comprising performing the vehicle operation by actuating a vehicle brake actuator based on the location coordinates of the detected object and a trajectory of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2020
From: ZAGAJAC, JOVAN MILIVOJE; VUKOVIC, IVAN
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 052681/0803 →
Continuity (1)
Related Publication 20200342620A1 · Oct 29, 2020